Nov 05 19:00:42 devstack cinder-volume[76130]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 05 19:00:42 devstack cinder-volume[76130]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 05 19:00:42 devstack cinder-volume[76130]: we strongly recommend against using it for new projects.
Nov 05 19:00:42 devstack cinder-volume[76130]: If you are already using Eventlet, we recommend migrating to a different
Nov 05 19:00:42 devstack cinder-volume[76130]: framework.  For more detail see
Nov 05 19:00:42 devstack cinder-volume[76130]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 05 19:00:42 devstack cinder-volume[76130]:   import eventlet  # noqa
Nov 05 19:00:45 devstack cinder-volume[76130]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76130) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 19:00:45 devstack cinder-volume[76130]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76130) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 19:00:45 devstack cinder-volume[76130]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76130) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 19:00:46 devstack cinder-volume[76130]: INFO dbcounter [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] Registered counter for database cinder
Nov 05 19:00:46 devstack cinder-volume[76130]: DEBUG oslo_db.sqlalchemy.engines [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76130) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 19:00:46 devstack cinder-volume[76130]: DEBUG dbcounter [-] [76130] Writer thread running {{(pid=76130) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 19:00:46 devstack cinder-volume[76130]: INFO cinder.rpc [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 05 19:00:46 devstack cinder-volume[76130]: INFO cinder.rpc [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 05 19:00:46 devstack cinder-volume[76130]: DEBUG oslo_db.sqlalchemy.engines [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76130) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 19:00:47 devstack cinder-volume[76130]: INFO cinder.volume.manager [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] Determined volume DB was empty at startup.
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG cinder.volume.manager [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76130) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 05 19:00:47 devstack cinder-volume[76130]: INFO cinder.volume.manager [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 05 19:00:47 devstack cinder-volume[76130]: WARNING stevedore.named [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 05 19:00:47 devstack cinder-volume[76130]: WARNING castellan.key_manager [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 19:00:47 devstack cinder-volume[76130]: WARNING cinder.keymgr.conf_key_mgr [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG cinder.volume.drivers.lvm [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76130) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_concurrency.processutils [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76130) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_concurrency.processutils [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] CMD "cinder-rtstool verify" returned: 0 in 0.621s {{(pid=76130) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_db.sqlalchemy.engines [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76130) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 19:00:47 devstack cinder-volume[76130]: INFO cinder.rpc [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Nov 05 19:00:47 devstack cinder-volume[76130]: INFO cinder.rpc [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Nov 05 19:00:47 devstack cinder-volume[76130]: WARNING stevedore.named [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 05 19:00:47 devstack cinder-volume[76130]: WARNING castellan.key_manager [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 19:00:47 devstack cinder-volume[76130]: INFO cinder.volume.manager [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_db.sqlalchemy.engines [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76130) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 19:00:47 devstack cinder-volume[76130]: INFO oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] Starting 1 workers
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] Started child 76307 {{(pid=76130) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] Full set of CONF: {{(pid=76130) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] ******************************************************************************** {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] Configuration options gathered from: {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] ================================================================================ {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] allow_availability_zone_fallback = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] allow_compression_on_image_upload = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] allowed_direct_url_schemes     = [] {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] api_rate_limit                 = True {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] auth_strategy                  = keystone {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] az_cache_duration              = 3600 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_availability_zone      = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_host                   = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_name                   = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_stats_polling_interval = 60 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76307]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1)
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backup_api_class               = cinder.backup.api.API {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backup_name_template           = backup-%s {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backup_use_same_host           = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backup_use_temp_snapshot       = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] chap_password                  = **** {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] chap_username                  =  {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cinder_internal_tenant_project_id = 71768ad4ac7c4eab8cee7d33030a9887 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cinder_internal_tenant_user_id = 4eae7cb6fd2b48a1b3acae91e77ac11a {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cloned_volume_same_az          = True {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cluster                        = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] compression_format             = gzip {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] compute_api_class              = cinder.compute.nova.API {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] config_dir                     = [] {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] config_source                  = [] {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] control_exchange               = openstack {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] debug                          = True {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] default_availability_zone      = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] default_group_type             = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] default_volume_type            = lvmdriver-1 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] disk_geometry                  = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] driver_client_cert             = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] driver_client_cert_key         = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] driver_data_namespace          = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] driver_ssl_cert_path           = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] driver_ssl_cert_verify         = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] driver_use_ssl                 = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] enable_force_upload            = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] enable_new_services            = True {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] enable_unsupported_driver      = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] enabled_backends               = ['lvmdriver-1'] {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] enforce_multipath_for_image_xfer = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] filter_function                = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] glance_api_insecure            = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] glance_api_servers             = ['http://192.168.122.24/image'] {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] glance_api_ssl_compression     = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] glance_ca_certificates_file    = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] glance_catalog_info            = image:glance:publicURL {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] glance_certfile                = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] glance_keyfile                 = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] glance_num_retries             = 3 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] glance_request_timeout         = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] goodness_function              = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] graceful_shutdown_timeout      = 5 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] group_api_class                = cinder.group.api.API {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] host                           = devstack {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] image_compress_on_upload       = True {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] image_conversion_address_space_limit = 1 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] image_conversion_cpu_limit     = 60 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] image_conversion_disable       = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] image_introspection_address_space_limit = 1 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] image_introspection_cpu_limit  = 60 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] image_upload_use_cinder_backend = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] image_upload_use_internal_tenant = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] image_volume_cache_enabled     = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] image_volume_cache_max_count   = 0 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] image_volume_cache_max_size_gb = 0 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] init_host_max_objects_retrieval = 0 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] instance_format                = [instance: %(uuid)s]  {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] iscsi_target_flags             =  {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] iscsi_write_cache              = on {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] iser_helper                    = tgtadm {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] iser_ip_address                = 192.168.122.24 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] iser_port                      = 3260 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] log_color                      = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] log_config_append              = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] log_dir                        = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] log_file                       = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] log_options                    = True {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] log_rotate_interval            = 1 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] log_rotate_interval_type       = days {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] log_rotation_type              = none {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] max_age                        = 0 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] max_logfile_count              = 30 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] max_logfile_size_mb            = 200 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] max_over_subscription_ratio    = 20.0 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] message_reap_interval          = 86400 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] message_ttl                    = 2592000 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] migration_create_volume_timeout_secs = 300 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] monkey_patch                   = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] monkey_patch_modules           = [] {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] my_ip                          = 192.168.122.24 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] no_snapshot_gb_quota           = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] num_iser_scan_tries            = 3 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] num_shell_tries                = 3 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] num_volume_device_scan_tries   = 3 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] nvmeof_conn_info_version       = 1 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] nvmet_ns_id                    = 10 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] nvmet_port_id                  = 1 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] osapi_max_limit                = 1000 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] osapi_volume_ext_list          = [] {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] osapi_volume_listen            = 0.0.0.0 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] osapi_volume_listen_port       = 8776 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] osapi_volume_use_ssl           = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] osapi_volume_workers           = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] per_volume_size_limit          = -1 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] periodic_fuzzy_delay           = 60 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] periodic_interval              = 60 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] project_id_regex               = [0-9a-f\-]+ {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] public_endpoint                = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] publish_errors                 = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] quota_backup_gigabytes         = 1000 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] quota_backups                  = 10 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] quota_gigabytes                = 1000 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] quota_groups                   = 10 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] quota_snapshots                = 10 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] quota_volumes                  = 10 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] rate_limit_burst               = 0 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] rate_limit_except_level        = CRITICAL {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] rate_limit_interval            = 0 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] reinit_driver_count            = 3 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] replication_device             = **** {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] report_discard_supported       = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] report_interval                = 120 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] reservation_clean_interval     = 86400 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] reservation_expire             = 86400 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] reserved_image_namespaces      = [] {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] reserved_percentage            = 0 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76307]: INFO cinder.volume.manager [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] rpc_response_timeout           = 120 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] run_external_periodic_tasks    = True {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] scst_target_driver             = iscsi {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:47 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] scst_target_iqn_name           = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] service_down_time              = 720 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] shell_completion               = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] snapshot_name_template         = snapshot-%s {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] snapshot_same_host             = True {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] split_loggers                  = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] state_path                     = /opt/stack/data/cinder {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] storage_availability_zone      = nova {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] storage_protocol               = iSCSI {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] syslog_log_facility            = LOG_USER {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] target_helper                  = lioadm {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] target_ip_address              = 192.168.122.24 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] target_port                    = 3260 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] target_protocol                = iscsi {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] target_secondary_ip_addresses  = [] {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] trace_flags                    = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] transfer_api_class             = cinder.transfer.api.API {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] transport_url                  = **** {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] until_refresh                  = 0 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] use_chap_auth                  = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] use_default_quota_class        = True {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] use_journal                    = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] use_json                       = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] use_multipath_for_image_xfer   = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] use_stderr                     = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] use_syslog                     = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] verify_glance_signatures       = enabled {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] volume_api_class               = cinder.volume.api.API {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] volume_backend_name            = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] volume_clear                   = zero {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] volume_clear_ionice            = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] volume_clear_size              = 0 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] volume_copy_bps_limit          = 0 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] volume_dd_blocksize            = 1M {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] volume_name_template           = volume-%s {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] volume_service_inithost_offload = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] volume_usage_audit_period      = month {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] zoning_mode                    = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_concurrency.disable_process_locking = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] keystone_authtoken.auth_section = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] keystone_authtoken.auth_type   = password {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] keystone_authtoken.auth_version = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] keystone_authtoken.cache       = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] keystone_authtoken.certfile    = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] keystone_authtoken.delay_auth_decision = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] keystone_authtoken.http_connect_timeout = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] keystone_authtoken.include_service_catalog = True {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] keystone_authtoken.insecure    = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] keystone_authtoken.interface   = public {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] keystone_authtoken.keyfile     = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] keystone_authtoken.memcache_password = **** {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] keystone_authtoken.memcache_username = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] keystone_authtoken.region_name = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] keystone_authtoken.service_token_roles_required = True {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] keystone_authtoken.service_type = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] keystone_authtoken.token_cache_time = 300 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.047s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:00:48 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.24/identity {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cache.backend                  = dogpile.cache.null {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cache.backend_argument         = **** {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cache.backend_expiration_time  = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cache.config_prefix            = cache.oslo {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cache.debug_cache_backend      = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cache.enable_retry_client      = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cache.enable_socket_keepalive  = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cache.enabled                  = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cache.expiration_time          = 600 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cache.hashclient_retry_attempts = 2 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cache.memcache_dead_retry      = 300 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cache.memcache_pool_maxsize    = 10 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cache.memcache_sasl_enabled    = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cache.password                 = **** {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cache.proxies                  = [] {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cache.redis_db                 = 0 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cache.redis_sentinel_service_name = mymaster {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cache.redis_server             = localhost:6379 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cache.retry_attempts           = 2 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cache.retry_delay              = 0.0 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cache.socket_keepalive_count   = 1 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cache.socket_keepalive_idle    = 1 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cache.socket_keepalive_interval = 1 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cache.socket_timeout           = 1.0 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cache.tls_allowed_ciphers      = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cache.tls_cafile               = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cache.tls_certfile             = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cache.tls_enabled              = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cache.tls_keyfile              = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cache.username                 = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] coordination.backend_url       = **** {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] database.asyncio_connection    = **** {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] database.asyncio_slave_connection = **** {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] database.backend               = sqlalchemy {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] database.connection            = **** {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] database.connection_debug      = 0 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] database.connection_parameters =  {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] database.connection_recycle_time = 3600 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] database.connection_trace      = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] database.db_inc_retry_interval = True {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] database.db_max_retries        = 20 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] database.db_max_retry_interval = 10 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] database.db_retry_interval     = 1 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] database.max_overflow          = 50 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] database.max_pool_size         = 5 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] database.max_retries           = 10 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] database.mysql_wsrep_sync_wait = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] database.pool_timeout          = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] database.retry_interval        = 10 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] database.slave_connection      = **** {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] database.sqlite_synchronous    = True {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] database.synchronous_reader    = True {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] database.use_db_reconnect      = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_tracing.insecure = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] profiler.connection_string     = messaging:// {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] profiler.enabled               = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] profiler.es_doc_type           = notification {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] profiler.es_scroll_size        = 10000 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] profiler.es_scroll_time        = 2m {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] profiler.filter_error_trace    = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] profiler.hmac_keys             = **** {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] profiler.sentinel_service_name = mymaster {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] profiler.socket_timeout        = 0.1 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] profiler.trace_requests        = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] profiler.trace_sqlalchemy      = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] profiler_jaeger.process_tags   = {} {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] profiler_jaeger.service_name_prefix = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] profiler_otlp.service_name_prefix = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_policy.enforce_new_defaults = True {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_policy.policy_default_rule = default {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_policy.policy_file        = policy.yaml {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.046s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:00:48 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_policy.remote_timeout     = 60.0 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] privsep_osbrick.group          = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] privsep_osbrick.helper_command = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] privsep_osbrick.user           = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cinder_sys_admin.group         = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cinder_sys_admin.helper_command = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] cinder_sys_admin.user          = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] service_user.auth_section      = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] service_user.auth_type         = password {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] service_user.cafile            = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] service_user.certfile          = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] service_user.collect_timing    = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] service_user.insecure          = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] service_user.keyfile           = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] service_user.send_service_user_token = True {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] service_user.split_loggers     = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] service_user.timeout           = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] service_user.tls_ciphers       = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] service_user.tls_min_version   = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] glance.auth_section            = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] glance.auth_type               = password {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] glance.certfile                = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] glance.collect_timing          = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] glance.insecure                = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] glance.keyfile                 = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] glance.region_name             = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] glance.split_loggers           = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] glance.timeout                 = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] glance.tls_ciphers             = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] glance.tls_min_version         = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.backend_availability_zone = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.chap_password = **** {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.chap_username =  {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.disk_geometry = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.driver_client_cert = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.driver_client_cert_key = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.driver_data_namespace = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.driver_use_ssl = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.enable_unsupported_driver = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.extra_capabilities = {} {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.filter_function = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.goodness_function = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.iscsi_target_flags =  {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.iscsi_write_cache = on {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.iser_helper   = tgtadm {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.iser_ip_address = 192.168.122.24 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.iser_port     = 3260 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.lvm_mirrors   = 0 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.lvm_share_target = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.lvm_type      = auto {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.num_shell_tries = 3 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.nvmet_port_id = 1 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.replication_device = **** {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.report_discard_supported = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.reserved_percentage = 0 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.scst_target_driver = iscsi {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.scst_target_iqn_name = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.storage_protocol = iSCSI {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.target_helper = tgtadm {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.target_ip_address = 192.168.122.24 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.target_port   = 3260 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.target_protocol = iscsi {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.trace_flags   = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.unique_fqdn_network = True {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.use_chap_auth = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.volume_backend_name = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.volume_clear  = zero {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.volume_clear_ionice = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.volume_clear_size = 0 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.volume_group  = cinder-volumes {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_reports.file_event_handler = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_reports.log_dir           = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.backend_availability_zone = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.backend_host       = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack sudo[76311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.chap_password      = **** {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.chap_username      = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.chiscsi_conf       = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.disk_geometry      = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.driver_client_cert = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack sudo[76311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.driver_data_namespace = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.driver_use_ssl     = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.extra_capabilities = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.filter_function    = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.goodness_function  = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.iser_helper        = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.iser_ip_address    = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.iser_port          = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.iser_target_prefix = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.lvm_conf_file      = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.lvm_mirrors        = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.lvm_share_target   = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.lvm_type           = auto {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.num_shell_tries    = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.nvmet_port_id      = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.replication_device = **** {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.report_discard_supported = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.reserved_percentage = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.scst_target_driver = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.storage_protocol   = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.target_helper      = lioadm {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.target_ip_address  = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.target_port        = 3260 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.target_protocol    = iscsi {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.trace_flags        = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.use_chap_auth      = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.volume_clear       = zero {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.volume_clear_size  = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] lvmdriver-1.volumes_dir        = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_rabbit.ssl      = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_rabbit.ssl_version =  {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_notifications.driver = [] {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_notifications.retry = -1 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] oslo_messaging_notifications.transport_url = **** {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] key_manager.fixed_key          = **** {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] barbican.barbican_api_version  = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] barbican.barbican_endpoint     = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] barbican.barbican_endpoint_type = public {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] barbican.barbican_region_name  = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] barbican.cafile                = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] barbican.certfile              = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] barbican.collect_timing        = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] barbican.insecure              = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] barbican.keyfile               = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] barbican.number_of_retries     = 60 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] barbican.retry_delay           = 1 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] barbican.send_service_user_token = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] barbican.split_loggers         = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] barbican.timeout               = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] barbican.tls_ciphers           = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] barbican.tls_min_version       = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] barbican.verify_ssl            = True {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] barbican.verify_ssl_path       = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] barbican_service_user.auth_section = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] barbican_service_user.auth_type = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] barbican_service_user.cafile   = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] barbican_service_user.certfile = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] barbican_service_user.collect_timing = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] barbican_service_user.insecure = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] barbican_service_user.keyfile  = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] barbican_service_user.split_loggers = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] barbican_service_user.timeout  = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] barbican_service_user.tls_ciphers = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] barbican_service_user.tls_min_version = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] vault.approle_role_id          = **** {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] vault.approle_secret_id        = **** {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] vault.auth_method              = approle {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] vault.auth_path                = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] vault.kv_mountpoint            = secret {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] vault.kv_path                  = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] vault.kv_version               = 2 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] vault.namespace                = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] vault.root_token_id            = **** {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] vault.ssl_ca_crt_file          = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] vault.timeout                  = 60.0 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] vault.token_file               = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] vault.token_role               = None {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] vault.use_ssl                  = False {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:00:48 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] ******************************************************************************** {{(pid=76130) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 05 19:00:48 devstack sudo[76311]: pam_unix(sudo:session): session closed for user root
Nov 05 19:00:48 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.351s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:00:48 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:00:48 devstack sudo[76466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 19:00:48 devstack sudo[76466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:00:48 devstack sudo[76466]: pam_unix(sudo:session): session closed for user root
Nov 05 19:00:48 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.312s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:00:48 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 19:00:48 devstack cinder-volume[76307]: INFO cinder.brick.local_dev.lvm [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Nov 05 19:00:48 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:00:48 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:00:48 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:00:48 devstack sudo[76561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 19:00:48 devstack sudo[76561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:00:49 devstack sudo[76561]: pam_unix(sudo:session): session closed for user root
Nov 05 19:00:49 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:00:49 devstack cinder-volume[76307]: DEBUG cinder.brick.local_dev.lvm [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76307) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Nov 05 19:00:49 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:00:49 devstack sudo[76662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 19:00:49 devstack sudo[76662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:00:49 devstack sudo[76662]: pam_unix(sudo:session): session closed for user root
Nov 05 19:00:49 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.641s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:00:49 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:00:49 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:00:49 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:00:49 devstack sudo[76838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 19:00:49 devstack sudo[76838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:00:50 devstack sudo[76838]: pam_unix(sudo:session): session closed for user root
Nov 05 19:00:50 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.368s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:00:50 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:00:50 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:00:50 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:00:50 devstack sudo[76924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Nov 05 19:00:50 devstack sudo[76924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:00:50 devstack sudo[76924]: pam_unix(sudo:session): session closed for user root
Nov 05 19:00:50 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.289s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:00:50 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:00:50 devstack sudo[76946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 19:00:50 devstack sudo[76946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:00:50 devstack sudo[76946]: pam_unix(sudo:session): session closed for user root
Nov 05 19:00:50 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:00:50 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:00:50 devstack sudo[77012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 19:00:50 devstack sudo[77012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:00:50 devstack sudo[77012]: pam_unix(sudo:session): session closed for user root
Nov 05 19:00:50 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:00:50 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:00:50 devstack sudo[77021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 19:00:50 devstack sudo[77021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:00:51 devstack sudo[77021]: pam_unix(sudo:session): session closed for user root
Nov 05 19:00:51 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.346s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:00:51 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:00:51 devstack sudo[77104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 19:00:51 devstack sudo[77104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:00:51 devstack sudo[77104]: pam_unix(sudo:session): session closed for user root
Nov 05 19:00:51 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:00:51 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:00:51 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:00:51 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:00:51 devstack sudo[77108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 19:00:51 devstack sudo[77108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:00:51 devstack sudo[77108]: pam_unix(sudo:session): session closed for user root
Nov 05 19:00:51 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:00:51 devstack cinder-volume[76307]: INFO cinder.volume.drivers.lvm [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Nov 05 19:00:51 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:00:51 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:00:51 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:00:51 devstack sudo[77112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 19:00:51 devstack sudo[77112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:00:52 devstack sudo[77112]: pam_unix(sudo:session): session closed for user root
Nov 05 19:00:52 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.286s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:00:52 devstack cinder-volume[76307]: DEBUG cinder.volume.drivers.lvm [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Updating volume stats {{(pid=76307) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 19:00:52 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:00:52 devstack sudo[77115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 19:00:52 devstack sudo[77115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:00:52 devstack sudo[77115]: pam_unix(sudo:session): session closed for user root
Nov 05 19:00:52 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:00:52 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:00:52 devstack sudo[77118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 19:00:52 devstack sudo[77118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:00:52 devstack sudo[77118]: pam_unix(sudo:session): session closed for user root
Nov 05 19:00:52 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:00:52 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:00:52 devstack sudo[77127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 19:00:52 devstack sudo[77127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:00:52 devstack sudo[77127]: pam_unix(sudo:session): session closed for user root
Nov 05 19:00:52 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:00:52 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:00:52 devstack sudo[77130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 19:00:52 devstack sudo[77130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:00:53 devstack sudo[77130]: pam_unix(sudo:session): session closed for user root
Nov 05 19:00:53 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:00:53 devstack cinder-volume[76307]: INFO cinder.volume.driver [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Driver hasn't implemented _init_vendor_properties()
Nov 05 19:00:53 devstack cinder-volume[76307]: DEBUG cinder.volume.driver [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76307) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 05 19:00:53 devstack cinder-volume[76307]: DEBUG oslo_db.sqlalchemy.engines [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76307) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 19:00:53 devstack cinder-volume[76307]: DEBUG dbcounter [-] [76307] Writer thread running {{(pid=76307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 19:00:53 devstack cinder-volume[76307]: DEBUG cinder.db.api [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Building query based on filter {{(pid=76307) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Nov 05 19:00:53 devstack cinder-volume[76307]: DEBUG cinder.image.image_utils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76307) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 05 19:00:53 devstack cinder-volume[76307]: INFO cinder.keymgr.migration [None req-20c3ee72-131a-4165-be30-1a7084a163f2 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 05 19:00:53 devstack cinder-volume[76307]: DEBUG cinder.volume.drivers.lvm [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Updating volume stats {{(pid=76307) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 19:00:53 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:00:53 devstack sudo[77135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 19:00:53 devstack sudo[77135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:00:53 devstack sudo[77135]: pam_unix(sudo:session): session closed for user root
Nov 05 19:00:53 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:00:53 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:00:53 devstack sudo[77138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 19:00:53 devstack sudo[77138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:00:53 devstack sudo[77138]: pam_unix(sudo:session): session closed for user root
Nov 05 19:00:53 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:00:53 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:00:53 devstack sudo[77141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 19:00:53 devstack sudo[77141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:00:54 devstack sudo[77141]: pam_unix(sudo:session): session closed for user root
Nov 05 19:00:54 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:00:54 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:00:54 devstack sudo[77144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 19:00:54 devstack sudo[77144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:00:54 devstack sudo[77144]: pam_unix(sudo:session): session closed for user root
Nov 05 19:00:54 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.309s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:00:54 devstack cinder-volume[76307]: DEBUG cinder.manager [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Notifying Schedulers of capabilities ... {{(pid=76307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:00:54 devstack cinder-volume[76307]: INFO cinder.volume.manager [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Driver initialization completed successfully.
Nov 05 19:00:54 devstack cinder-volume[76307]: INFO cinder.manager [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Initiating service 2 cleanup
Nov 05 19:00:54 devstack cinder-volume[76307]: INFO cinder.manager [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Service 2 cleanup completed.
Nov 05 19:00:54 devstack cinder-volume[76307]: DEBUG cinder.service [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Creating RPC server for service cinder-volume {{(pid=76307) start /opt/stack/cinder/cinder/service.py:231}}
Nov 05 19:00:54 devstack cinder-volume[76307]: DEBUG cinder.service [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76307) start /opt/stack/cinder/cinder/service.py:237}}
Nov 05 19:00:54 devstack cinder-volume[76307]: INFO cinder.volume.manager [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Nov 05 19:00:54 devstack cinder-volume[76307]: DEBUG cinder.volume.drivers.lvm [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Updating volume stats {{(pid=76307) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 19:00:54 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:00:54 devstack sudo[77149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 19:00:54 devstack sudo[77149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:00:54 devstack sudo[77149]: pam_unix(sudo:session): session closed for user root
Nov 05 19:00:54 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:00:54 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:00:54 devstack sudo[77152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 19:00:54 devstack sudo[77152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:00:55 devstack sudo[77152]: pam_unix(sudo:session): session closed for user root
Nov 05 19:00:55 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:00:55 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:00:55 devstack sudo[77156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 19:00:55 devstack sudo[77156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:00:55 devstack sudo[77156]: pam_unix(sudo:session): session closed for user root
Nov 05 19:00:55 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.284s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:00:55 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:00:55 devstack sudo[77159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 19:00:55 devstack sudo[77159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:00:55 devstack sudo[77159]: pam_unix(sudo:session): session closed for user root
Nov 05 19:00:55 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:00:55 devstack cinder-volume[76307]: INFO cinder.volume.manager [None req-006aaf38-8edb-4ebe-85df-8faeadbdc607 None None] Driver post RPC initialization completed successfully.
Nov 05 19:00:57 devstack cinder-volume[76130]: DEBUG dbcounter [-] [76130] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76130) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:01:05 devstack cinder-volume[76307]: DEBUG dbcounter [-] [76307] Writing DB stats cinder:SELECT=4 {{(pid=76307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:01:05 devstack cinder-volume[76307]: DEBUG dbcounter [-] [76307] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:01:41 devstack cinder-volume[76307]: DEBUG oslo_service.periodic_task [None req-3c4beec7-d4c0-4932-b0fc-06bfea8d24e7 None None] Running periodic task VolumeManager._thread_info {{(pid=76307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:01:41 devstack cinder-volume[76307]: DEBUG cinder.volume.manager [None req-3c4beec7-d4c0-4932-b0fc-06bfea8d24e7 None None] thread count: 6 {{(pid=76307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 19:01:41 devstack cinder-volume[76307]: DEBUG cinder.volume.manager [None req-3c4beec7-d4c0-4932-b0fc-06bfea8d24e7 None None] thread info: [<_MainThread(MainThread, started 134941759062144)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134941644471936)>, <Thread(Thread-3 (stat_writer), started daemon 134941644355648)>, <Thread(Rabbit-heartbeat, started daemon 134941643288192)>, <Thread(Thread-5 (_runner), started daemon 134941643889920)>, <Thread(Thread-7 (_runner), started daemon 134941644038080)>] {{(pid=76307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 19:02:41 devstack cinder-volume[76307]: DEBUG oslo_service.periodic_task [None req-3c4beec7-d4c0-4932-b0fc-06bfea8d24e7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:02:41 devstack cinder-volume[76307]: DEBUG cinder.volume.drivers.lvm [None req-3c4beec7-d4c0-4932-b0fc-06bfea8d24e7 None None] Updating volume stats {{(pid=76307) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 19:02:41 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-3c4beec7-d4c0-4932-b0fc-06bfea8d24e7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:02:41 devstack sudo[82285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 19:02:41 devstack sudo[82285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:02:42 devstack sudo[82285]: pam_unix(sudo:session): session closed for user root
Nov 05 19:02:42 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-3c4beec7-d4c0-4932-b0fc-06bfea8d24e7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:02:42 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-3c4beec7-d4c0-4932-b0fc-06bfea8d24e7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:02:42 devstack sudo[82288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 19:02:42 devstack sudo[82288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:02:42 devstack sudo[82288]: pam_unix(sudo:session): session closed for user root
Nov 05 19:02:42 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-3c4beec7-d4c0-4932-b0fc-06bfea8d24e7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:02:42 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-3c4beec7-d4c0-4932-b0fc-06bfea8d24e7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:02:42 devstack sudo[82291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 19:02:42 devstack sudo[82291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:02:42 devstack sudo[82291]: pam_unix(sudo:session): session closed for user root
Nov 05 19:02:42 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-3c4beec7-d4c0-4932-b0fc-06bfea8d24e7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:02:42 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-3c4beec7-d4c0-4932-b0fc-06bfea8d24e7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:02:42 devstack sudo[82294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 19:02:42 devstack sudo[82294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:02:42 devstack sudo[82294]: pam_unix(sudo:session): session closed for user root
Nov 05 19:02:42 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-3c4beec7-d4c0-4932-b0fc-06bfea8d24e7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:02:42 devstack cinder-volume[76307]: DEBUG cinder.manager [None req-3c4beec7-d4c0-4932-b0fc-06bfea8d24e7 None None] Notifying Schedulers of capabilities ... {{(pid=76307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:02:42 devstack cinder-volume[76307]: DEBUG oslo_service.periodic_task [None req-3c4beec7-d4c0-4932-b0fc-06bfea8d24e7 None None] Running periodic task VolumeManager._thread_info {{(pid=76307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:02:42 devstack cinder-volume[76307]: DEBUG cinder.volume.manager [None req-3c4beec7-d4c0-4932-b0fc-06bfea8d24e7 None None] thread count: 6 {{(pid=76307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 19:02:42 devstack cinder-volume[76307]: DEBUG cinder.volume.manager [None req-3c4beec7-d4c0-4932-b0fc-06bfea8d24e7 None None] thread info: [<_MainThread(MainThread, started 134941759062144)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134941644471936)>, <Thread(Thread-3 (stat_writer), started daemon 134941644355648)>, <Thread(Rabbit-heartbeat, started daemon 134941643288192)>, <Thread(Thread-5 (_runner), started daemon 134941643889920)>, <Thread(Thread-7 (_runner), started daemon 134941644038080)>] {{(pid=76307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 19:03:05 devstack cinder-volume[76307]: DEBUG dbcounter [-] [76307] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:03:41 devstack cinder-volume[76307]: DEBUG oslo_service.periodic_task [None req-3c4beec7-d4c0-4932-b0fc-06bfea8d24e7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:03:41 devstack cinder-volume[76307]: DEBUG cinder.volume.drivers.lvm [None req-3c4beec7-d4c0-4932-b0fc-06bfea8d24e7 None None] Updating volume stats {{(pid=76307) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 19:03:41 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-3c4beec7-d4c0-4932-b0fc-06bfea8d24e7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:03:41 devstack sudo[84193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 19:03:41 devstack sudo[84193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:03:42 devstack sudo[84193]: pam_unix(sudo:session): session closed for user root
Nov 05 19:03:42 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-3c4beec7-d4c0-4932-b0fc-06bfea8d24e7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:03:42 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-3c4beec7-d4c0-4932-b0fc-06bfea8d24e7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:03:42 devstack sudo[84211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 19:03:42 devstack sudo[84211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:03:42 devstack sudo[84211]: pam_unix(sudo:session): session closed for user root
Nov 05 19:03:42 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-3c4beec7-d4c0-4932-b0fc-06bfea8d24e7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:03:42 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-3c4beec7-d4c0-4932-b0fc-06bfea8d24e7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:03:42 devstack sudo[84219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 19:03:42 devstack sudo[84219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:03:42 devstack sudo[84219]: pam_unix(sudo:session): session closed for user root
Nov 05 19:03:42 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-3c4beec7-d4c0-4932-b0fc-06bfea8d24e7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:03:42 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-3c4beec7-d4c0-4932-b0fc-06bfea8d24e7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:03:42 devstack sudo[84224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 19:03:42 devstack sudo[84224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:03:42 devstack sudo[84224]: pam_unix(sudo:session): session closed for user root
Nov 05 19:03:42 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-3c4beec7-d4c0-4932-b0fc-06bfea8d24e7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:03:42 devstack cinder-volume[76307]: DEBUG cinder.manager [None req-3c4beec7-d4c0-4932-b0fc-06bfea8d24e7 None None] Notifying Schedulers of capabilities ... {{(pid=76307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:04:41 devstack cinder-volume[76307]: DEBUG oslo_service.periodic_task [None req-3c4beec7-d4c0-4932-b0fc-06bfea8d24e7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:04:41 devstack cinder-volume[76307]: DEBUG cinder.volume.drivers.lvm [None req-3c4beec7-d4c0-4932-b0fc-06bfea8d24e7 None None] Updating volume stats {{(pid=76307) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 19:04:41 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-3c4beec7-d4c0-4932-b0fc-06bfea8d24e7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:04:41 devstack sudo[85624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 19:04:41 devstack sudo[85624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:04:42 devstack sudo[85624]: pam_unix(sudo:session): session closed for user root
Nov 05 19:04:42 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-3c4beec7-d4c0-4932-b0fc-06bfea8d24e7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:04:42 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-3c4beec7-d4c0-4932-b0fc-06bfea8d24e7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:04:42 devstack sudo[85628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 19:04:42 devstack sudo[85628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:04:42 devstack sudo[85628]: pam_unix(sudo:session): session closed for user root
Nov 05 19:04:42 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-3c4beec7-d4c0-4932-b0fc-06bfea8d24e7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:04:42 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-3c4beec7-d4c0-4932-b0fc-06bfea8d24e7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:04:42 devstack sudo[85635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 19:04:42 devstack sudo[85635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:04:42 devstack sudo[85635]: pam_unix(sudo:session): session closed for user root
Nov 05 19:04:42 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-3c4beec7-d4c0-4932-b0fc-06bfea8d24e7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:04:42 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-3c4beec7-d4c0-4932-b0fc-06bfea8d24e7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:04:42 devstack sudo[85645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 19:04:42 devstack sudo[85645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:04:42 devstack sudo[85645]: pam_unix(sudo:session): session closed for user root
Nov 05 19:04:42 devstack cinder-volume[76307]: DEBUG oslo_concurrency.processutils [None req-3c4beec7-d4c0-4932-b0fc-06bfea8d24e7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76307) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:04:42 devstack cinder-volume[76307]: DEBUG cinder.manager [None req-3c4beec7-d4c0-4932-b0fc-06bfea8d24e7 None None] Notifying Schedulers of capabilities ... {{(pid=76307) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:04:42 devstack cinder-volume[76307]: DEBUG oslo_service.periodic_task [None req-3c4beec7-d4c0-4932-b0fc-06bfea8d24e7 None None] Running periodic task VolumeManager._thread_info {{(pid=76307) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:04:42 devstack cinder-volume[76307]: DEBUG cinder.volume.manager [None req-3c4beec7-d4c0-4932-b0fc-06bfea8d24e7 None None] thread count: 6 {{(pid=76307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 19:04:42 devstack cinder-volume[76307]: DEBUG cinder.volume.manager [None req-3c4beec7-d4c0-4932-b0fc-06bfea8d24e7 None None] thread info: [<_MainThread(MainThread, started 134941759062144)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134941644471936)>, <Thread(Thread-3 (stat_writer), started daemon 134941644355648)>, <Thread(Rabbit-heartbeat, started daemon 134941643288192)>, <Thread(Thread-5 (_runner), started daemon 134941643889920)>, <Thread(Thread-7 (_runner), started daemon 134941644038080)>] {{(pid=76307) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 19:05:05 devstack cinder-volume[76307]: DEBUG dbcounter [-] [76307] Writing DB stats cinder:SELECT=1 {{(pid=76307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:05:05 devstack cinder-volume[76307]: DEBUG dbcounter [-] [76307] Writing DB stats cinder:UPDATE=1 {{(pid=76307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:05:14 devstack cinder-volume[76130]: INFO oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] Caught SIGTERM, stopping children
Nov 05 19:05:14 devstack cinder-volume[76130]: DEBUG oslo_concurrency.lockutils [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] Acquiring lock "singleton_lock" {{(pid=76130) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 19:05:14 devstack cinder-volume[76130]: DEBUG oslo_concurrency.lockutils [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] Acquired lock "singleton_lock" {{(pid=76130) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 19:05:14 devstack cinder-volume[76130]: DEBUG oslo_concurrency.lockutils [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] Releasing lock "singleton_lock" {{(pid=76130) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 19:05:14 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] Stop services. {{(pid=76130) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Nov 05 19:05:14 devstack cinder-volume[76130]: DEBUG oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] Killing children. {{(pid=76130) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Nov 05 19:05:14 devstack cinder-volume[76130]: INFO oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] Waiting on 1 children to exit
Nov 05 19:05:14 devstack cinder-volume[76307]: DEBUG oslo_concurrency.lockutils [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] Acquiring lock "singleton_lock" {{(pid=76307) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 19:05:14 devstack cinder-volume[76307]: DEBUG oslo_concurrency.lockutils [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] Acquired lock "singleton_lock" {{(pid=76307) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 19:05:14 devstack cinder-volume[76307]: DEBUG oslo_concurrency.lockutils [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] Releasing lock "singleton_lock" {{(pid=76307) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 19:05:14 devstack cinder-volume[76307]: WARNING amqp [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 05 19:05:14 devstack cinder-volume[76307]: WARNING amqp [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 05 19:05:14 devstack cinder-volume[76130]: INFO oslo_service.backend._eventlet.service [None req-2c945ef9-48cd-46ba-8c5c-c7fac5bca7fd None None] Child 76307 exited with status 0
Nov 05 19:05:15 devstack cinder-volume[86359]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 05 19:05:15 devstack cinder-volume[86359]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 05 19:05:15 devstack cinder-volume[86359]: we strongly recommend against using it for new projects.
Nov 05 19:05:15 devstack cinder-volume[86359]: If you are already using Eventlet, we recommend migrating to a different
Nov 05 19:05:15 devstack cinder-volume[86359]: framework.  For more detail see
Nov 05 19:05:15 devstack cinder-volume[86359]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 05 19:05:15 devstack cinder-volume[86359]:   import eventlet  # noqa
Nov 05 19:05:17 devstack cinder-volume[86359]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86359) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 19:05:17 devstack cinder-volume[86359]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86359) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 19:05:17 devstack cinder-volume[86359]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86359) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 19:05:17 devstack cinder-volume[86359]: INFO dbcounter [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] Registered counter for database cinder
Nov 05 19:05:17 devstack cinder-volume[86359]: DEBUG oslo_db.sqlalchemy.engines [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86359) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG dbcounter [-] [86359] Writer thread running {{(pid=86359) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 19:05:18 devstack cinder-volume[86359]: INFO cinder.rpc [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 05 19:05:18 devstack cinder-volume[86359]: INFO cinder.rpc [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_db.sqlalchemy.engines [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86359) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 19:05:18 devstack cinder-volume[86359]: INFO cinder.volume.manager [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] Determined volume DB was empty at startup.
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG cinder.volume.manager [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86359) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 05 19:05:18 devstack cinder-volume[86359]: INFO cinder.volume.manager [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 05 19:05:18 devstack cinder-volume[86359]: WARNING stevedore.named [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 05 19:05:18 devstack cinder-volume[86359]: WARNING castellan.key_manager [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 19:05:18 devstack cinder-volume[86359]: WARNING cinder.keymgr.conf_key_mgr [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 19:05:18 devstack cinder-volume[86359]: INFO cinder.volume.manager [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_db.sqlalchemy.engines [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86359) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 19:05:18 devstack cinder-volume[86359]: INFO oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] Starting 1 workers
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] Started child 86577 {{(pid=86359) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] Full set of CONF: {{(pid=86359) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] ******************************************************************************** {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] Configuration options gathered from: {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] ================================================================================ {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] allow_availability_zone_fallback = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] allow_compression_on_image_upload = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] allowed_direct_url_schemes     = [] {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] api_rate_limit                 = True {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] auth_strategy                  = keystone {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_availability_zone      = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_host                   = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_name                   = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_stats_polling_interval = 60 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backup_api_class               = cinder.backup.api.API {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backup_name_template           = backup-%s {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backup_use_same_host           = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backup_use_temp_snapshot       = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] chap_password                  = **** {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86577]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1)
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] chap_username                  =  {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cinder_internal_tenant_project_id = 71768ad4ac7c4eab8cee7d33030a9887 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cinder_internal_tenant_user_id = 4eae7cb6fd2b48a1b3acae91e77ac11a {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cluster                        = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] compression_format             = gzip {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] compute_api_class              = cinder.compute.nova.API {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] config_dir                     = [] {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] config_source                  = [] {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] control_exchange               = openstack {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] debug                          = True {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] default_availability_zone      = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] default_group_type             = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] default_volume_type            = QuobyteHD {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] disk_geometry                  = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] driver_client_cert             = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] driver_client_cert_key         = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] driver_data_namespace          = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] driver_ssl_cert_path           = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] driver_ssl_cert_verify         = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] driver_use_ssl                 = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] enable_new_services            = True {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] enable_unsupported_driver      = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] enabled_backends               = ['QuobyteHD'] {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] enforce_multipath_for_image_xfer = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] filter_function                = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] glance_api_insecure            = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] glance_api_servers             = ['http://192.168.122.24/image'] {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] glance_api_ssl_compression     = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] glance_ca_certificates_file    = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] glance_catalog_info            = image:glance:publicURL {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] glance_certfile                = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] glance_keyfile                 = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] glance_num_retries             = 3 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] glance_request_timeout         = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] goodness_function              = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] graceful_shutdown_timeout      = 5 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] group_api_class                = cinder.group.api.API {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] host                           = devstack {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] image_compress_on_upload       = True {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] image_conversion_address_space_limit = 1 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] image_conversion_cpu_limit     = 60 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] image_conversion_disable       = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] image_introspection_address_space_limit = 1 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] image_introspection_cpu_limit  = 60 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] image_upload_use_cinder_backend = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] image_upload_use_internal_tenant = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] image_volume_cache_enabled     = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] image_volume_cache_max_count   = 0 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] image_volume_cache_max_size_gb = 0 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] init_host_max_objects_retrieval = 0 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] instance_format                = [instance: %(uuid)s]  {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] iscsi_target_flags             =  {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] iscsi_write_cache              = on {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] iser_helper                    = tgtadm {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] iser_ip_address                = 192.168.122.24 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] iser_port                      = 3260 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] log_color                      = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] log_config_append              = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] log_dir                        = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] log_file                       = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] log_options                    = True {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] log_rotate_interval            = 1 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] log_rotate_interval_type       = days {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] log_rotation_type              = none {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] max_age                        = 0 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] max_logfile_count              = 30 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] max_logfile_size_mb            = 200 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] max_over_subscription_ratio    = 20.0 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] message_reap_interval          = 86400 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] message_ttl                    = 2592000 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] migration_create_volume_timeout_secs = 300 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] monkey_patch                   = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] monkey_patch_modules           = [] {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] my_ip                          = 192.168.122.24 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] no_snapshot_gb_quota           = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] num_iser_scan_tries            = 3 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] num_shell_tries                = 3 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] num_volume_device_scan_tries   = 3 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] nvmeof_conn_info_version       = 1 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] nvmet_ns_id                    = 10 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] nvmet_port_id                  = 1 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] osapi_max_limit                = 1000 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] osapi_volume_ext_list          = [] {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] osapi_volume_listen_port       = 8776 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86577]: INFO cinder.volume.manager [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] Starting volume driver QuobyteDriver (1.2.1)
Nov 05 19:05:18 devstack cinder-volume[86577]: DEBUG cinder.volume.drivers.remotefs [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86577) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] osapi_volume_use_ssl           = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] osapi_volume_workers           = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] per_volume_size_limit          = -1 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] periodic_fuzzy_delay           = 60 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] periodic_interval              = 60 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] public_endpoint                = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] publish_errors                 = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] quota_backup_gigabytes         = 1000 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] quota_backups                  = 10 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] quota_gigabytes                = 1000 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] quota_groups                   = 10 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] quota_snapshots                = 10 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] quota_volumes                  = 10 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] rate_limit_burst               = 0 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] rate_limit_except_level        = CRITICAL {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] rate_limit_interval            = 0 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] reinit_driver_count            = 3 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] replication_device             = **** {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] report_discard_supported       = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] report_interval                = 120 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] reservation_clean_interval     = 86400 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] reservation_expire             = 86400 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] reserved_image_namespaces      = [] {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] reserved_percentage            = 0 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] rpc_response_timeout           = 120 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] run_external_periodic_tasks    = True {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] scst_target_driver             = iscsi {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] scst_target_iqn_name           = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] service_down_time              = 720 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] shell_completion               = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] snapshot_name_template         = snapshot-%s {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] split_loggers                  = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] state_path                     = /opt/stack/data/cinder {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] storage_availability_zone      = nova {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] storage_protocol               = iSCSI {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] syslog_log_facility            = LOG_USER {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] target_helper                  = lioadm {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] target_ip_address              = 192.168.122.24 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] target_port                    = 3260 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] target_protocol                = iscsi {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] target_secondary_ip_addresses  = [] {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] trace_flags                    = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] transport_url                  = **** {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] until_refresh                  = 0 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] use_chap_auth                  = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] use_default_quota_class        = True {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] use_journal                    = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] use_json                       = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] use_multipath_for_image_xfer   = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] use_stderr                     = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] use_syslog                     = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] verify_glance_signatures       = enabled {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] volume_api_class               = cinder.volume.api.API {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] volume_backend_name            = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] volume_clear                   = zero {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] volume_clear_ionice            = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] volume_clear_size              = 0 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] volume_copy_bps_limit          = 0 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] volume_dd_blocksize            = 1M {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] volume_name_template           = volume-%s {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] volume_service_inithost_offload = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] volume_usage_audit_period      = month {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] zoning_mode                    = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_concurrency.disable_process_locking = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] keystone_authtoken.auth_section = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] keystone_authtoken.auth_type   = password {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] keystone_authtoken.auth_version = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] keystone_authtoken.cache       = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] keystone_authtoken.certfile    = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] keystone_authtoken.delay_auth_decision = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] keystone_authtoken.http_connect_timeout = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] keystone_authtoken.include_service_catalog = True {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] keystone_authtoken.insecure    = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] keystone_authtoken.interface   = public {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] keystone_authtoken.keyfile     = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] keystone_authtoken.memcache_password = **** {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] keystone_authtoken.memcache_username = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] keystone_authtoken.region_name = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] keystone_authtoken.service_token_roles_required = True {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] keystone_authtoken.service_type = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] keystone_authtoken.token_cache_time = 300 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.24/identity {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cache.backend                  = dogpile.cache.null {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cache.backend_argument         = **** {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cache.backend_expiration_time  = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cache.config_prefix            = cache.oslo {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cache.debug_cache_backend      = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cache.enable_retry_client      = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cache.enable_socket_keepalive  = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cache.enabled                  = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cache.expiration_time          = 600 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cache.hashclient_retry_attempts = 2 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cache.memcache_dead_retry      = 300 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cache.memcache_pool_maxsize    = 10 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cache.memcache_sasl_enabled    = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cache.password                 = **** {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cache.proxies                  = [] {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cache.redis_db                 = 0 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cache.redis_sentinel_service_name = mymaster {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cache.redis_server             = localhost:6379 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cache.retry_attempts           = 2 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cache.retry_delay              = 0.0 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cache.socket_keepalive_count   = 1 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cache.socket_keepalive_idle    = 1 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cache.socket_keepalive_interval = 1 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cache.socket_timeout           = 1.0 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cache.tls_allowed_ciphers      = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cache.tls_cafile               = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cache.tls_certfile             = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cache.tls_enabled              = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cache.tls_keyfile              = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cache.username                 = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] coordination.backend_url       = **** {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] database.asyncio_connection    = **** {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] database.asyncio_slave_connection = **** {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] database.backend               = sqlalchemy {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] database.connection            = **** {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] database.connection_debug      = 0 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] database.connection_parameters =  {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] database.connection_recycle_time = 3600 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] database.connection_trace      = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] database.db_inc_retry_interval = True {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] database.db_max_retries        = 20 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] database.db_max_retry_interval = 10 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] database.db_retry_interval     = 1 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] database.max_overflow          = 50 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] database.max_pool_size         = 5 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] database.max_retries           = 10 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] database.mysql_wsrep_sync_wait = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86577]: DEBUG cinder.volume.drivers.quobyte [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86577) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Nov 05 19:05:18 devstack cinder-volume[86577]: WARNING cinder.volume.drivers.quobyte [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 05 19:05:18 devstack cinder-volume[86577]: WARNING cinder.volume.drivers.quobyte [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] database.pool_timeout          = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] database.retry_interval        = 10 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] database.slave_connection      = **** {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] database.sqlite_synchronous    = True {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] database.synchronous_reader    = True {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] database.use_db_reconnect      = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86577]: DEBUG oslo_concurrency.processutils [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] Running cmd (subprocess): mount.quobyte {{(pid=86577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_tracing.insecure = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] profiler.connection_string     = messaging:// {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] profiler.enabled               = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] profiler.es_doc_type           = notification {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] profiler.es_scroll_size        = 10000 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] profiler.es_scroll_time        = 2m {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] profiler.filter_error_trace    = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] profiler.hmac_keys             = **** {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] profiler.sentinel_service_name = mymaster {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] profiler.socket_timeout        = 0.1 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] profiler.trace_requests        = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] profiler.trace_sqlalchemy      = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] profiler_jaeger.process_tags   = {} {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] profiler_jaeger.service_name_prefix = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] profiler_otlp.service_name_prefix = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_policy.enforce_new_defaults = True {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_policy.policy_default_rule = default {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_policy.policy_file        = policy.yaml {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] privsep_osbrick.group          = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] privsep_osbrick.helper_command = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] privsep_osbrick.user           = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cinder_sys_admin.group         = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cinder_sys_admin.helper_command = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] cinder_sys_admin.user          = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] service_user.auth_section      = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] service_user.auth_type         = password {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] service_user.cafile            = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] service_user.certfile          = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] service_user.collect_timing    = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] service_user.insecure          = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] service_user.keyfile           = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] service_user.send_service_user_token = True {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] service_user.split_loggers     = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] service_user.timeout           = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] service_user.tls_ciphers       = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] service_user.tls_min_version   = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] glance.auth_section            = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] glance.auth_type               = password {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] glance.certfile                = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] glance.collect_timing          = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] glance.insecure                = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] glance.keyfile                 = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] glance.region_name             = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] glance.split_loggers           = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] glance.timeout                 = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] glance.tls_ciphers             = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] glance.tls_min_version         = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.backend_availability_zone = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.chap_password = **** {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.chap_username =  {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.disk_geometry = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.driver_client_cert = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.driver_client_cert_key = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.driver_data_namespace = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.driver_use_ssl = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.enable_unsupported_driver = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.extra_capabilities = {} {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.filter_function = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.goodness_function = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.iscsi_target_flags =  {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.iscsi_write_cache = on {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.iser_helper   = tgtadm {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.iser_ip_address = 192.168.122.24 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.iser_port     = 3260 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.nas_host      =  {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.nas_login     = admin {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.nas_mount_options = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.nas_password  = **** {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.nas_private_key =  {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.nas_share_path =  {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.num_shell_tries = 3 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.nvmet_port_id = 1 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.quobyte_client_cfg = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.quobyte_volume_url = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.replication_device = **** {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.report_discard_supported = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.reserved_percentage = 0 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.scst_target_driver = iscsi {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.scst_target_iqn_name = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.storage_protocol = iSCSI {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.target_helper = tgtadm {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.target_ip_address = 192.168.122.24 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.target_port   = 3260 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.target_protocol = iscsi {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.trace_flags   = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.unique_fqdn_network = True {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.use_chap_auth = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.volume_backend_name = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.volume_clear  = zero {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.volume_clear_ionice = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.volume_clear_size = 0 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_reports.file_event_handler = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_reports.log_dir           = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.backend_availability_zone = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.backend_host         = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.chap_password        = **** {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.chap_username        = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.chiscsi_conf         = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.disk_geometry        = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.driver_client_cert   = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.driver_client_cert_key = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.driver_data_namespace = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.driver_use_ssl       = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.extra_capabilities   = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.filter_function      = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.goodness_function    = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.iser_helper          = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.iser_ip_address      = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.iser_port            = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.iser_target_prefix   = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.nas_host             = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.nas_login            = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.nas_mount_options    = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.nas_password         = **** {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.nas_private_key      = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.nas_share_path       = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.nas_ssh_port         = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.num_shell_tries      = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.nvmet_port_id        = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.replication_device   = **** {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.report_discard_supported = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.reserved_percentage  = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.scst_target_driver   = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.storage_protocol     = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.target_helper        = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.target_ip_address    = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.target_port          = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.target_prefix        = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.target_protocol      = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.trace_flags          = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.use_chap_auth        = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.volume_clear         = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.volume_clear_size    = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] QuobyteHD.volumes_dir          = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_rabbit.ssl      = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_notifications.driver = [] {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_notifications.retry = -1 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] oslo_messaging_notifications.transport_url = **** {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack quobyte-client[86578]: Reading configuration file: /etc/quobyte/client.cfg
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] key_manager.fixed_key          = **** {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack quobyte-client[86578]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] barbican.barbican_api_version  = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] barbican.barbican_endpoint     = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] barbican.barbican_endpoint_type = public {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] barbican.barbican_region_name  = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] barbican.cafile                = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] barbican.certfile              = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] barbican.collect_timing        = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] barbican.insecure              = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] barbican.keyfile               = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] barbican.number_of_retries     = 60 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] barbican.retry_delay           = 1 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] barbican.send_service_user_token = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] barbican.split_loggers         = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] barbican.timeout               = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] barbican.tls_ciphers           = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] barbican.tls_min_version       = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] barbican.verify_ssl            = True {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] barbican.verify_ssl_path       = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] barbican_service_user.auth_section = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] barbican_service_user.auth_type = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] barbican_service_user.cafile   = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] barbican_service_user.certfile = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] barbican_service_user.collect_timing = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] barbican_service_user.insecure = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] barbican_service_user.keyfile  = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] barbican_service_user.split_loggers = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] barbican_service_user.timeout  = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] barbican_service_user.tls_ciphers = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] barbican_service_user.tls_min_version = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] vault.approle_role_id          = **** {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] vault.approle_secret_id        = **** {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] vault.auth_method              = approle {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] vault.auth_path                = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] vault.kv_mountpoint            = secret {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] vault.kv_path                  = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] vault.kv_version               = 2 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] vault.namespace                = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] vault.root_token_id            = **** {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] vault.ssl_ca_crt_file          = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] vault.timeout                  = 60.0 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] vault.token_file               = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] vault.token_role               = None {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] vault.use_ssl                  = False {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:18 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] ******************************************************************************** {{(pid=86359) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 05 19:05:18 devstack cinder-volume[86577]: DEBUG oslo_concurrency.processutils [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] CMD "mount.quobyte" returned: 1 in 0.185s {{(pid=86577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:05:18 devstack cinder-volume[86577]: DEBUG oslo_concurrency.lockutils [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86577) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:05:18 devstack cinder-volume[86577]: DEBUG oslo_concurrency.lockutils [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86577) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:05:18 devstack cinder-volume[86577]: DEBUG cinder.volume.drivers.quobyte [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=86577) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:05:18 devstack cinder-volume[86577]: INFO cinder.volume.drivers.quobyte [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec ...
Nov 05 19:05:18 devstack cinder-volume[86577]: DEBUG oslo_concurrency.processutils [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 -c /etc/quobyte/client-cinder.cfg {{(pid=86577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:05:18 devstack sudo[86583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 -c /etc/quobyte/client-cinder.cfg
Nov 05 19:05:18 devstack sudo[86583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:05:19 devstack sudo[86583]: pam_unix(sudo:session): session closed for user root
Nov 05 19:05:19 devstack cinder-volume[86577]: DEBUG oslo_concurrency.processutils [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.393s {{(pid=86577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:05:19 devstack cinder-volume[86577]: INFO cinder.volume.drivers.quobyte [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec succeeded
Nov 05 19:05:19 devstack cinder-volume[86577]: DEBUG cinder.volume.drivers.quobyte [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=86577) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:05:19 devstack cinder-volume[86577]: DEBUG oslo_concurrency.lockutils [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.406s {{(pid=86577) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:05:19 devstack cinder-volume[86577]: DEBUG oslo_concurrency.processutils [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=86577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:05:19 devstack sudo[86685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:05:19 devstack sudo[86685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:05:19 devstack sudo[86685]: pam_unix(sudo:session): session closed for user root
Nov 05 19:05:19 devstack cinder-volume[86577]: DEBUG oslo_concurrency.processutils [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.250s {{(pid=86577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:05:19 devstack cinder-volume[86577]: INFO cinder.volume.driver [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] Driver hasn't implemented _init_vendor_properties()
Nov 05 19:05:19 devstack cinder-volume[86577]: DEBUG cinder.volume.driver [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4295387268066, 'free_capacity_gb': 1773.4295387268066, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86577) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 05 19:05:19 devstack cinder-volume[86577]: DEBUG oslo_db.sqlalchemy.engines [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86577) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 19:05:19 devstack cinder-volume[86577]: DEBUG dbcounter [-] [86577] Writer thread running {{(pid=86577) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 19:05:19 devstack cinder-volume[86577]: DEBUG cinder.db.api [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] Building query based on filter {{(pid=86577) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Nov 05 19:05:19 devstack cinder-volume[86577]: DEBUG cinder.image.image_utils [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86577) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 05 19:05:19 devstack cinder-volume[86577]: INFO cinder.keymgr.migration [None req-547bfb1b-f454-48fe-8308-a44c1155bf09 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 05 19:05:19 devstack cinder-volume[86577]: DEBUG oslo_concurrency.lockutils [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86577) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:05:19 devstack cinder-volume[86577]: DEBUG oslo_concurrency.lockutils [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86577) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:05:19 devstack cinder-volume[86577]: DEBUG cinder.volume.drivers.quobyte [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=86577) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:05:19 devstack cinder-volume[86577]: DEBUG cinder.volume.drivers.quobyte [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=86577) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:05:19 devstack cinder-volume[86577]: DEBUG oslo_concurrency.lockutils [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86577) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:05:19 devstack cinder-volume[86577]: DEBUG oslo_concurrency.processutils [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=86577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:05:19 devstack sudo[86688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:05:19 devstack sudo[86688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:05:19 devstack sudo[86688]: pam_unix(sudo:session): session closed for user root
Nov 05 19:05:19 devstack cinder-volume[86577]: DEBUG oslo_concurrency.processutils [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.234s {{(pid=86577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:05:19 devstack cinder-volume[86577]: DEBUG cinder.manager [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] Notifying Schedulers of capabilities ... {{(pid=86577) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:05:19 devstack cinder-volume[86577]: INFO cinder.volume.manager [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] Driver initialization completed successfully.
Nov 05 19:05:19 devstack cinder-volume[86577]: INFO cinder.manager [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] Initiating service 3 cleanup
Nov 05 19:05:19 devstack cinder-volume[86577]: INFO cinder.manager [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] Service 3 cleanup completed.
Nov 05 19:05:19 devstack cinder-volume[86577]: DEBUG cinder.service [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] Creating RPC server for service cinder-volume {{(pid=86577) start /opt/stack/cinder/cinder/service.py:231}}
Nov 05 19:05:19 devstack cinder-volume[86577]: DEBUG cinder.service [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86577) start /opt/stack/cinder/cinder/service.py:237}}
Nov 05 19:05:20 devstack cinder-volume[86577]: INFO cinder.volume.manager [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Nov 05 19:05:20 devstack cinder-volume[86577]: DEBUG oslo_concurrency.lockutils [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86577) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:05:20 devstack cinder-volume[86577]: DEBUG oslo_concurrency.lockutils [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86577) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:05:20 devstack cinder-volume[86577]: DEBUG cinder.volume.drivers.quobyte [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=86577) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:05:20 devstack cinder-volume[86577]: DEBUG cinder.volume.drivers.quobyte [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=86577) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:05:20 devstack cinder-volume[86577]: DEBUG oslo_concurrency.lockutils [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86577) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:05:20 devstack cinder-volume[86577]: DEBUG oslo_concurrency.processutils [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=86577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:05:20 devstack sudo[86692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:05:20 devstack sudo[86692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:05:20 devstack sudo[86692]: pam_unix(sudo:session): session closed for user root
Nov 05 19:05:20 devstack cinder-volume[86577]: DEBUG oslo_concurrency.processutils [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.252s {{(pid=86577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:05:20 devstack cinder-volume[86577]: INFO cinder.volume.manager [None req-b317ba72-a543-4186-a168-fd5d5075857e None None] Driver post RPC initialization completed successfully.
Nov 05 19:05:24 devstack cinder-volume[86577]: DEBUG oslo_concurrency.lockutils [None req-895091f9-6549-4f3a-bad4-705ace014d32 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86577) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:05:24 devstack cinder-volume[86577]: DEBUG oslo_concurrency.lockutils [None req-895091f9-6549-4f3a-bad4-705ace014d32 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86577) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:05:24 devstack cinder-volume[86577]: DEBUG cinder.volume.drivers.quobyte [None req-895091f9-6549-4f3a-bad4-705ace014d32 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=86577) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:05:24 devstack cinder-volume[86577]: DEBUG cinder.volume.drivers.quobyte [None req-895091f9-6549-4f3a-bad4-705ace014d32 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=86577) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:05:24 devstack cinder-volume[86577]: DEBUG oslo_concurrency.lockutils [None req-895091f9-6549-4f3a-bad4-705ace014d32 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86577) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:05:24 devstack cinder-volume[86577]: DEBUG oslo_concurrency.processutils [None req-895091f9-6549-4f3a-bad4-705ace014d32 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=86577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:05:24 devstack sudo[86811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:05:24 devstack sudo[86811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:05:24 devstack sudo[86811]: pam_unix(sudo:session): session closed for user root
Nov 05 19:05:24 devstack cinder-volume[86577]: DEBUG oslo_concurrency.processutils [None req-895091f9-6549-4f3a-bad4-705ace014d32 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.228s {{(pid=86577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:05:24 devstack cinder-volume[86577]: DEBUG cinder.manager [None req-895091f9-6549-4f3a-bad4-705ace014d32 None None] Notifying Schedulers of capabilities ... {{(pid=86577) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:05:26 devstack cinder-volume[86359]: INFO oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] Caught SIGTERM, stopping children
Nov 05 19:05:26 devstack cinder-volume[86359]: DEBUG oslo_concurrency.lockutils [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] Acquiring lock "singleton_lock" {{(pid=86359) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 19:05:26 devstack cinder-volume[86359]: DEBUG oslo_concurrency.lockutils [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] Acquired lock "singleton_lock" {{(pid=86359) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 19:05:26 devstack cinder-volume[86359]: DEBUG oslo_concurrency.lockutils [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] Releasing lock "singleton_lock" {{(pid=86359) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 19:05:26 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] Stop services. {{(pid=86359) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Nov 05 19:05:26 devstack cinder-volume[86359]: DEBUG oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] Killing children. {{(pid=86359) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Nov 05 19:05:26 devstack cinder-volume[86359]: INFO oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] Waiting on 1 children to exit
Nov 05 19:05:28 devstack cinder-volume[86577]: DEBUG oslo_concurrency.lockutils [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] Acquiring lock "singleton_lock" {{(pid=86577) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 19:05:28 devstack cinder-volume[86577]: DEBUG oslo_concurrency.lockutils [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] Acquired lock "singleton_lock" {{(pid=86577) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 19:05:28 devstack cinder-volume[86577]: DEBUG oslo_concurrency.lockutils [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] Releasing lock "singleton_lock" {{(pid=86577) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 19:05:28 devstack cinder-volume[86577]: WARNING amqp [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 05 19:05:28 devstack cinder-volume[86577]: WARNING amqp [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 05 19:05:28 devstack cinder-volume[86359]: INFO oslo_service.backend._eventlet.service [None req-526c525c-b11d-4786-ab87-d6d0a9109cba None None] Child 86577 exited with status 0
Nov 05 19:05:28 devstack cinder-volume[86891]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 05 19:05:28 devstack cinder-volume[86891]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 05 19:05:28 devstack cinder-volume[86891]: we strongly recommend against using it for new projects.
Nov 05 19:05:28 devstack cinder-volume[86891]: If you are already using Eventlet, we recommend migrating to a different
Nov 05 19:05:28 devstack cinder-volume[86891]: framework.  For more detail see
Nov 05 19:05:28 devstack cinder-volume[86891]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 05 19:05:28 devstack cinder-volume[86891]:   import eventlet  # noqa
Nov 05 19:05:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86891) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 19:05:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86891) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 19:05:32 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86891) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 19:05:32 devstack cinder-volume[86891]: INFO dbcounter [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] Registered counter for database cinder
Nov 05 19:05:32 devstack cinder-volume[86891]: DEBUG oslo_db.sqlalchemy.engines [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86891) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 19:05:33 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writer thread running {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 19:05:33 devstack cinder-volume[86891]: INFO cinder.rpc [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 05 19:05:33 devstack cinder-volume[86891]: INFO cinder.rpc [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 05 19:05:33 devstack cinder-volume[86891]: DEBUG oslo_db.sqlalchemy.engines [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86891) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 19:05:33 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] Determined volume DB was empty at startup.
Nov 05 19:05:33 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86891) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 05 19:05:33 devstack cinder-volume[86891]: WARNING stevedore.named [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 05 19:05:33 devstack cinder-volume[86891]: WARNING castellan.key_manager [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 19:05:33 devstack cinder-volume[86891]: WARNING cinder.keymgr.conf_key_mgr [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 19:05:33 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 05 19:05:33 devstack cinder-volume[86891]: DEBUG oslo_db.sqlalchemy.engines [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86891) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 19:05:34 devstack cinder-volume[86891]: INFO oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] Starting 1 workers
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] Started child 87184 {{(pid=86891) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] Full set of CONF: {{(pid=86891) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] ******************************************************************************** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] Configuration options gathered from: {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] ================================================================================ {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 05 19:05:34 devstack cinder-volume[87184]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1)
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] allow_availability_zone_fallback = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] allow_compression_on_image_upload = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] allowed_direct_url_schemes     = [] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] api_rate_limit                 = True {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] auth_strategy                  = keystone {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_availability_zone      = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_host                   = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_name                   = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_stats_polling_interval = 60 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backup_api_class               = cinder.backup.api.API {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backup_name_template           = backup-%s {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backup_use_same_host           = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backup_use_temp_snapshot       = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] chap_password                  = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] chap_username                  =  {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cinder_internal_tenant_project_id = 71768ad4ac7c4eab8cee7d33030a9887 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cinder_internal_tenant_user_id = 4eae7cb6fd2b48a1b3acae91e77ac11a {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cluster                        = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] compression_format             = gzip {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] compute_api_class              = cinder.compute.nova.API {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] config_dir                     = [] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] config_source                  = [] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] control_exchange               = openstack {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] debug                          = True {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] default_availability_zone      = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] default_group_type             = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] default_volume_type            = QuobyteHD {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] disk_geometry                  = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] driver_client_cert             = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] driver_client_cert_key         = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] driver_data_namespace          = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] driver_ssl_cert_path           = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] driver_ssl_cert_verify         = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] driver_use_ssl                 = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] enable_new_services            = True {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] enable_unsupported_driver      = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] enabled_backends               = ['QuobyteHD'] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] enforce_multipath_for_image_xfer = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] filter_function                = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] glance_api_insecure            = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] glance_api_servers             = ['http://192.168.122.24/image'] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] glance_api_ssl_compression     = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] glance_ca_certificates_file    = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] glance_catalog_info            = image:glance:publicURL {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] glance_certfile                = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f6e90503-67dd-4e03-a333-0b7df2eb6a81 None None] Starting volume driver QuobyteDriver (1.2.1)
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] glance_keyfile                 = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] glance_num_retries             = 3 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] glance_request_timeout         = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-f6e90503-67dd-4e03-a333-0b7df2eb6a81 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87184) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] goodness_function              = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] graceful_shutdown_timeout      = 5 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] group_api_class                = cinder.group.api.API {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] host                           = devstack {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] image_compress_on_upload       = True {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] image_conversion_address_space_limit = 1 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] image_conversion_cpu_limit     = 60 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] image_conversion_disable       = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] image_introspection_address_space_limit = 1 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] image_introspection_cpu_limit  = 60 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] image_upload_use_cinder_backend = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] image_upload_use_internal_tenant = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] image_volume_cache_enabled     = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] image_volume_cache_max_count   = 0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] image_volume_cache_max_size_gb = 0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] init_host_max_objects_retrieval = 0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] instance_format                = [instance: %(uuid)s]  {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] iscsi_target_flags             =  {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] iscsi_write_cache              = on {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] iser_helper                    = tgtadm {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] iser_ip_address                = 192.168.122.24 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] iser_port                      = 3260 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] log_color                      = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] log_config_append              = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] log_dir                        = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] log_file                       = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] log_options                    = True {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] log_rotate_interval            = 1 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] log_rotate_interval_type       = days {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] log_rotation_type              = none {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] max_age                        = 0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] max_logfile_count              = 30 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] max_logfile_size_mb            = 200 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] max_over_subscription_ratio    = 20.0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] message_reap_interval          = 86400 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] message_ttl                    = 2592000 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] migration_create_volume_timeout_secs = 300 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] monkey_patch                   = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] monkey_patch_modules           = [] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] my_ip                          = 192.168.122.24 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] no_snapshot_gb_quota           = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] num_iser_scan_tries            = 3 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] num_shell_tries                = 3 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] num_volume_device_scan_tries   = 3 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] nvmeof_conn_info_version       = 1 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] nvmet_ns_id                    = 10 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] nvmet_port_id                  = 1 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] osapi_max_limit                = 1000 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] osapi_volume_ext_list          = [] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] osapi_volume_listen_port       = 8776 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] osapi_volume_use_ssl           = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] osapi_volume_workers           = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] per_volume_size_limit          = -1 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] periodic_fuzzy_delay           = 60 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] periodic_interval              = 60 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] public_endpoint                = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] publish_errors                 = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] quota_backup_gigabytes         = 1000 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] quota_backups                  = 10 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] quota_gigabytes                = 1000 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] quota_groups                   = 10 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] quota_snapshots                = 10 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] quota_volumes                  = 10 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] rate_limit_burst               = 0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] rate_limit_except_level        = CRITICAL {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] rate_limit_interval            = 0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] reinit_driver_count            = 3 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] replication_device             = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] report_discard_supported       = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] report_interval                = 120 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] reservation_clean_interval     = 86400 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] reservation_expire             = 86400 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] reserved_image_namespaces      = [] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] reserved_percentage            = 0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f6e90503-67dd-4e03-a333-0b7df2eb6a81 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87184) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] rpc_response_timeout           = 120 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] run_external_periodic_tasks    = True {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.quobyte [None req-f6e90503-67dd-4e03-a333-0b7df2eb6a81 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] scst_target_driver             = iscsi {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.quobyte [None req-f6e90503-67dd-4e03-a333-0b7df2eb6a81 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] scst_target_iqn_name           = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] service_down_time              = 720 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] shell_completion               = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] snapshot_name_template         = snapshot-%s {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f6e90503-67dd-4e03-a333-0b7df2eb6a81 None None] Running cmd (subprocess): mount.quobyte {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] split_loggers                  = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] state_path                     = /opt/stack/data/cinder {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] storage_availability_zone      = nova {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] storage_protocol               = iSCSI {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] syslog_log_facility            = LOG_USER {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] target_helper                  = lioadm {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] target_ip_address              = 192.168.122.24 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] target_port                    = 3260 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] target_protocol                = iscsi {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] target_secondary_ip_addresses  = [] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] trace_flags                    = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] transport_url                  = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] until_refresh                  = 0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] use_chap_auth                  = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] use_default_quota_class        = True {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] use_journal                    = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] use_json                       = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] use_multipath_for_image_xfer   = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] use_stderr                     = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] use_syslog                     = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] verify_glance_signatures       = enabled {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] volume_api_class               = cinder.volume.api.API {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] volume_backend_name            = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] volume_clear                   = zero {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] volume_clear_ionice            = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] volume_clear_size              = 0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] volume_copy_bps_limit          = 0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] volume_dd_blocksize            = 1M {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] volume_name_template           = volume-%s {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] volume_service_inithost_offload = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] volume_usage_audit_period      = month {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] zoning_mode                    = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_concurrency.disable_process_locking = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] keystone_authtoken.auth_section = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] keystone_authtoken.auth_type   = password {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] keystone_authtoken.auth_version = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] keystone_authtoken.cache       = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] keystone_authtoken.certfile    = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] keystone_authtoken.delay_auth_decision = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] keystone_authtoken.http_connect_timeout = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] keystone_authtoken.include_service_catalog = True {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] keystone_authtoken.insecure    = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] keystone_authtoken.interface   = public {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] keystone_authtoken.keyfile     = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] keystone_authtoken.memcache_password = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] keystone_authtoken.memcache_username = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] keystone_authtoken.region_name = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] keystone_authtoken.service_token_roles_required = True {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] keystone_authtoken.service_type = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] keystone_authtoken.token_cache_time = 300 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.24/identity {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cache.backend                  = dogpile.cache.null {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cache.backend_argument         = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cache.backend_expiration_time  = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cache.config_prefix            = cache.oslo {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cache.debug_cache_backend      = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cache.enable_retry_client      = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cache.enable_socket_keepalive  = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cache.enabled                  = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cache.expiration_time          = 600 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cache.hashclient_retry_attempts = 2 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cache.memcache_dead_retry      = 300 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cache.memcache_pool_maxsize    = 10 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cache.memcache_sasl_enabled    = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cache.password                 = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cache.proxies                  = [] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cache.redis_db                 = 0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cache.redis_sentinel_service_name = mymaster {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cache.redis_server             = localhost:6379 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cache.retry_attempts           = 2 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cache.retry_delay              = 0.0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cache.socket_keepalive_count   = 1 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cache.socket_keepalive_idle    = 1 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cache.socket_keepalive_interval = 1 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cache.socket_timeout           = 1.0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cache.tls_allowed_ciphers      = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cache.tls_cafile               = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cache.tls_certfile             = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cache.tls_enabled              = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cache.tls_keyfile              = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cache.username                 = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] coordination.backend_url       = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] database.asyncio_connection    = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] database.asyncio_slave_connection = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] database.backend               = sqlalchemy {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] database.connection            = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] database.connection_debug      = 0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] database.connection_parameters =  {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] database.connection_recycle_time = 3600 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] database.connection_trace      = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] database.db_inc_retry_interval = True {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] database.db_max_retries        = 20 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] database.db_max_retry_interval = 10 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] database.db_retry_interval     = 1 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] database.max_overflow          = 50 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] database.max_pool_size         = 5 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] database.max_retries           = 10 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] database.mysql_wsrep_sync_wait = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] database.pool_timeout          = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] database.retry_interval        = 10 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] database.slave_connection      = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] database.sqlite_synchronous    = True {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] database.synchronous_reader    = True {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] database.use_db_reconnect      = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_tracing.insecure = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] profiler.connection_string     = messaging:// {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] profiler.enabled               = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] profiler.es_doc_type           = notification {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] profiler.es_scroll_size        = 10000 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] profiler.es_scroll_time        = 2m {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] profiler.filter_error_trace    = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] profiler.hmac_keys             = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] profiler.sentinel_service_name = mymaster {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] profiler.socket_timeout        = 0.1 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] profiler.trace_requests        = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] profiler.trace_sqlalchemy      = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] profiler_jaeger.process_tags   = {} {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] profiler_jaeger.service_name_prefix = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] profiler_otlp.service_name_prefix = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack quobyte-client[87185]: Reading configuration file: /etc/quobyte/client.cfg
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_policy.enforce_new_defaults = True {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack quobyte-client[87185]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Nov 05 19:05:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f6e90503-67dd-4e03-a333-0b7df2eb6a81 None None] CMD "mount.quobyte" returned: 1 in 0.067s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:05:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f6e90503-67dd-4e03-a333-0b7df2eb6a81 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_policy.policy_default_rule = default {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f6e90503-67dd-4e03-a333-0b7df2eb6a81 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f6e90503-67dd-4e03-a333-0b7df2eb6a81 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_policy.policy_file        = policy.yaml {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] privsep_osbrick.group          = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] privsep_osbrick.helper_command = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] privsep_osbrick.user           = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cinder_sys_admin.group         = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cinder_sys_admin.helper_command = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f6e90503-67dd-4e03-a333-0b7df2eb6a81 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:05:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f6e90503-67dd-4e03-a333-0b7df2eb6a81 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f6e90503-67dd-4e03-a333-0b7df2eb6a81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] cinder_sys_admin.user          = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] service_user.auth_section      = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] service_user.auth_type         = password {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] service_user.cafile            = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] service_user.certfile          = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] service_user.collect_timing    = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] service_user.insecure          = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] service_user.keyfile           = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] service_user.send_service_user_token = True {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] service_user.split_loggers     = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] service_user.timeout           = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] service_user.tls_ciphers       = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] service_user.tls_min_version   = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] glance.auth_section            = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] glance.auth_type               = password {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] glance.certfile                = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] glance.collect_timing          = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] glance.insecure                = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] glance.keyfile                 = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] glance.region_name             = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] glance.split_loggers           = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] glance.timeout                 = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] glance.tls_ciphers             = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] glance.tls_min_version         = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.backend_availability_zone = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.chap_password = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.chap_username =  {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.disk_geometry = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.driver_client_cert = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.driver_client_cert_key = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.driver_data_namespace = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.driver_use_ssl = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.enable_unsupported_driver = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.extra_capabilities = {} {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.filter_function = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.goodness_function = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.iscsi_target_flags =  {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.iscsi_write_cache = on {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.iser_helper   = tgtadm {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.iser_ip_address = 192.168.122.24 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.iser_port     = 3260 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack sudo[87193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.nas_host      =  {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.nas_login     = admin {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.nas_mount_options = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.nas_password  = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.nas_private_key =  {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack sudo[87193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.nas_share_path =  {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.num_shell_tries = 3 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.nvmet_port_id = 1 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.quobyte_client_cfg = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.quobyte_volume_url = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.replication_device = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.report_discard_supported = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.reserved_percentage = 0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.scst_target_driver = iscsi {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.scst_target_iqn_name = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.storage_protocol = iSCSI {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.target_helper = tgtadm {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.target_ip_address = 192.168.122.24 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.target_port   = 3260 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.target_protocol = iscsi {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.trace_flags   = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.unique_fqdn_network = True {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.use_chap_auth = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.volume_backend_name = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.volume_clear  = zero {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.volume_clear_ionice = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.volume_clear_size = 0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_reports.file_event_handler = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_reports.log_dir           = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.backend_availability_zone = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.backend_host         = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.chap_password        = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.chap_username        = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.chiscsi_conf         = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.disk_geometry        = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.driver_client_cert   = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.driver_client_cert_key = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.driver_data_namespace = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.driver_use_ssl       = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.extra_capabilities   = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.filter_function      = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.goodness_function    = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.iser_helper          = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.iser_ip_address      = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.iser_port            = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.iser_target_prefix   = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.nas_host             = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.nas_login            = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.nas_mount_options    = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.nas_password         = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.nas_private_key      = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.nas_share_path       = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.nas_ssh_port         = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.num_shell_tries      = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.nvmet_port_id        = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.replication_device   = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.report_discard_supported = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.reserved_percentage  = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.scst_target_driver   = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.storage_protocol     = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.target_helper        = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.target_ip_address    = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.target_port          = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.target_prefix        = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.target_protocol      = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.trace_flags          = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.use_chap_auth        = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.volume_clear         = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.volume_clear_size    = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] QuobyteHD.volumes_dir          = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_rabbit.ssl      = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_notifications.driver = [] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_notifications.retry = -1 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] oslo_messaging_notifications.transport_url = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] key_manager.fixed_key          = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] barbican.barbican_api_version  = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] barbican.barbican_endpoint     = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] barbican.barbican_endpoint_type = public {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] barbican.barbican_region_name  = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] barbican.cafile                = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] barbican.certfile              = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] barbican.collect_timing        = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] barbican.insecure              = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] barbican.keyfile               = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] barbican.number_of_retries     = 60 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] barbican.retry_delay           = 1 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] barbican.send_service_user_token = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] barbican.split_loggers         = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] barbican.timeout               = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] barbican.tls_ciphers           = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] barbican.tls_min_version       = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] barbican.verify_ssl            = True {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] barbican.verify_ssl_path       = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] barbican_service_user.auth_section = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] barbican_service_user.auth_type = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] barbican_service_user.cafile   = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] barbican_service_user.certfile = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] barbican_service_user.collect_timing = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] barbican_service_user.insecure = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] barbican_service_user.keyfile  = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] barbican_service_user.split_loggers = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] barbican_service_user.timeout  = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] barbican_service_user.tls_ciphers = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] barbican_service_user.tls_min_version = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] vault.approle_role_id          = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] vault.approle_secret_id        = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] vault.auth_method              = approle {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] vault.auth_path                = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] vault.kv_mountpoint            = secret {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] vault.kv_path                  = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] vault.kv_version               = 2 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] vault.namespace                = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] vault.root_token_id            = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] vault.ssl_ca_crt_file          = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] vault.timeout                  = 60.0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] vault.token_file               = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] vault.token_role               = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] vault.use_ssl                  = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 19:05:34 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-8720689d-7d6c-4171-810e-64e51d6f0dae None None] ******************************************************************************** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 05 19:05:34 devstack sudo[87193]: pam_unix(sudo:session): session closed for user root
Nov 05 19:05:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f6e90503-67dd-4e03-a333-0b7df2eb6a81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.256s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:05:34 devstack cinder-volume[87184]: INFO cinder.volume.driver [None req-f6e90503-67dd-4e03-a333-0b7df2eb6a81 None None] Driver hasn't implemented _init_vendor_properties()
Nov 05 19:05:34 devstack cinder-volume[87184]: DEBUG cinder.volume.driver [None req-f6e90503-67dd-4e03-a333-0b7df2eb6a81 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4295387268066, 'free_capacity_gb': 1773.4295387268066, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87184) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 05 19:05:34 devstack cinder-volume[87184]: DEBUG oslo_db.sqlalchemy.engines [None req-f6e90503-67dd-4e03-a333-0b7df2eb6a81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87184) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 19:05:34 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writer thread running {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 19:05:34 devstack cinder-volume[87184]: DEBUG cinder.db.api [None req-f6e90503-67dd-4e03-a333-0b7df2eb6a81 None None] Building query based on filter {{(pid=87184) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Nov 05 19:05:34 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-f6e90503-67dd-4e03-a333-0b7df2eb6a81 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87184) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 05 19:05:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f6e90503-67dd-4e03-a333-0b7df2eb6a81 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:05:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f6e90503-67dd-4e03-a333-0b7df2eb6a81 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:05:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f6e90503-67dd-4e03-a333-0b7df2eb6a81 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:05:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f6e90503-67dd-4e03-a333-0b7df2eb6a81 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:05:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f6e90503-67dd-4e03-a333-0b7df2eb6a81 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:05:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f6e90503-67dd-4e03-a333-0b7df2eb6a81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:05:34 devstack cinder-volume[87184]: INFO cinder.keymgr.migration [None req-99eac6a5-093f-424d-9fe9-f23e20677b96 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 05 19:05:34 devstack sudo[87199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:05:34 devstack sudo[87199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:05:34 devstack sudo[87199]: pam_unix(sudo:session): session closed for user root
Nov 05 19:05:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f6e90503-67dd-4e03-a333-0b7df2eb6a81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.255s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:05:34 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-f6e90503-67dd-4e03-a333-0b7df2eb6a81 None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:05:34 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f6e90503-67dd-4e03-a333-0b7df2eb6a81 None None] Driver initialization completed successfully.
Nov 05 19:05:34 devstack cinder-volume[87184]: INFO cinder.manager [None req-f6e90503-67dd-4e03-a333-0b7df2eb6a81 None None] Initiating service 3 cleanup
Nov 05 19:05:34 devstack cinder-volume[87184]: INFO cinder.manager [None req-f6e90503-67dd-4e03-a333-0b7df2eb6a81 None None] Service 3 cleanup completed.
Nov 05 19:05:34 devstack cinder-volume[87184]: DEBUG cinder.service [None req-f6e90503-67dd-4e03-a333-0b7df2eb6a81 None None] Creating RPC server for service cinder-volume {{(pid=87184) start /opt/stack/cinder/cinder/service.py:231}}
Nov 05 19:05:34 devstack cinder-volume[87184]: DEBUG cinder.service [None req-f6e90503-67dd-4e03-a333-0b7df2eb6a81 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87184) start /opt/stack/cinder/cinder/service.py:237}}
Nov 05 19:05:34 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f6e90503-67dd-4e03-a333-0b7df2eb6a81 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Nov 05 19:05:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f6e90503-67dd-4e03-a333-0b7df2eb6a81 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:05:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f6e90503-67dd-4e03-a333-0b7df2eb6a81 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:05:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f6e90503-67dd-4e03-a333-0b7df2eb6a81 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:05:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f6e90503-67dd-4e03-a333-0b7df2eb6a81 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:05:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f6e90503-67dd-4e03-a333-0b7df2eb6a81 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:05:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f6e90503-67dd-4e03-a333-0b7df2eb6a81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:05:35 devstack sudo[87210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:05:35 devstack sudo[87210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:05:35 devstack sudo[87210]: pam_unix(sudo:session): session closed for user root
Nov 05 19:05:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f6e90503-67dd-4e03-a333-0b7df2eb6a81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.287s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:05:35 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f6e90503-67dd-4e03-a333-0b7df2eb6a81 None None] Driver post RPC initialization completed successfully.
Nov 05 19:05:44 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:05:44 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=1 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:05:45 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:06:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:06:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread count: 6 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 19:06:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread info: [<_MainThread(MainThread, started 126882883072128)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126882770872512)>, <Thread(Thread-3 (stat_writer), started daemon 126882769837376)>, <Thread(Rabbit-heartbeat, started daemon 126882768896256)>, <Thread(Thread-5 (_runner), started daemon 126882768980928)>, <Thread(Thread-7 (_runner), started daemon 126882767016448)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 19:06:55 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-85babb43-ff69-4309-899e-b202ae2994c3 tempest-VolumesAdminNegativeTest-1340286976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:06:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-85babb43-ff69-4309-899e-b202ae2994c3 tempest-VolumesAdminNegativeTest-1340286976 None] Flow 'volume_create_manager' (6367066e-5fee-4223-a139-72a16af92086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:06:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-85babb43-ff69-4309-899e-b202ae2994c3 tempest-VolumesAdminNegativeTest-1340286976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (796f84ba-8c9d-4832-8d9a-8b33a13e3171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:06:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-85babb43-ff69-4309-899e-b202ae2994c3 tempest-VolumesAdminNegativeTest-1340286976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (796f84ba-8c9d-4832-8d9a-8b33a13e3171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-754345462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df67153d-f1f4-4876-aff7-1f5e121c1244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd9079d4070342c3b99905e9e53ab0fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:06:55Z,use_quota=True,user_id='fc52d2fd352c4b3e9f09c22dc49f7a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:06:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-85babb43-ff69-4309-899e-b202ae2994c3 tempest-VolumesAdminNegativeTest-1340286976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f877abc0-bb47-441e-8977-9a6991752769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:06:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-85babb43-ff69-4309-899e-b202ae2994c3 tempest-VolumesAdminNegativeTest-1340286976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f877abc0-bb47-441e-8977-9a6991752769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:06:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-85babb43-ff69-4309-899e-b202ae2994c3 tempest-VolumesAdminNegativeTest-1340286976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (997f0dcd-0ee2-4a0c-ae66-9a0bfb64ec88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:06:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-85babb43-ff69-4309-899e-b202ae2994c3 tempest-VolumesAdminNegativeTest-1340286976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (997f0dcd-0ee2-4a0c-ae66-9a0bfb64ec88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df67153d-f1f4-4876-aff7-1f5e121c1244', 'volume_name': 'volume-df67153d-f1f4-4876-aff7-1f5e121c1244', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:06:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-85babb43-ff69-4309-899e-b202ae2994c3 tempest-VolumesAdminNegativeTest-1340286976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea8cad9-98ad-4f1f-86e2-e537cf40c4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:06:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-85babb43-ff69-4309-899e-b202ae2994c3 tempest-VolumesAdminNegativeTest-1340286976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea8cad9-98ad-4f1f-86e2-e537cf40c4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:06:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-85babb43-ff69-4309-899e-b202ae2994c3 tempest-VolumesAdminNegativeTest-1340286976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bae7ba54-6d5e-49a8-b1ec-ceea51f3a98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:06:55 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-85babb43-ff69-4309-899e-b202ae2994c3 tempest-VolumesAdminNegativeTest-1340286976 None] Volume df67153d-f1f4-4876-aff7-1f5e121c1244: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df67153d-f1f4-4876-aff7-1f5e121c1244', 'volume_size': 1}
Nov 05 19:06:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-85babb43-ff69-4309-899e-b202ae2994c3 tempest-VolumesAdminNegativeTest-1340286976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:06:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-85babb43-ff69-4309-899e-b202ae2994c3 tempest-VolumesAdminNegativeTest-1340286976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:06:55 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-85babb43-ff69-4309-899e-b202ae2994c3 tempest-VolumesAdminNegativeTest-1340286976 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-754345462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df67153d-f1f4-4876-aff7-1f5e121c1244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd9079d4070342c3b99905e9e53ab0fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:06:55Z,use_quota=True,user_id='fc52d2fd352c4b3e9f09c22dc49f7a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:06:55 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-85babb43-ff69-4309-899e-b202ae2994c3 tempest-VolumesAdminNegativeTest-1340286976 None] Creating volume df67153d-f1f4-4876-aff7-1f5e121c1244 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:06:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-85babb43-ff69-4309-899e-b202ae2994c3 tempest-VolumesAdminNegativeTest-1340286976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:06:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-85babb43-ff69-4309-899e-b202ae2994c3 tempest-VolumesAdminNegativeTest-1340286976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:06:55 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-85babb43-ff69-4309-899e-b202ae2994c3 tempest-VolumesAdminNegativeTest-1340286976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:06:55 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-85babb43-ff69-4309-899e-b202ae2994c3 tempest-VolumesAdminNegativeTest-1340286976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:06:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-85babb43-ff69-4309-899e-b202ae2994c3 tempest-VolumesAdminNegativeTest-1340286976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:06:55 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-85babb43-ff69-4309-899e-b202ae2994c3 tempest-VolumesAdminNegativeTest-1340286976 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:06:55 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-85babb43-ff69-4309-899e-b202ae2994c3 tempest-VolumesAdminNegativeTest-1340286976 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:06:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-85babb43-ff69-4309-899e-b202ae2994c3 tempest-VolumesAdminNegativeTest-1340286976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-df67153d-f1f4-4876-aff7-1f5e121c1244 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:06:55 devstack sudo[88022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-df67153d-f1f4-4876-aff7-1f5e121c1244 1073741824
Nov 05 19:06:55 devstack sudo[88022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:06:56 devstack sudo[88022]: pam_unix(sudo:session): session closed for user root
Nov 05 19:06:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-85babb43-ff69-4309-899e-b202ae2994c3 tempest-VolumesAdminNegativeTest-1340286976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-df67153d-f1f4-4876-aff7-1f5e121c1244 1073741824" returned: 0 in 1.080s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:06:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-85babb43-ff69-4309-899e-b202ae2994c3 tempest-VolumesAdminNegativeTest-1340286976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-df67153d-f1f4-4876-aff7-1f5e121c1244 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:06:56 devstack sudo[88341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-df67153d-f1f4-4876-aff7-1f5e121c1244
Nov 05 19:06:56 devstack sudo[88341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:06:57 devstack sudo[88341]: pam_unix(sudo:session): session closed for user root
Nov 05 19:06:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-85babb43-ff69-4309-899e-b202ae2994c3 tempest-VolumesAdminNegativeTest-1340286976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-df67153d-f1f4-4876-aff7-1f5e121c1244" returned: 0 in 0.612s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:06:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-85babb43-ff69-4309-899e-b202ae2994c3 tempest-VolumesAdminNegativeTest-1340286976 None] <== create_volume: return (1815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:06:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-85babb43-ff69-4309-899e-b202ae2994c3 tempest-VolumesAdminNegativeTest-1340286976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.818s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:06:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-85babb43-ff69-4309-899e-b202ae2994c3 tempest-VolumesAdminNegativeTest-1340286976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bae7ba54-6d5e-49a8-b1ec-ceea51f3a98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df67153d-f1f4-4876-aff7-1f5e121c1244', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:06:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-85babb43-ff69-4309-899e-b202ae2994c3 tempest-VolumesAdminNegativeTest-1340286976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a179b1c-5ba6-40f9-a1b4-b88ed44da883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:06:57 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-85babb43-ff69-4309-899e-b202ae2994c3 tempest-VolumesAdminNegativeTest-1340286976 None] Volume volume-df67153d-f1f4-4876-aff7-1f5e121c1244 (df67153d-f1f4-4876-aff7-1f5e121c1244): created successfully
Nov 05 19:06:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-85babb43-ff69-4309-899e-b202ae2994c3 tempest-VolumesAdminNegativeTest-1340286976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a179b1c-5ba6-40f9-a1b4-b88ed44da883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:06:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-85babb43-ff69-4309-899e-b202ae2994c3 tempest-VolumesAdminNegativeTest-1340286976 None] Flow 'volume_create_manager' (6367066e-5fee-4223-a139-72a16af92086) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:06:57 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-85babb43-ff69-4309-899e-b202ae2994c3 tempest-VolumesAdminNegativeTest-1340286976 None] Created volume successfully.
Nov 05 19:06:59 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4373ef25-b133-4627-8bb4-706bfe6995de tempest-VolumesAdminNegativeTest-1340286976 None] Acquiring lock "cinder-df67153d-f1f4-4876-aff7-1f5e121c1244-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:06:59 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4373ef25-b133-4627-8bb4-706bfe6995de tempest-VolumesAdminNegativeTest-1340286976 None] Lock "cinder-df67153d-f1f4-4876-aff7-1f5e121c1244-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:06:59 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4373ef25-b133-4627-8bb4-706bfe6995de tempest-VolumesAdminNegativeTest-1340286976 None] Acquiring lock "cinder-quobyte-df67153d-f1f4-4876-aff7-1f5e121c1244" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:06:59 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4373ef25-b133-4627-8bb4-706bfe6995de tempest-VolumesAdminNegativeTest-1340286976 None] Lock "cinder-quobyte-df67153d-f1f4-4876-aff7-1f5e121c1244" acquired by "delete_volume" :: waited 0.033s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:06:59 devstack cinder-volume[87184]: INFO oslo.privsep.daemon [None req-4373ef25-b133-4627-8bb4-706bfe6995de tempest-VolumesAdminNegativeTest-1340286976 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpw7hcra6f/privsep.sock']
Nov 05 19:06:59 devstack sudo[88348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpw7hcra6f/privsep.sock
Nov 05 19:06:59 devstack sudo[88348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:07:00 devstack cinder-volume[87184]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Nov 05 19:07:00 devstack cinder-volume[87184]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 05 19:07:00 devstack cinder-volume[87184]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Nov 05 19:07:00 devstack cinder-volume[87184]: WARNING oslo.privsep.daemon [-] privsep log: 
Nov 05 19:07:00 devstack cinder-volume[87184]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Nov 05 19:07:00 devstack cinder-volume[87184]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Nov 05 19:07:00 devstack cinder-volume[87184]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 05 19:07:00 devstack cinder-volume[87184]: WARNING oslo.privsep.daemon [-] privsep log: 
Nov 05 19:07:00 devstack cinder-volume[87184]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Nov 05 19:07:00 devstack sudo[88348]: pam_unix(sudo:session): session closed for user root
Nov 05 19:07:00 devstack cinder-volume[87184]: INFO oslo.privsep.daemon [None req-4373ef25-b133-4627-8bb4-706bfe6995de tempest-VolumesAdminNegativeTest-1340286976 None] Spawned new privsep daemon via rootwrap
Nov 05 19:07:00 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [None req-4373ef25-b133-4627-8bb4-706bfe6995de tempest-VolumesAdminNegativeTest-1340286976 None] Accepted privsep connection to /tmp/tmpw7hcra6f/privsep.sock {{(pid=87184) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Nov 05 19:07:00 devstack cinder-volume[87184]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 05 19:07:00 devstack cinder-volume[87184]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 05 19:07:00 devstack cinder-volume[87184]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 05 19:07:00 devstack cinder-volume[87184]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88367
Nov 05 19:07:00 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e06027-b34a-42c3-a4cd-7872b34a949d]: (2,) {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:07:00 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc40daa8-f0ff-460b-b108-97de2f19ac60]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:07:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4373ef25-b133-4627-8bb4-706bfe6995de tempest-VolumesAdminNegativeTest-1340286976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-df67153d-f1f4-4876-aff7-1f5e121c1244 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:07:00 devstack sudo[88369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-df67153d-f1f4-4876-aff7-1f5e121c1244
Nov 05 19:07:01 devstack sudo[88369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:07:01 devstack sudo[88369]: pam_unix(sudo:session): session closed for user root
Nov 05 19:07:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4373ef25-b133-4627-8bb4-706bfe6995de tempest-VolumesAdminNegativeTest-1340286976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-df67153d-f1f4-4876-aff7-1f5e121c1244" returned: 0 in 0.729s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:07:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4373ef25-b133-4627-8bb4-706bfe6995de tempest-VolumesAdminNegativeTest-1340286976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-df67153d-f1f4-4876-aff7-1f5e121c1244 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:07:01 devstack sudo[88375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-df67153d-f1f4-4876-aff7-1f5e121c1244
Nov 05 19:07:01 devstack sudo[88375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:07:01 devstack sudo[88375]: pam_unix(sudo:session): session closed for user root
Nov 05 19:07:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4373ef25-b133-4627-8bb4-706bfe6995de tempest-VolumesAdminNegativeTest-1340286976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-df67153d-f1f4-4876-aff7-1f5e121c1244" returned: 0 in 0.256s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:07:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4373ef25-b133-4627-8bb4-706bfe6995de tempest-VolumesAdminNegativeTest-1340286976 None] Lock "cinder-quobyte-df67153d-f1f4-4876-aff7-1f5e121c1244" released by "delete_volume" :: held 2.622s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:07:01 devstack cinder-volume[87184]: WARNING cinder.quota [None req-4373ef25-b133-4627-8bb4-706bfe6995de tempest-VolumesAdminNegativeTest-1340286976 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 05 19:07:01 devstack cinder-volume[87184]: WARNING cinder.quota [None req-4373ef25-b133-4627-8bb4-706bfe6995de tempest-VolumesAdminNegativeTest-1340286976 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 05 19:07:01 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-4373ef25-b133-4627-8bb4-706bfe6995de tempest-VolumesAdminNegativeTest-1340286976 None] Created reservations ['064ee4dd-0b33-4be4-8948-bc6f6c73968f', '67bcf29b-63e2-4bb2-ad75-06c573805fb7', '624d2932-d9b5-4c06-8094-b905c8533a2b', '6624bfae-3957-4aa4-82cb-2db22c20f204'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:07:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4373ef25-b133-4627-8bb4-706bfe6995de tempest-VolumesAdminNegativeTest-1340286976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:07:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4373ef25-b133-4627-8bb4-706bfe6995de tempest-VolumesAdminNegativeTest-1340286976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:07:02 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4373ef25-b133-4627-8bb4-706bfe6995de tempest-VolumesAdminNegativeTest-1340286976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:07:02 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4373ef25-b133-4627-8bb4-706bfe6995de tempest-VolumesAdminNegativeTest-1340286976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:07:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4373ef25-b133-4627-8bb4-706bfe6995de tempest-VolumesAdminNegativeTest-1340286976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:07:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4373ef25-b133-4627-8bb4-706bfe6995de tempest-VolumesAdminNegativeTest-1340286976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:07:02 devstack sudo[88378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:07:02 devstack sudo[88378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:07:02 devstack sudo[88378]: pam_unix(sudo:session): session closed for user root
Nov 05 19:07:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4373ef25-b133-4627-8bb4-706bfe6995de tempest-VolumesAdminNegativeTest-1340286976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.306s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:07:02 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-4373ef25-b133-4627-8bb4-706bfe6995de tempest-VolumesAdminNegativeTest-1340286976 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:07:02 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-4373ef25-b133-4627-8bb4-706bfe6995de tempest-VolumesAdminNegativeTest-1340286976 None] Deleted volume successfully.
Nov 05 19:07:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4373ef25-b133-4627-8bb4-706bfe6995de tempest-VolumesAdminNegativeTest-1340286976 None] Lock "cinder-df67153d-f1f4-4876-aff7-1f5e121c1244-delete_volume" released by "delete_volume" :: held 3.323s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:07:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:07:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:07:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:07:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:07:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:07:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:07:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:07:05 devstack sudo[88431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:07:05 devstack sudo[88431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:07:05 devstack sudo[88431]: pam_unix(sudo:session): session closed for user root
Nov 05 19:07:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.334s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:07:05 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:07:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:07:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread count: 8 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 19:07:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread info: [<_MainThread(MainThread, started 126882883072128)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126882770872512)>, <Thread(Thread-3 (stat_writer), started daemon 126882769837376)>, <Thread(Rabbit-heartbeat, started daemon 126882768896256)>, <Thread(Thread-5 (_runner), started daemon 126882768980928)>, <Thread(Thread-7 (_runner), started daemon 126882767016448)>, <Thread(fd_logger, started daemon 126882764561216)>, <Thread(privsep_reader, started daemon 126882764568576)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 19:07:10 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-5820f54d-49f9-4615-b21f-4c54faf20015 tempest-ServerActionsTestOtherA-1201227496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:07:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5820f54d-49f9-4615-b21f-4c54faf20015 tempest-ServerActionsTestOtherA-1201227496 None] Flow 'volume_create_manager' (175ee566-3dcb-4aca-8f05-cad5f1749850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:07:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5820f54d-49f9-4615-b21f-4c54faf20015 tempest-ServerActionsTestOtherA-1201227496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c8bfe88-111e-4c17-b8b1-4ebc75d04727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:07:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5820f54d-49f9-4615-b21f-4c54faf20015 tempest-ServerActionsTestOtherA-1201227496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c8bfe88-111e-4c17-b8b1-4ebc75d04727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1012426643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9c78cd6-0fef-4f57-8c93-e32f92c3e52f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='603afb9729324fe6b0dd981526241801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:07:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:07:11Z,use_quota=True,user_id='a4ade5547ede44fe822a49ed14705361',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:07:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5820f54d-49f9-4615-b21f-4c54faf20015 tempest-ServerActionsTestOtherA-1201227496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9458641-da1d-4387-a8c8-754c671ba674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:07:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5820f54d-49f9-4615-b21f-4c54faf20015 tempest-ServerActionsTestOtherA-1201227496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9458641-da1d-4387-a8c8-754c671ba674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:07:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5820f54d-49f9-4615-b21f-4c54faf20015 tempest-ServerActionsTestOtherA-1201227496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b161e2c0-6017-455d-9d4d-f53782080a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:07:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5820f54d-49f9-4615-b21f-4c54faf20015 tempest-ServerActionsTestOtherA-1201227496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b161e2c0-6017-455d-9d4d-f53782080a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9c78cd6-0fef-4f57-8c93-e32f92c3e52f', 'volume_name': 'volume-d9c78cd6-0fef-4f57-8c93-e32f92c3e52f', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:07:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5820f54d-49f9-4615-b21f-4c54faf20015 tempest-ServerActionsTestOtherA-1201227496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e4db06c-9411-4762-ab42-f90fb558dfdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:07:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5820f54d-49f9-4615-b21f-4c54faf20015 tempest-ServerActionsTestOtherA-1201227496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e4db06c-9411-4762-ab42-f90fb558dfdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:07:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5820f54d-49f9-4615-b21f-4c54faf20015 tempest-ServerActionsTestOtherA-1201227496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa0f5771-96ff-46a5-b9ec-7a706c20a5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:07:11 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-5820f54d-49f9-4615-b21f-4c54faf20015 tempest-ServerActionsTestOtherA-1201227496 None] Volume d9c78cd6-0fef-4f57-8c93-e32f92c3e52f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9c78cd6-0fef-4f57-8c93-e32f92c3e52f', 'volume_size': 1}
Nov 05 19:07:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5820f54d-49f9-4615-b21f-4c54faf20015 tempest-ServerActionsTestOtherA-1201227496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:07:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5820f54d-49f9-4615-b21f-4c54faf20015 tempest-ServerActionsTestOtherA-1201227496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:07:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5820f54d-49f9-4615-b21f-4c54faf20015 tempest-ServerActionsTestOtherA-1201227496 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1012426643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9c78cd6-0fef-4f57-8c93-e32f92c3e52f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='603afb9729324fe6b0dd981526241801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:07:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:07:11Z,use_quota=True,user_id='a4ade5547ede44fe822a49ed14705361',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:07:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-5820f54d-49f9-4615-b21f-4c54faf20015 tempest-ServerActionsTestOtherA-1201227496 None] Creating volume d9c78cd6-0fef-4f57-8c93-e32f92c3e52f {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:07:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5820f54d-49f9-4615-b21f-4c54faf20015 tempest-ServerActionsTestOtherA-1201227496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:07:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5820f54d-49f9-4615-b21f-4c54faf20015 tempest-ServerActionsTestOtherA-1201227496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:07:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5820f54d-49f9-4615-b21f-4c54faf20015 tempest-ServerActionsTestOtherA-1201227496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:07:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5820f54d-49f9-4615-b21f-4c54faf20015 tempest-ServerActionsTestOtherA-1201227496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:07:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5820f54d-49f9-4615-b21f-4c54faf20015 tempest-ServerActionsTestOtherA-1201227496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:07:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5820f54d-49f9-4615-b21f-4c54faf20015 tempest-ServerActionsTestOtherA-1201227496 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:07:11 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-5820f54d-49f9-4615-b21f-4c54faf20015 tempest-ServerActionsTestOtherA-1201227496 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:07:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5820f54d-49f9-4615-b21f-4c54faf20015 tempest-ServerActionsTestOtherA-1201227496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d9c78cd6-0fef-4f57-8c93-e32f92c3e52f 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:07:11 devstack sudo[88441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d9c78cd6-0fef-4f57-8c93-e32f92c3e52f 1073741824
Nov 05 19:07:11 devstack sudo[88441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:07:11 devstack sudo[88441]: pam_unix(sudo:session): session closed for user root
Nov 05 19:07:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5820f54d-49f9-4615-b21f-4c54faf20015 tempest-ServerActionsTestOtherA-1201227496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d9c78cd6-0fef-4f57-8c93-e32f92c3e52f 1073741824" returned: 0 in 0.554s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:07:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5820f54d-49f9-4615-b21f-4c54faf20015 tempest-ServerActionsTestOtherA-1201227496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d9c78cd6-0fef-4f57-8c93-e32f92c3e52f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:07:11 devstack sudo[88447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d9c78cd6-0fef-4f57-8c93-e32f92c3e52f
Nov 05 19:07:11 devstack sudo[88447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:07:11 devstack sudo[88447]: pam_unix(sudo:session): session closed for user root
Nov 05 19:07:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5820f54d-49f9-4615-b21f-4c54faf20015 tempest-ServerActionsTestOtherA-1201227496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d9c78cd6-0fef-4f57-8c93-e32f92c3e52f" returned: 0 in 0.292s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:07:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5820f54d-49f9-4615-b21f-4c54faf20015 tempest-ServerActionsTestOtherA-1201227496 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:07:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5820f54d-49f9-4615-b21f-4c54faf20015 tempest-ServerActionsTestOtherA-1201227496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:07:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5820f54d-49f9-4615-b21f-4c54faf20015 tempest-ServerActionsTestOtherA-1201227496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa0f5771-96ff-46a5-b9ec-7a706c20a5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9c78cd6-0fef-4f57-8c93-e32f92c3e52f', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:07:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5820f54d-49f9-4615-b21f-4c54faf20015 tempest-ServerActionsTestOtherA-1201227496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c912b36-e8d3-432e-996d-a1bf0a6ebb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:07:12 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-5820f54d-49f9-4615-b21f-4c54faf20015 tempest-ServerActionsTestOtherA-1201227496 None] Volume volume-d9c78cd6-0fef-4f57-8c93-e32f92c3e52f (d9c78cd6-0fef-4f57-8c93-e32f92c3e52f): created successfully
Nov 05 19:07:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5820f54d-49f9-4615-b21f-4c54faf20015 tempest-ServerActionsTestOtherA-1201227496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c912b36-e8d3-432e-996d-a1bf0a6ebb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:07:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5820f54d-49f9-4615-b21f-4c54faf20015 tempest-ServerActionsTestOtherA-1201227496 None] Flow 'volume_create_manager' (175ee566-3dcb-4aca-8f05-cad5f1749850) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:07:12 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-5820f54d-49f9-4615-b21f-4c54faf20015 tempest-ServerActionsTestOtherA-1201227496 None] Created volume successfully.
Nov 05 19:07:15 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-85028635-53e7-4257-bc40-4ee0440ca711 tempest-AttachVolumeShelveTestJSON-1705043075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:07:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-85028635-53e7-4257-bc40-4ee0440ca711 tempest-AttachVolumeShelveTestJSON-1705043075 None] Flow 'volume_create_manager' (51965480-e829-4544-9515-facfc093cc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:07:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-85028635-53e7-4257-bc40-4ee0440ca711 tempest-AttachVolumeShelveTestJSON-1705043075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54f4b9b8-aa49-4fc0-a029-6dcc6ad8466c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:07:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-85028635-53e7-4257-bc40-4ee0440ca711 tempest-AttachVolumeShelveTestJSON-1705043075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54f4b9b8-aa49-4fc0-a029-6dcc6ad8466c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-478422248',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=416da17f-b7e3-40ab-9d32-767a17b80bb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2efbc714270446b85b860d74f2f92ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:07:15Z,use_quota=True,user_id='b6e1395ac81140518bf5c09cb23ef29f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:07:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-85028635-53e7-4257-bc40-4ee0440ca711 tempest-AttachVolumeShelveTestJSON-1705043075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2e55a9b-3cb0-4afb-b3d5-e4e85b4f950c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:07:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-85028635-53e7-4257-bc40-4ee0440ca711 tempest-AttachVolumeShelveTestJSON-1705043075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2e55a9b-3cb0-4afb-b3d5-e4e85b4f950c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:07:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-85028635-53e7-4257-bc40-4ee0440ca711 tempest-AttachVolumeShelveTestJSON-1705043075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c1e5280-e7fa-4122-8526-dc9bd83d0bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:07:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-85028635-53e7-4257-bc40-4ee0440ca711 tempest-AttachVolumeShelveTestJSON-1705043075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c1e5280-e7fa-4122-8526-dc9bd83d0bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '416da17f-b7e3-40ab-9d32-767a17b80bb8', 'volume_name': 'volume-416da17f-b7e3-40ab-9d32-767a17b80bb8', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:07:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-85028635-53e7-4257-bc40-4ee0440ca711 tempest-AttachVolumeShelveTestJSON-1705043075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c068a35b-1ed9-4f75-bbd9-ca76a5b89d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:07:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-85028635-53e7-4257-bc40-4ee0440ca711 tempest-AttachVolumeShelveTestJSON-1705043075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c068a35b-1ed9-4f75-bbd9-ca76a5b89d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:07:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-85028635-53e7-4257-bc40-4ee0440ca711 tempest-AttachVolumeShelveTestJSON-1705043075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ad13bfa-c92f-4695-a8bd-c0c5131064c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:07:15 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-85028635-53e7-4257-bc40-4ee0440ca711 tempest-AttachVolumeShelveTestJSON-1705043075 None] Volume 416da17f-b7e3-40ab-9d32-767a17b80bb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-416da17f-b7e3-40ab-9d32-767a17b80bb8', 'volume_size': 1}
Nov 05 19:07:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-85028635-53e7-4257-bc40-4ee0440ca711 tempest-AttachVolumeShelveTestJSON-1705043075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:07:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-85028635-53e7-4257-bc40-4ee0440ca711 tempest-AttachVolumeShelveTestJSON-1705043075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:07:15 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-85028635-53e7-4257-bc40-4ee0440ca711 tempest-AttachVolumeShelveTestJSON-1705043075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-478422248',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=416da17f-b7e3-40ab-9d32-767a17b80bb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2efbc714270446b85b860d74f2f92ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:07:15Z,use_quota=True,user_id='b6e1395ac81140518bf5c09cb23ef29f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:07:15 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-85028635-53e7-4257-bc40-4ee0440ca711 tempest-AttachVolumeShelveTestJSON-1705043075 None] Creating volume 416da17f-b7e3-40ab-9d32-767a17b80bb8 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:07:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-85028635-53e7-4257-bc40-4ee0440ca711 tempest-AttachVolumeShelveTestJSON-1705043075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:07:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-85028635-53e7-4257-bc40-4ee0440ca711 tempest-AttachVolumeShelveTestJSON-1705043075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:07:15 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-85028635-53e7-4257-bc40-4ee0440ca711 tempest-AttachVolumeShelveTestJSON-1705043075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:07:15 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-85028635-53e7-4257-bc40-4ee0440ca711 tempest-AttachVolumeShelveTestJSON-1705043075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:07:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-85028635-53e7-4257-bc40-4ee0440ca711 tempest-AttachVolumeShelveTestJSON-1705043075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:07:15 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-85028635-53e7-4257-bc40-4ee0440ca711 tempest-AttachVolumeShelveTestJSON-1705043075 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:07:15 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-85028635-53e7-4257-bc40-4ee0440ca711 tempest-AttachVolumeShelveTestJSON-1705043075 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:07:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-85028635-53e7-4257-bc40-4ee0440ca711 tempest-AttachVolumeShelveTestJSON-1705043075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-416da17f-b7e3-40ab-9d32-767a17b80bb8 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:07:15 devstack sudo[88454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-416da17f-b7e3-40ab-9d32-767a17b80bb8 1073741824
Nov 05 19:07:15 devstack sudo[88454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:07:15 devstack sudo[88454]: pam_unix(sudo:session): session closed for user root
Nov 05 19:07:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-85028635-53e7-4257-bc40-4ee0440ca711 tempest-AttachVolumeShelveTestJSON-1705043075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-416da17f-b7e3-40ab-9d32-767a17b80bb8 1073741824" returned: 0 in 0.471s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:07:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-85028635-53e7-4257-bc40-4ee0440ca711 tempest-AttachVolumeShelveTestJSON-1705043075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-416da17f-b7e3-40ab-9d32-767a17b80bb8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:07:15 devstack sudo[88460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-416da17f-b7e3-40ab-9d32-767a17b80bb8
Nov 05 19:07:15 devstack sudo[88460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:07:16 devstack sudo[88460]: pam_unix(sudo:session): session closed for user root
Nov 05 19:07:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-85028635-53e7-4257-bc40-4ee0440ca711 tempest-AttachVolumeShelveTestJSON-1705043075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-416da17f-b7e3-40ab-9d32-767a17b80bb8" returned: 0 in 0.271s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:07:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-85028635-53e7-4257-bc40-4ee0440ca711 tempest-AttachVolumeShelveTestJSON-1705043075 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:07:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-85028635-53e7-4257-bc40-4ee0440ca711 tempest-AttachVolumeShelveTestJSON-1705043075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:07:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-85028635-53e7-4257-bc40-4ee0440ca711 tempest-AttachVolumeShelveTestJSON-1705043075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ad13bfa-c92f-4695-a8bd-c0c5131064c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-416da17f-b7e3-40ab-9d32-767a17b80bb8', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:07:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-85028635-53e7-4257-bc40-4ee0440ca711 tempest-AttachVolumeShelveTestJSON-1705043075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaef96a5-8787-45a1-8425-2fda6f90a6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:07:16 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-85028635-53e7-4257-bc40-4ee0440ca711 tempest-AttachVolumeShelveTestJSON-1705043075 None] Volume volume-416da17f-b7e3-40ab-9d32-767a17b80bb8 (416da17f-b7e3-40ab-9d32-767a17b80bb8): created successfully
Nov 05 19:07:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-85028635-53e7-4257-bc40-4ee0440ca711 tempest-AttachVolumeShelveTestJSON-1705043075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaef96a5-8787-45a1-8425-2fda6f90a6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:07:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-85028635-53e7-4257-bc40-4ee0440ca711 tempest-AttachVolumeShelveTestJSON-1705043075 None] Flow 'volume_create_manager' (51965480-e829-4544-9515-facfc093cc11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:07:16 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-85028635-53e7-4257-bc40-4ee0440ca711 tempest-AttachVolumeShelveTestJSON-1705043075 None] Created volume successfully.
Nov 05 19:07:26 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:UPDATE=23,cinder:SELECT=9,cinder:INSERT=3,cinder:DELETE=3 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:07:26 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=13,cinder:UPDATE=11,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:07:35 devstack cinder-volume[87184]: WARNING py.warnings [req-dd6e9f14-7ee8-47bb-8943-85ad259a1c67 req-52790f3f-b7f0-46f1-8d96-4a65ed02e7a8 tempest-AttachVolumeShelveTestJSON-1705043075 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes".  Apply join condition(s) between each element to resolve.
Nov 05 19:07:35 devstack cinder-volume[87184]:   .first()
Nov 05 19:07:35 devstack cinder-volume[87184]: 
Nov 05 19:07:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-dd6e9f14-7ee8-47bb-8943-85ad259a1c67 req-52790f3f-b7f0-46f1-8d96-4a65ed02e7a8 tempest-AttachVolumeShelveTestJSON-1705043075 None] No connector for attachment c266cb43-5037-4d8a-94d6-fbf330a15c82; skipping storage backend terminate_connection call. {{(pid=87184) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Nov 05 19:07:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-dd6e9f14-7ee8-47bb-8943-85ad259a1c67 req-52790f3f-b7f0-46f1-8d96-4a65ed02e7a8 tempest-AttachVolumeShelveTestJSON-1705043075 None] Deleting attachment c266cb43-5037-4d8a-94d6-fbf330a15c82. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 19:07:44 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-c91b0357-45be-4ccb-b120-f4b53d68a21b tempest-TaggedAttachmentsTest-1343347901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:07:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c91b0357-45be-4ccb-b120-f4b53d68a21b tempest-TaggedAttachmentsTest-1343347901 None] Flow 'volume_create_manager' (47e3204f-e806-46e3-83e7-c0eb600b9508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:07:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c91b0357-45be-4ccb-b120-f4b53d68a21b tempest-TaggedAttachmentsTest-1343347901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f94a7c5-7833-4ff3-87ff-e60c3acb082e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:07:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c91b0357-45be-4ccb-b120-f4b53d68a21b tempest-TaggedAttachmentsTest-1343347901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f94a7c5-7833-4ff3-87ff-e60c3acb082e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1256199763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=172f5f0e-b51f-4f6a-bd86-7c931f57bd03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf6250b8533b41a0ba20ab7a7348add5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:07:45Z,use_quota=True,user_id='b87189cdda254a849589752768e2169e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:07:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c91b0357-45be-4ccb-b120-f4b53d68a21b tempest-TaggedAttachmentsTest-1343347901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8a20982-aa9a-4f59-bb29-c17aef94a3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:07:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c91b0357-45be-4ccb-b120-f4b53d68a21b tempest-TaggedAttachmentsTest-1343347901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8a20982-aa9a-4f59-bb29-c17aef94a3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:07:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c91b0357-45be-4ccb-b120-f4b53d68a21b tempest-TaggedAttachmentsTest-1343347901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ef49d8-b3b4-4e11-ad98-41d91df187a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:07:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c91b0357-45be-4ccb-b120-f4b53d68a21b tempest-TaggedAttachmentsTest-1343347901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ef49d8-b3b4-4e11-ad98-41d91df187a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '172f5f0e-b51f-4f6a-bd86-7c931f57bd03', 'volume_name': 'volume-172f5f0e-b51f-4f6a-bd86-7c931f57bd03', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:07:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c91b0357-45be-4ccb-b120-f4b53d68a21b tempest-TaggedAttachmentsTest-1343347901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdc4d7a1-d242-47a5-b9ef-c031fdf9da1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:07:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c91b0357-45be-4ccb-b120-f4b53d68a21b tempest-TaggedAttachmentsTest-1343347901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdc4d7a1-d242-47a5-b9ef-c031fdf9da1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:07:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c91b0357-45be-4ccb-b120-f4b53d68a21b tempest-TaggedAttachmentsTest-1343347901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2c063fb-3139-4a27-b73b-ddefa8641693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:07:44 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-c91b0357-45be-4ccb-b120-f4b53d68a21b tempest-TaggedAttachmentsTest-1343347901 None] Volume 172f5f0e-b51f-4f6a-bd86-7c931f57bd03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-172f5f0e-b51f-4f6a-bd86-7c931f57bd03', 'volume_size': 1}
Nov 05 19:07:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c91b0357-45be-4ccb-b120-f4b53d68a21b tempest-TaggedAttachmentsTest-1343347901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:07:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c91b0357-45be-4ccb-b120-f4b53d68a21b tempest-TaggedAttachmentsTest-1343347901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:07:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c91b0357-45be-4ccb-b120-f4b53d68a21b tempest-TaggedAttachmentsTest-1343347901 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1256199763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=172f5f0e-b51f-4f6a-bd86-7c931f57bd03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf6250b8533b41a0ba20ab7a7348add5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:07:45Z,use_quota=True,user_id='b87189cdda254a849589752768e2169e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:07:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-c91b0357-45be-4ccb-b120-f4b53d68a21b tempest-TaggedAttachmentsTest-1343347901 None] Creating volume 172f5f0e-b51f-4f6a-bd86-7c931f57bd03 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:07:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c91b0357-45be-4ccb-b120-f4b53d68a21b tempest-TaggedAttachmentsTest-1343347901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:07:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c91b0357-45be-4ccb-b120-f4b53d68a21b tempest-TaggedAttachmentsTest-1343347901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:07:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c91b0357-45be-4ccb-b120-f4b53d68a21b tempest-TaggedAttachmentsTest-1343347901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:07:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c91b0357-45be-4ccb-b120-f4b53d68a21b tempest-TaggedAttachmentsTest-1343347901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:07:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c91b0357-45be-4ccb-b120-f4b53d68a21b tempest-TaggedAttachmentsTest-1343347901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:07:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c91b0357-45be-4ccb-b120-f4b53d68a21b tempest-TaggedAttachmentsTest-1343347901 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:07:44 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-c91b0357-45be-4ccb-b120-f4b53d68a21b tempest-TaggedAttachmentsTest-1343347901 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:07:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c91b0357-45be-4ccb-b120-f4b53d68a21b tempest-TaggedAttachmentsTest-1343347901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-172f5f0e-b51f-4f6a-bd86-7c931f57bd03 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:07:44 devstack sudo[88642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-172f5f0e-b51f-4f6a-bd86-7c931f57bd03 1073741824
Nov 05 19:07:44 devstack sudo[88642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:07:45 devstack sudo[88642]: pam_unix(sudo:session): session closed for user root
Nov 05 19:07:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c91b0357-45be-4ccb-b120-f4b53d68a21b tempest-TaggedAttachmentsTest-1343347901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-172f5f0e-b51f-4f6a-bd86-7c931f57bd03 1073741824" returned: 0 in 0.810s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:07:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c91b0357-45be-4ccb-b120-f4b53d68a21b tempest-TaggedAttachmentsTest-1343347901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-172f5f0e-b51f-4f6a-bd86-7c931f57bd03 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:07:45 devstack sudo[88650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-172f5f0e-b51f-4f6a-bd86-7c931f57bd03
Nov 05 19:07:45 devstack sudo[88650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:07:46 devstack sudo[88650]: pam_unix(sudo:session): session closed for user root
Nov 05 19:07:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c91b0357-45be-4ccb-b120-f4b53d68a21b tempest-TaggedAttachmentsTest-1343347901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-172f5f0e-b51f-4f6a-bd86-7c931f57bd03" returned: 0 in 0.395s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:07:46 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c91b0357-45be-4ccb-b120-f4b53d68a21b tempest-TaggedAttachmentsTest-1343347901 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:07:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c91b0357-45be-4ccb-b120-f4b53d68a21b tempest-TaggedAttachmentsTest-1343347901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:07:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c91b0357-45be-4ccb-b120-f4b53d68a21b tempest-TaggedAttachmentsTest-1343347901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2c063fb-3139-4a27-b73b-ddefa8641693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-172f5f0e-b51f-4f6a-bd86-7c931f57bd03', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:07:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c91b0357-45be-4ccb-b120-f4b53d68a21b tempest-TaggedAttachmentsTest-1343347901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe2be3dd-b4cc-44aa-a9fe-a0a5bf9e28e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:07:46 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-c91b0357-45be-4ccb-b120-f4b53d68a21b tempest-TaggedAttachmentsTest-1343347901 None] Volume volume-172f5f0e-b51f-4f6a-bd86-7c931f57bd03 (172f5f0e-b51f-4f6a-bd86-7c931f57bd03): created successfully
Nov 05 19:07:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c91b0357-45be-4ccb-b120-f4b53d68a21b tempest-TaggedAttachmentsTest-1343347901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe2be3dd-b4cc-44aa-a9fe-a0a5bf9e28e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:07:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c91b0357-45be-4ccb-b120-f4b53d68a21b tempest-TaggedAttachmentsTest-1343347901 None] Flow 'volume_create_manager' (47e3204f-e806-46e3-83e7-c0eb600b9508) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:07:46 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-c91b0357-45be-4ccb-b120-f4b53d68a21b tempest-TaggedAttachmentsTest-1343347901 None] Created volume successfully.
Nov 05 19:07:56 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=4,cinder:UPDATE=4 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:07:56 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:08:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-c9fd4037-50f7-4661-b27f-11aea8059307 req-57e51c53-747c-48cd-a9d0-6af54a792458 tempest-ServerActionsTestOtherA-1201227496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:08:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-c9fd4037-50f7-4661-b27f-11aea8059307 req-57e51c53-747c-48cd-a9d0-6af54a792458 tempest-ServerActionsTestOtherA-1201227496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:08:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-c9fd4037-50f7-4661-b27f-11aea8059307 req-57e51c53-747c-48cd-a9d0-6af54a792458 tempest-ServerActionsTestOtherA-1201227496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.047s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:08:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-c9fd4037-50f7-4661-b27f-11aea8059307 req-57e51c53-747c-48cd-a9d0-6af54a792458 tempest-ServerActionsTestOtherA-1201227496 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec', 'name': 'volume-d9c78cd6-0fef-4f57-8c93-e32f92c3e52f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '65bdbee6-d40e-41a1-aee1-22edbbb1c69c', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 19:08:04 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-c9fd4037-50f7-4661-b27f-11aea8059307 req-57e51c53-747c-48cd-a9d0-6af54a792458 tempest-ServerActionsTestOtherA-1201227496 None] attachment_update completed successfully.
Nov 05 19:08:05 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8f29e15-4c66-4c07-a58d-0413590f4aa5 tempest-DeleteServersTestJSON-527704804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:08:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d8f29e15-4c66-4c07-a58d-0413590f4aa5 tempest-DeleteServersTestJSON-527704804 None] Flow 'volume_create_manager' (dba31dd4-e35f-4c19-8429-94a2b3231f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:08:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d8f29e15-4c66-4c07-a58d-0413590f4aa5 tempest-DeleteServersTestJSON-527704804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95dcdb19-8c06-46ba-9f3f-9997e302afd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:08:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d8f29e15-4c66-4c07-a58d-0413590f4aa5 tempest-DeleteServersTestJSON-527704804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95dcdb19-8c06-46ba-9f3f-9997e302afd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1476949265',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec10a8ed-e31f-4a42-809c-4bbb226acf0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9cbf11e9e78487984d1b99b4d456bb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:08:05Z,use_quota=True,user_id='037603a488a44011bf5e8409fda6b21b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:08:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d8f29e15-4c66-4c07-a58d-0413590f4aa5 tempest-DeleteServersTestJSON-527704804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f1145f-e6a9-4b49-9c71-908a4b2a4280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:08:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d8f29e15-4c66-4c07-a58d-0413590f4aa5 tempest-DeleteServersTestJSON-527704804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f1145f-e6a9-4b49-9c71-908a4b2a4280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:08:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d8f29e15-4c66-4c07-a58d-0413590f4aa5 tempest-DeleteServersTestJSON-527704804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f7e2e81-5d1d-4dd9-98b6-30339ed4100c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:08:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d8f29e15-4c66-4c07-a58d-0413590f4aa5 tempest-DeleteServersTestJSON-527704804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f7e2e81-5d1d-4dd9-98b6-30339ed4100c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec10a8ed-e31f-4a42-809c-4bbb226acf0c', 'volume_name': 'volume-ec10a8ed-e31f-4a42-809c-4bbb226acf0c', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:08:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d8f29e15-4c66-4c07-a58d-0413590f4aa5 tempest-DeleteServersTestJSON-527704804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddab0c14-eb9f-4bb6-b3f0-2e891aba164a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:08:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d8f29e15-4c66-4c07-a58d-0413590f4aa5 tempest-DeleteServersTestJSON-527704804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddab0c14-eb9f-4bb6-b3f0-2e891aba164a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:08:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d8f29e15-4c66-4c07-a58d-0413590f4aa5 tempest-DeleteServersTestJSON-527704804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af3909f-2e1b-41b0-9188-34c51059e1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:08:05 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-d8f29e15-4c66-4c07-a58d-0413590f4aa5 tempest-DeleteServersTestJSON-527704804 None] Volume ec10a8ed-e31f-4a42-809c-4bbb226acf0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec10a8ed-e31f-4a42-809c-4bbb226acf0c', 'volume_size': 1}
Nov 05 19:08:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d8f29e15-4c66-4c07-a58d-0413590f4aa5 tempest-DeleteServersTestJSON-527704804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:08:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d8f29e15-4c66-4c07-a58d-0413590f4aa5 tempest-DeleteServersTestJSON-527704804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:08:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d8f29e15-4c66-4c07-a58d-0413590f4aa5 tempest-DeleteServersTestJSON-527704804 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1476949265',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec10a8ed-e31f-4a42-809c-4bbb226acf0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9cbf11e9e78487984d1b99b4d456bb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:08:05Z,use_quota=True,user_id='037603a488a44011bf5e8409fda6b21b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:08:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-d8f29e15-4c66-4c07-a58d-0413590f4aa5 tempest-DeleteServersTestJSON-527704804 None] Creating volume ec10a8ed-e31f-4a42-809c-4bbb226acf0c {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:08:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d8f29e15-4c66-4c07-a58d-0413590f4aa5 tempest-DeleteServersTestJSON-527704804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:08:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d8f29e15-4c66-4c07-a58d-0413590f4aa5 tempest-DeleteServersTestJSON-527704804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:08:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d8f29e15-4c66-4c07-a58d-0413590f4aa5 tempest-DeleteServersTestJSON-527704804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:08:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d8f29e15-4c66-4c07-a58d-0413590f4aa5 tempest-DeleteServersTestJSON-527704804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:08:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d8f29e15-4c66-4c07-a58d-0413590f4aa5 tempest-DeleteServersTestJSON-527704804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:08:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d8f29e15-4c66-4c07-a58d-0413590f4aa5 tempest-DeleteServersTestJSON-527704804 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:08:05 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-d8f29e15-4c66-4c07-a58d-0413590f4aa5 tempest-DeleteServersTestJSON-527704804 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:08:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d8f29e15-4c66-4c07-a58d-0413590f4aa5 tempest-DeleteServersTestJSON-527704804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ec10a8ed-e31f-4a42-809c-4bbb226acf0c 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:08:05 devstack sudo[88987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ec10a8ed-e31f-4a42-809c-4bbb226acf0c 1073741824
Nov 05 19:08:05 devstack sudo[88987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:08:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:08:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:08:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:08:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:08:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:08:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.068s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:08:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:08:05 devstack sudo[89087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:08:05 devstack sudo[89087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:08:06 devstack sudo[89087]: pam_unix(sudo:session): session closed for user root
Nov 05 19:08:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.777s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:08:06 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:08:06 devstack sudo[88987]: pam_unix(sudo:session): session closed for user root
Nov 05 19:08:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d8f29e15-4c66-4c07-a58d-0413590f4aa5 tempest-DeleteServersTestJSON-527704804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ec10a8ed-e31f-4a42-809c-4bbb226acf0c 1073741824" returned: 0 in 1.211s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:08:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d8f29e15-4c66-4c07-a58d-0413590f4aa5 tempest-DeleteServersTestJSON-527704804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ec10a8ed-e31f-4a42-809c-4bbb226acf0c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:08:06 devstack sudo[89413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ec10a8ed-e31f-4a42-809c-4bbb226acf0c
Nov 05 19:08:06 devstack sudo[89413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:08:06 devstack sudo[89413]: pam_unix(sudo:session): session closed for user root
Nov 05 19:08:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d8f29e15-4c66-4c07-a58d-0413590f4aa5 tempest-DeleteServersTestJSON-527704804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ec10a8ed-e31f-4a42-809c-4bbb226acf0c" returned: 0 in 0.395s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:08:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d8f29e15-4c66-4c07-a58d-0413590f4aa5 tempest-DeleteServersTestJSON-527704804 None] <== create_volume: return (1715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:08:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d8f29e15-4c66-4c07-a58d-0413590f4aa5 tempest-DeleteServersTestJSON-527704804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.718s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:08:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d8f29e15-4c66-4c07-a58d-0413590f4aa5 tempest-DeleteServersTestJSON-527704804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af3909f-2e1b-41b0-9188-34c51059e1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec10a8ed-e31f-4a42-809c-4bbb226acf0c', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:08:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d8f29e15-4c66-4c07-a58d-0413590f4aa5 tempest-DeleteServersTestJSON-527704804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9389644-0f16-435e-b33c-889b1dc8c11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:08:06 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-d8f29e15-4c66-4c07-a58d-0413590f4aa5 tempest-DeleteServersTestJSON-527704804 None] Volume volume-ec10a8ed-e31f-4a42-809c-4bbb226acf0c (ec10a8ed-e31f-4a42-809c-4bbb226acf0c): created successfully
Nov 05 19:08:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d8f29e15-4c66-4c07-a58d-0413590f4aa5 tempest-DeleteServersTestJSON-527704804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9389644-0f16-435e-b33c-889b1dc8c11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:08:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d8f29e15-4c66-4c07-a58d-0413590f4aa5 tempest-DeleteServersTestJSON-527704804 None] Flow 'volume_create_manager' (dba31dd4-e35f-4c19-8429-94a2b3231f64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:08:06 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-d8f29e15-4c66-4c07-a58d-0413590f4aa5 tempest-DeleteServersTestJSON-527704804 None] Created volume successfully.
Nov 05 19:08:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-d6a3ae6d-9dd1-4f70-a70b-100bc4e96ac3 req-49992984-6256-4949-8602-837ef1e5f70e tempest-DeleteServersTestJSON-527704804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:08:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-d6a3ae6d-9dd1-4f70-a70b-100bc4e96ac3 req-49992984-6256-4949-8602-837ef1e5f70e tempest-DeleteServersTestJSON-527704804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:08:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-d6a3ae6d-9dd1-4f70-a70b-100bc4e96ac3 req-49992984-6256-4949-8602-837ef1e5f70e tempest-DeleteServersTestJSON-527704804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:08:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-d6a3ae6d-9dd1-4f70-a70b-100bc4e96ac3 req-49992984-6256-4949-8602-837ef1e5f70e tempest-DeleteServersTestJSON-527704804 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec', 'name': 'volume-ec10a8ed-e31f-4a42-809c-4bbb226acf0c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2583fd28-ece1-4df1-b701-31c798e56b0d', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 19:08:09 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-d6a3ae6d-9dd1-4f70-a70b-100bc4e96ac3 req-49992984-6256-4949-8602-837ef1e5f70e tempest-DeleteServersTestJSON-527704804 None] attachment_update completed successfully.
Nov 05 19:08:11 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-57821f23-02b7-481b-871d-1c9f1573fcdb req-ef289c7f-f973-4cd8-9911-ff064d1c0200 tempest-ServerActionsTestOtherA-1201227496 None] Terminate volume connection completed successfully.
Nov 05 19:08:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-57821f23-02b7-481b-871d-1c9f1573fcdb req-ef289c7f-f973-4cd8-9911-ff064d1c0200 tempest-ServerActionsTestOtherA-1201227496 None] Deleting attachment 65bdbee6-d40e-41a1-aee1-22edbbb1c69c. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 19:08:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-57821f23-02b7-481b-871d-1c9f1573fcdb req-c0a1123c-aeca-4972-b475-6c734d8d4b5a tempest-ServerActionsTestOtherA-1201227496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:08:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-57821f23-02b7-481b-871d-1c9f1573fcdb req-c0a1123c-aeca-4972-b475-6c734d8d4b5a tempest-ServerActionsTestOtherA-1201227496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:08:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-57821f23-02b7-481b-871d-1c9f1573fcdb req-c0a1123c-aeca-4972-b475-6c734d8d4b5a tempest-ServerActionsTestOtherA-1201227496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:08:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-57821f23-02b7-481b-871d-1c9f1573fcdb req-c0a1123c-aeca-4972-b475-6c734d8d4b5a tempest-ServerActionsTestOtherA-1201227496 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec', 'name': 'volume-d9c78cd6-0fef-4f57-8c93-e32f92c3e52f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4a296831-ddfe-4a94-aa20-19e998508a9a', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 19:08:14 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-57821f23-02b7-481b-871d-1c9f1573fcdb req-c0a1123c-aeca-4972-b475-6c734d8d4b5a tempest-ServerActionsTestOtherA-1201227496 None] attachment_update completed successfully.
Nov 05 19:08:15 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-0000be8f-97f5-4ba4-bb37-f909141344b8 req-c0ff3b93-edce-45f0-8535-a0bb9220e7ed tempest-DeleteServersTestJSON-527704804 None] Terminate volume connection completed successfully.
Nov 05 19:08:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-0000be8f-97f5-4ba4-bb37-f909141344b8 req-c0ff3b93-edce-45f0-8535-a0bb9220e7ed tempest-DeleteServersTestJSON-527704804 None] Deleting attachment 2583fd28-ece1-4df1-b701-31c798e56b0d. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 19:08:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-edb5c379-9237-4700-954d-a7ff80a01728 tempest-DeleteServersTestJSON-527704804 None] Acquiring lock "cinder-ec10a8ed-e31f-4a42-809c-4bbb226acf0c-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:08:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-edb5c379-9237-4700-954d-a7ff80a01728 tempest-DeleteServersTestJSON-527704804 None] Lock "cinder-ec10a8ed-e31f-4a42-809c-4bbb226acf0c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:08:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-edb5c379-9237-4700-954d-a7ff80a01728 tempest-DeleteServersTestJSON-527704804 None] Acquiring lock "cinder-quobyte-ec10a8ed-e31f-4a42-809c-4bbb226acf0c" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:08:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-edb5c379-9237-4700-954d-a7ff80a01728 tempest-DeleteServersTestJSON-527704804 None] Lock "cinder-quobyte-ec10a8ed-e31f-4a42-809c-4bbb226acf0c" acquired by "delete_volume" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:08:18 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a472a4-b13b-4e7d-a90a-82311f523454]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:08:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-edb5c379-9237-4700-954d-a7ff80a01728 tempest-DeleteServersTestJSON-527704804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ec10a8ed-e31f-4a42-809c-4bbb226acf0c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:08:18 devstack sudo[90006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ec10a8ed-e31f-4a42-809c-4bbb226acf0c
Nov 05 19:08:18 devstack sudo[90006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:08:18 devstack sudo[90006]: pam_unix(sudo:session): session closed for user root
Nov 05 19:08:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-edb5c379-9237-4700-954d-a7ff80a01728 tempest-DeleteServersTestJSON-527704804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ec10a8ed-e31f-4a42-809c-4bbb226acf0c" returned: 0 in 0.383s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:08:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-edb5c379-9237-4700-954d-a7ff80a01728 tempest-DeleteServersTestJSON-527704804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ec10a8ed-e31f-4a42-809c-4bbb226acf0c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:08:18 devstack sudo[90011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ec10a8ed-e31f-4a42-809c-4bbb226acf0c
Nov 05 19:08:18 devstack sudo[90011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:08:18 devstack sudo[90011]: pam_unix(sudo:session): session closed for user root
Nov 05 19:08:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-edb5c379-9237-4700-954d-a7ff80a01728 tempest-DeleteServersTestJSON-527704804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ec10a8ed-e31f-4a42-809c-4bbb226acf0c" returned: 0 in 0.307s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:08:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-edb5c379-9237-4700-954d-a7ff80a01728 tempest-DeleteServersTestJSON-527704804 None] Lock "cinder-quobyte-ec10a8ed-e31f-4a42-809c-4bbb226acf0c" released by "delete_volume" :: held 0.750s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:08:19 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-edb5c379-9237-4700-954d-a7ff80a01728 tempest-DeleteServersTestJSON-527704804 None] Created reservations ['ed65bfca-9093-4131-9987-c3c74f7ef7f7', '7f6da6be-63c9-4f2e-863c-12189ad5170c', '9c89955a-4784-4375-89a1-d6f71196944b', 'ffdab6de-8ec2-45ae-9204-7fbf908f36f3'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:08:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-edb5c379-9237-4700-954d-a7ff80a01728 tempest-DeleteServersTestJSON-527704804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:08:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-edb5c379-9237-4700-954d-a7ff80a01728 tempest-DeleteServersTestJSON-527704804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:08:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-edb5c379-9237-4700-954d-a7ff80a01728 tempest-DeleteServersTestJSON-527704804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:08:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-edb5c379-9237-4700-954d-a7ff80a01728 tempest-DeleteServersTestJSON-527704804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:08:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-edb5c379-9237-4700-954d-a7ff80a01728 tempest-DeleteServersTestJSON-527704804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:08:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-edb5c379-9237-4700-954d-a7ff80a01728 tempest-DeleteServersTestJSON-527704804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:08:19 devstack sudo[90017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:08:19 devstack sudo[90017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:08:19 devstack sudo[90017]: pam_unix(sudo:session): session closed for user root
Nov 05 19:08:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-edb5c379-9237-4700-954d-a7ff80a01728 tempest-DeleteServersTestJSON-527704804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.382s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:08:19 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-edb5c379-9237-4700-954d-a7ff80a01728 tempest-DeleteServersTestJSON-527704804 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:08:19 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-edb5c379-9237-4700-954d-a7ff80a01728 tempest-DeleteServersTestJSON-527704804 None] Deleted volume successfully.
Nov 05 19:08:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-edb5c379-9237-4700-954d-a7ff80a01728 tempest-DeleteServersTestJSON-527704804 None] Lock "cinder-ec10a8ed-e31f-4a42-809c-4bbb226acf0c-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:08:29 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=27,cinder:UPDATE=17,cinder:INSERT=3 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:08:29 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=30,cinder:UPDATE=14,cinder:INSERT=2,cinder:DELETE=2 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:08:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-4c059cf9-fd19-49ca-a2ea-53f69b61687f req-b5ce3307-d2e6-4995-9cad-25638fa00c0c tempest-TaggedAttachmentsTest-1343347901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:08:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-4c059cf9-fd19-49ca-a2ea-53f69b61687f req-b5ce3307-d2e6-4995-9cad-25638fa00c0c tempest-TaggedAttachmentsTest-1343347901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:08:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-4c059cf9-fd19-49ca-a2ea-53f69b61687f req-b5ce3307-d2e6-4995-9cad-25638fa00c0c tempest-TaggedAttachmentsTest-1343347901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:08:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-4c059cf9-fd19-49ca-a2ea-53f69b61687f req-b5ce3307-d2e6-4995-9cad-25638fa00c0c tempest-TaggedAttachmentsTest-1343347901 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec', 'name': 'volume-172f5f0e-b51f-4f6a-bd86-7c931f57bd03', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9894a077-af07-41ed-9232-637564050681', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 19:08:40 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-4c059cf9-fd19-49ca-a2ea-53f69b61687f req-b5ce3307-d2e6-4995-9cad-25638fa00c0c tempest-TaggedAttachmentsTest-1343347901 None] attachment_update completed successfully.
Nov 05 19:08:44 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-e435ef18-abef-43e5-b24b-fec627e62f82 req-10386ca2-4e74-4efe-84c1-040ac7f75e53 tempest-ServerActionsTestOtherA-1201227496 None] Terminate volume connection completed successfully.
Nov 05 19:08:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-e435ef18-abef-43e5-b24b-fec627e62f82 req-10386ca2-4e74-4efe-84c1-040ac7f75e53 tempest-ServerActionsTestOtherA-1201227496 None] Deleting attachment 4a296831-ddfe-4a94-aa20-19e998508a9a. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 19:08:44 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-21fcc6aa-a8d3-46ae-950a-825ffba4aa4e req-342a9d1e-43f6-4a0c-acdc-d1416a780423 tempest-TaggedAttachmentsTest-1343347901 None] Terminate volume connection completed successfully.
Nov 05 19:08:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-21fcc6aa-a8d3-46ae-950a-825ffba4aa4e req-342a9d1e-43f6-4a0c-acdc-d1416a780423 tempest-TaggedAttachmentsTest-1343347901 None] Deleting attachment 9894a077-af07-41ed-9232-637564050681. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 19:08:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f32a60e2-fc62-4d95-bd37-6f6052f76ec0 tempest-AttachVolumeShelveTestJSON-1705043075 None] Acquiring lock "cinder-416da17f-b7e3-40ab-9d32-767a17b80bb8-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:08:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f32a60e2-fc62-4d95-bd37-6f6052f76ec0 tempest-AttachVolumeShelveTestJSON-1705043075 None] Lock "cinder-416da17f-b7e3-40ab-9d32-767a17b80bb8-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:08:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f32a60e2-fc62-4d95-bd37-6f6052f76ec0 tempest-AttachVolumeShelveTestJSON-1705043075 None] Acquiring lock "cinder-quobyte-416da17f-b7e3-40ab-9d32-767a17b80bb8" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:08:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f32a60e2-fc62-4d95-bd37-6f6052f76ec0 tempest-AttachVolumeShelveTestJSON-1705043075 None] Lock "cinder-quobyte-416da17f-b7e3-40ab-9d32-767a17b80bb8" acquired by "delete_volume" :: waited 0.032s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:08:45 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f43683-60ec-41ad-8972-ac23adf2d4f0]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:08:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f32a60e2-fc62-4d95-bd37-6f6052f76ec0 tempest-AttachVolumeShelveTestJSON-1705043075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-416da17f-b7e3-40ab-9d32-767a17b80bb8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:08:45 devstack sudo[90295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-416da17f-b7e3-40ab-9d32-767a17b80bb8
Nov 05 19:08:45 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:08:46 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root
Nov 05 19:08:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f32a60e2-fc62-4d95-bd37-6f6052f76ec0 tempest-AttachVolumeShelveTestJSON-1705043075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-416da17f-b7e3-40ab-9d32-767a17b80bb8" returned: 0 in 0.820s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:08:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f32a60e2-fc62-4d95-bd37-6f6052f76ec0 tempest-AttachVolumeShelveTestJSON-1705043075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-416da17f-b7e3-40ab-9d32-767a17b80bb8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:08:46 devstack sudo[90322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-416da17f-b7e3-40ab-9d32-767a17b80bb8
Nov 05 19:08:46 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:08:46 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root
Nov 05 19:08:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f32a60e2-fc62-4d95-bd37-6f6052f76ec0 tempest-AttachVolumeShelveTestJSON-1705043075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-416da17f-b7e3-40ab-9d32-767a17b80bb8" returned: 0 in 0.536s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:08:46 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f32a60e2-fc62-4d95-bd37-6f6052f76ec0 tempest-AttachVolumeShelveTestJSON-1705043075 None] Lock "cinder-quobyte-416da17f-b7e3-40ab-9d32-767a17b80bb8" released by "delete_volume" :: held 1.464s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:08:46 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-f32a60e2-fc62-4d95-bd37-6f6052f76ec0 tempest-AttachVolumeShelveTestJSON-1705043075 None] Created reservations ['cd65f4df-9e5f-4b87-9b0e-f5fc3df25273', 'ac342eba-8e1d-4d2e-ad44-4f8eb54e6f69', 'bd8bc4eb-9956-4684-a37f-24bfb4708d81', 'dc99ab1a-70c0-4d22-94f2-1a27455b402e'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:08:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f32a60e2-fc62-4d95-bd37-6f6052f76ec0 tempest-AttachVolumeShelveTestJSON-1705043075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:08:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f32a60e2-fc62-4d95-bd37-6f6052f76ec0 tempest-AttachVolumeShelveTestJSON-1705043075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:08:46 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f32a60e2-fc62-4d95-bd37-6f6052f76ec0 tempest-AttachVolumeShelveTestJSON-1705043075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:08:46 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f32a60e2-fc62-4d95-bd37-6f6052f76ec0 tempest-AttachVolumeShelveTestJSON-1705043075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:08:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f32a60e2-fc62-4d95-bd37-6f6052f76ec0 tempest-AttachVolumeShelveTestJSON-1705043075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:08:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f32a60e2-fc62-4d95-bd37-6f6052f76ec0 tempest-AttachVolumeShelveTestJSON-1705043075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:08:46 devstack sudo[90359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:08:46 devstack sudo[90359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:08:47 devstack sudo[90359]: pam_unix(sudo:session): session closed for user root
Nov 05 19:08:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f32a60e2-fc62-4d95-bd37-6f6052f76ec0 tempest-AttachVolumeShelveTestJSON-1705043075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.281s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:08:47 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-f32a60e2-fc62-4d95-bd37-6f6052f76ec0 tempest-AttachVolumeShelveTestJSON-1705043075 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:08:47 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f32a60e2-fc62-4d95-bd37-6f6052f76ec0 tempest-AttachVolumeShelveTestJSON-1705043075 None] Deleted volume successfully.
Nov 05 19:08:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f32a60e2-fc62-4d95-bd37-6f6052f76ec0 tempest-AttachVolumeShelveTestJSON-1705043075 None] Lock "cinder-416da17f-b7e3-40ab-9d32-767a17b80bb8-delete_volume" released by "delete_volume" :: held 2.034s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:08:54 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:08:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Flow 'volume_create_manager' (89cd334f-3583-469c-874a-dd9f61b1beab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:08:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0006cac5-6a55-4ba1-af9d-4942c5800b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:08:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0006cac5-6a55-4ba1-af9d-4942c5800b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-403911042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e96d910b-0ace-4196-9a8b-5c14b5946d88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='603afb9729324fe6b0dd981526241801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:08:54Z,use_quota=True,user_id='a4ade5547ede44fe822a49ed14705361',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:08:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc5186b5-94ba-48f1-9053-e2759b9e7211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:08:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc5186b5-94ba-48f1-9053-e2759b9e7211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:08:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (319f9d48-78b6-495d-8df0-91b31c50e787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:08:54 devstack cinder-volume[87184]: DEBUG cinder.image.glance [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Creating Keystone auth plugin from conf {{(pid=87184) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 19:08:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (319f9d48-78b6-495d-8df0-91b31c50e787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e96d910b-0ace-4196-9a8b-5c14b5946d88', 'volume_name': 'volume-e96d910b-0ace-4196-9a8b-5c14b5946d88', 'volume_size': 1, 'image_id': '300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3e813114ebb84b35a5c6eb1b802f157f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'created_at': datetime.datetime(2026, 11, 5, 18, 1, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 18, 1, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x736631df0e90>}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:08:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dea748b-7a46-4a6c-b087-bb84d375059c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:08:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dea748b-7a46-4a6c-b087-bb84d375059c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:08:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c917bb9f-34a0-4aa6-86e9-78db75451a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:08:54 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Volume e96d910b-0ace-4196-9a8b-5c14b5946d88: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e96d910b-0ace-4196-9a8b-5c14b5946d88', 'volume_size': 1, 'image_id': '300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3e813114ebb84b35a5c6eb1b802f157f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'created_at': datetime.datetime(2026, 11, 5, 18, 1, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 18, 1, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x736631df0e90>}
Nov 05 19:08:54 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Trying to clone e96d910b-0ace-4196-9a8b-5c14b5946d88 from image 300700a0-51ab-4ee2-8ef0-e0eeaa8aee29 at location (None, [{'url': 'file:///opt/stack/data/glance/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'metadata': {}}]). {{(pid=87184) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 19:08:55 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_f_o1lnmcdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 19:08:55 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 19:08:55 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c31514f-9bd3-49d7-9486-7dd0ff48a232]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:08:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_f_o1lnmcdevstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:08:55 devstack sudo[90496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_f_o1lnmcdevstack@QuobyteHD
Nov 05 19:08:55 devstack sudo[90496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:08:56 devstack sudo[90496]: pam_unix(sudo:session): session closed for user root
Nov 05 19:08:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_f_o1lnmcdevstack@QuobyteHD" returned: 0 in 0.632s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:08:56 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Temporary image 300700a0-51ab-4ee2-8ef0-e0eeaa8aee29 is fetched for user a4ade5547ede44fe822a49ed14705361. {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 19:08:56 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[397feff7-1c7a-4279-95e1-33048b6eecfb]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:08:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_f_o1lnmcdevstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:08:56 devstack sudo[90504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_f_o1lnmcdevstack@QuobyteHD
Nov 05 19:08:56 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:08:57 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root
Nov 05 19:08:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_f_o1lnmcdevstack@QuobyteHD" returned: 0 in 0.660s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:08:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:08:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:08:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-403911042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e96d910b-0ace-4196-9a8b-5c14b5946d88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='603afb9729324fe6b0dd981526241801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:08:54Z,use_quota=True,user_id='a4ade5547ede44fe822a49ed14705361',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:08:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Creating volume e96d910b-0ace-4196-9a8b-5c14b5946d88 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:08:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:08:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:08:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:08:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:08:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:08:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:08:57 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:08:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e96d910b-0ace-4196-9a8b-5c14b5946d88 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:08:57 devstack sudo[90513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e96d910b-0ace-4196-9a8b-5c14b5946d88 1073741824
Nov 05 19:08:57 devstack sudo[90513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:08:57 devstack sudo[90513]: pam_unix(sudo:session): session closed for user root
Nov 05 19:08:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e96d910b-0ace-4196-9a8b-5c14b5946d88 1073741824" returned: 0 in 0.732s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:08:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e96d910b-0ace-4196-9a8b-5c14b5946d88 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:08:57 devstack sudo[90521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e96d910b-0ace-4196-9a8b-5c14b5946d88
Nov 05 19:08:57 devstack sudo[90521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:08:58 devstack sudo[90521]: pam_unix(sudo:session): session closed for user root
Nov 05 19:08:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e96d910b-0ace-4196-9a8b-5c14b5946d88" returned: 0 in 0.331s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:08:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:08:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:08:58 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Attempting download of 300700a0-51ab-4ee2-8ef0-e0eeaa8aee29 ((None, [{'url': 'file:///opt/stack/data/glance/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'metadata': {}}])) to volume e96d910b-0ace-4196-9a8b-5c14b5946d88. {{(pid=87184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 19:08:58 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe84e7b-5c96-4d66-963f-46416277536a]: (4, 'raw') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:08:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_j2cgbicn {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:08:58 devstack sudo[90524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_j2cgbicn
Nov 05 19:08:58 devstack sudo[90524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:08:58 devstack sudo[90524]: pam_unix(sudo:session): session closed for user root
Nov 05 19:08:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_j2cgbicn" returned: 0 in 0.386s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:08:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_j2cgbicn {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:08:58 devstack sudo[90528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_j2cgbicn
Nov 05 19:08:58 devstack sudo[90528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:08:59 devstack sudo[90528]: pam_unix(sudo:session): session closed for user root
Nov 05 19:08:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_j2cgbicn" returned: 1 in 0.438s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:08:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_j2cgbicn' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 19:08:59 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4040937c-3a2d-479c-955c-d567098e9a0a]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:08:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_f_o1lnmcdevstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:08:59 devstack sudo[90532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_f_o1lnmcdevstack@QuobyteHD
Nov 05 19:08:59 devstack sudo[90532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:08:59 devstack sudo[90532]: pam_unix(sudo:session): session closed for user root
Nov 05 19:08:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_f_o1lnmcdevstack@QuobyteHD" returned: 0 in 0.440s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:08:59 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] 300700a0-51ab-4ee2-8ef0-e0eeaa8aee29 was qcow2, converting to qcow2 {{(pid=87184) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 19:08:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_f_o1lnmcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e96d910b-0ace-4196-9a8b-5c14b5946d88 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:08:59 devstack sudo[90538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_f_o1lnmcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e96d910b-0ace-4196-9a8b-5c14b5946d88
Nov 05 19:08:59 devstack sudo[90538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:00 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [req-82de201a-3139-4202-bbe5-2e8a92e932af req-a09ad249-ca29-4581-b97b-220018670522 tempest-VolumesGetTestJSON-1751989804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:09:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-82de201a-3139-4202-bbe5-2e8a92e932af req-a09ad249-ca29-4581-b97b-220018670522 tempest-VolumesGetTestJSON-1751989804 None] Flow 'volume_create_manager' (636f8568-aaed-4c93-910c-617c1704bfc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:09:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-82de201a-3139-4202-bbe5-2e8a92e932af req-a09ad249-ca29-4581-b97b-220018670522 tempest-VolumesGetTestJSON-1751989804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff843088-f703-4ad5-94c5-507604c947da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:09:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-82de201a-3139-4202-bbe5-2e8a92e932af req-a09ad249-ca29-4581-b97b-220018670522 tempest-VolumesGetTestJSON-1751989804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff843088-f703-4ad5-94c5-507604c947da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1228825617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=581ecb29-06d3-4314-be61-e4ec57226cec,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee0b92ede8d74e118683c1c2bfd9aeb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:09:00Z,use_quota=True,user_id='594deba98fc6410bbd035dfbde61d25b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:09:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-82de201a-3139-4202-bbe5-2e8a92e932af req-a09ad249-ca29-4581-b97b-220018670522 tempest-VolumesGetTestJSON-1751989804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bb80727-8e37-40da-a86b-8dfb8d7d4bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:09:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-82de201a-3139-4202-bbe5-2e8a92e932af req-a09ad249-ca29-4581-b97b-220018670522 tempest-VolumesGetTestJSON-1751989804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bb80727-8e37-40da-a86b-8dfb8d7d4bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:09:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-82de201a-3139-4202-bbe5-2e8a92e932af req-a09ad249-ca29-4581-b97b-220018670522 tempest-VolumesGetTestJSON-1751989804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9578a34e-2abe-4da6-adf6-6c8f8c3c3d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:09:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-82de201a-3139-4202-bbe5-2e8a92e932af req-a09ad249-ca29-4581-b97b-220018670522 tempest-VolumesGetTestJSON-1751989804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9578a34e-2abe-4da6-adf6-6c8f8c3c3d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '581ecb29-06d3-4314-be61-e4ec57226cec', 'volume_name': 'volume-581ecb29-06d3-4314-be61-e4ec57226cec', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:09:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-82de201a-3139-4202-bbe5-2e8a92e932af req-a09ad249-ca29-4581-b97b-220018670522 tempest-VolumesGetTestJSON-1751989804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c996c475-754e-4e4f-9d27-a850f6087921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:09:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-82de201a-3139-4202-bbe5-2e8a92e932af req-a09ad249-ca29-4581-b97b-220018670522 tempest-VolumesGetTestJSON-1751989804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c996c475-754e-4e4f-9d27-a850f6087921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:09:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-82de201a-3139-4202-bbe5-2e8a92e932af req-a09ad249-ca29-4581-b97b-220018670522 tempest-VolumesGetTestJSON-1751989804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82bf70bc-2d83-4fac-a87a-fdc2c23c1452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:09:00 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [req-82de201a-3139-4202-bbe5-2e8a92e932af req-a09ad249-ca29-4581-b97b-220018670522 tempest-VolumesGetTestJSON-1751989804 None] Volume 581ecb29-06d3-4314-be61-e4ec57226cec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-581ecb29-06d3-4314-be61-e4ec57226cec', 'volume_size': 1}
Nov 05 19:09:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-82de201a-3139-4202-bbe5-2e8a92e932af req-a09ad249-ca29-4581-b97b-220018670522 tempest-VolumesGetTestJSON-1751989804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:09:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-82de201a-3139-4202-bbe5-2e8a92e932af req-a09ad249-ca29-4581-b97b-220018670522 tempest-VolumesGetTestJSON-1751989804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:09:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [req-82de201a-3139-4202-bbe5-2e8a92e932af req-a09ad249-ca29-4581-b97b-220018670522 tempest-VolumesGetTestJSON-1751989804 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1228825617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=581ecb29-06d3-4314-be61-e4ec57226cec,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee0b92ede8d74e118683c1c2bfd9aeb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:09:00Z,use_quota=True,user_id='594deba98fc6410bbd035dfbde61d25b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:09:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [req-82de201a-3139-4202-bbe5-2e8a92e932af req-a09ad249-ca29-4581-b97b-220018670522 tempest-VolumesGetTestJSON-1751989804 None] Creating volume 581ecb29-06d3-4314-be61-e4ec57226cec {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:09:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-82de201a-3139-4202-bbe5-2e8a92e932af req-a09ad249-ca29-4581-b97b-220018670522 tempest-VolumesGetTestJSON-1751989804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:09:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-82de201a-3139-4202-bbe5-2e8a92e932af req-a09ad249-ca29-4581-b97b-220018670522 tempest-VolumesGetTestJSON-1751989804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:09:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [req-82de201a-3139-4202-bbe5-2e8a92e932af req-a09ad249-ca29-4581-b97b-220018670522 tempest-VolumesGetTestJSON-1751989804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:09:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [req-82de201a-3139-4202-bbe5-2e8a92e932af req-a09ad249-ca29-4581-b97b-220018670522 tempest-VolumesGetTestJSON-1751989804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:09:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-82de201a-3139-4202-bbe5-2e8a92e932af req-a09ad249-ca29-4581-b97b-220018670522 tempest-VolumesGetTestJSON-1751989804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:09:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [req-82de201a-3139-4202-bbe5-2e8a92e932af req-a09ad249-ca29-4581-b97b-220018670522 tempest-VolumesGetTestJSON-1751989804 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:09:00 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [req-82de201a-3139-4202-bbe5-2e8a92e932af req-a09ad249-ca29-4581-b97b-220018670522 tempest-VolumesGetTestJSON-1751989804 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:09:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-82de201a-3139-4202-bbe5-2e8a92e932af req-a09ad249-ca29-4581-b97b-220018670522 tempest-VolumesGetTestJSON-1751989804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-581ecb29-06d3-4314-be61-e4ec57226cec 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:09:00 devstack sudo[90546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-581ecb29-06d3-4314-be61-e4ec57226cec 1073741824
Nov 05 19:09:00 devstack sudo[90546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-70f6e7fd-4896-4ceb-b990-f05c4cc366f2 tempest-TaggedAttachmentsTest-1343347901 None] Acquiring lock "cinder-172f5f0e-b51f-4f6a-bd86-7c931f57bd03-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:09:01 devstack sudo[90546]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-82de201a-3139-4202-bbe5-2e8a92e932af req-a09ad249-ca29-4581-b97b-220018670522 tempest-VolumesGetTestJSON-1751989804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-581ecb29-06d3-4314-be61-e4ec57226cec 1073741824" returned: 0 in 0.668s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-70f6e7fd-4896-4ceb-b990-f05c4cc366f2 tempest-TaggedAttachmentsTest-1343347901 None] Lock "cinder-172f5f0e-b51f-4f6a-bd86-7c931f57bd03-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:09:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-82de201a-3139-4202-bbe5-2e8a92e932af req-a09ad249-ca29-4581-b97b-220018670522 tempest-VolumesGetTestJSON-1751989804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-581ecb29-06d3-4314-be61-e4ec57226cec {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:09:01 devstack sudo[90555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-581ecb29-06d3-4314-be61-e4ec57226cec
Nov 05 19:09:01 devstack sudo[90555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-70f6e7fd-4896-4ceb-b990-f05c4cc366f2 tempest-TaggedAttachmentsTest-1343347901 None] Acquiring lock "cinder-quobyte-172f5f0e-b51f-4f6a-bd86-7c931f57bd03" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:09:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-70f6e7fd-4896-4ceb-b990-f05c4cc366f2 tempest-TaggedAttachmentsTest-1343347901 None] Lock "cinder-quobyte-172f5f0e-b51f-4f6a-bd86-7c931f57bd03" acquired by "delete_volume" :: waited 0.028s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:09:01 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca1822c-2c48-4470-b2f3-8f07b6efc6c4]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:09:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-70f6e7fd-4896-4ceb-b990-f05c4cc366f2 tempest-TaggedAttachmentsTest-1343347901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-172f5f0e-b51f-4f6a-bd86-7c931f57bd03 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:09:01 devstack sudo[90557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-172f5f0e-b51f-4f6a-bd86-7c931f57bd03
Nov 05 19:09:01 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:01 devstack sudo[90555]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-82de201a-3139-4202-bbe5-2e8a92e932af req-a09ad249-ca29-4581-b97b-220018670522 tempest-VolumesGetTestJSON-1751989804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-581ecb29-06d3-4314-be61-e4ec57226cec" returned: 0 in 0.379s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [req-82de201a-3139-4202-bbe5-2e8a92e932af req-a09ad249-ca29-4581-b97b-220018670522 tempest-VolumesGetTestJSON-1751989804 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:09:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-82de201a-3139-4202-bbe5-2e8a92e932af req-a09ad249-ca29-4581-b97b-220018670522 tempest-VolumesGetTestJSON-1751989804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:09:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-82de201a-3139-4202-bbe5-2e8a92e932af req-a09ad249-ca29-4581-b97b-220018670522 tempest-VolumesGetTestJSON-1751989804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82bf70bc-2d83-4fac-a87a-fdc2c23c1452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-581ecb29-06d3-4314-be61-e4ec57226cec', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:09:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-82de201a-3139-4202-bbe5-2e8a92e932af req-a09ad249-ca29-4581-b97b-220018670522 tempest-VolumesGetTestJSON-1751989804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e0ffef6-8f32-46fa-b83b-f1996a2b58ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:09:01 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [req-82de201a-3139-4202-bbe5-2e8a92e932af req-a09ad249-ca29-4581-b97b-220018670522 tempest-VolumesGetTestJSON-1751989804 None] Volume volume-581ecb29-06d3-4314-be61-e4ec57226cec (581ecb29-06d3-4314-be61-e4ec57226cec): created successfully
Nov 05 19:09:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-82de201a-3139-4202-bbe5-2e8a92e932af req-a09ad249-ca29-4581-b97b-220018670522 tempest-VolumesGetTestJSON-1751989804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e0ffef6-8f32-46fa-b83b-f1996a2b58ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:09:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-82de201a-3139-4202-bbe5-2e8a92e932af req-a09ad249-ca29-4581-b97b-220018670522 tempest-VolumesGetTestJSON-1751989804 None] Flow 'volume_create_manager' (636f8568-aaed-4c93-910c-617c1704bfc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:09:01 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-82de201a-3139-4202-bbe5-2e8a92e932af req-a09ad249-ca29-4581-b97b-220018670522 tempest-VolumesGetTestJSON-1751989804 None] Created volume successfully.
Nov 05 19:09:02 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-70f6e7fd-4896-4ceb-b990-f05c4cc366f2 tempest-TaggedAttachmentsTest-1343347901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-172f5f0e-b51f-4f6a-bd86-7c931f57bd03" returned: 0 in 0.425s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-70f6e7fd-4896-4ceb-b990-f05c4cc366f2 tempest-TaggedAttachmentsTest-1343347901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-172f5f0e-b51f-4f6a-bd86-7c931f57bd03 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:09:02 devstack sudo[90563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-172f5f0e-b51f-4f6a-bd86-7c931f57bd03
Nov 05 19:09:02 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:02 devstack sudo[90538]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_f_o1lnmcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e96d910b-0ace-4196-9a8b-5c14b5946d88" returned: 0 in 2.539s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:02 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_f_o1lnmcdevstack@QuobyteHD, size 112.00 MB, duration 2.54 sec, destination /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e96d910b-0ace-4196-9a8b-5c14b5946d88 {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 19:09:02 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Converted 112.00 MB image at 44.09 MB/s
Nov 05 19:09:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e96d910b-0ace-4196-9a8b-5c14b5946d88 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:09:02 devstack sudo[90565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e96d910b-0ace-4196-9a8b-5c14b5946d88 1G
Nov 05 19:09:02 devstack sudo[90565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:02 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-70f6e7fd-4896-4ceb-b990-f05c4cc366f2 tempest-TaggedAttachmentsTest-1343347901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-172f5f0e-b51f-4f6a-bd86-7c931f57bd03" returned: 0 in 0.275s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-70f6e7fd-4896-4ceb-b990-f05c4cc366f2 tempest-TaggedAttachmentsTest-1343347901 None] Lock "cinder-quobyte-172f5f0e-b51f-4f6a-bd86-7c931f57bd03" released by "delete_volume" :: held 0.771s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:09:02 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-70f6e7fd-4896-4ceb-b990-f05c4cc366f2 tempest-TaggedAttachmentsTest-1343347901 None] Created reservations ['fb297f83-3596-486a-b7ff-81fa44622e0d', 'b3ae5589-e27a-4406-ae9f-1bd7639f2750', '152efaa3-dec6-4e71-8d83-f09d53c62891', '83556bf2-877d-423d-8643-4e12dfc8b763'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:09:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-70f6e7fd-4896-4ceb-b990-f05c4cc366f2 tempest-TaggedAttachmentsTest-1343347901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:09:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-70f6e7fd-4896-4ceb-b990-f05c4cc366f2 tempest-TaggedAttachmentsTest-1343347901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:09:02 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-70f6e7fd-4896-4ceb-b990-f05c4cc366f2 tempest-TaggedAttachmentsTest-1343347901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:09:02 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-70f6e7fd-4896-4ceb-b990-f05c4cc366f2 tempest-TaggedAttachmentsTest-1343347901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:09:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-70f6e7fd-4896-4ceb-b990-f05c4cc366f2 tempest-TaggedAttachmentsTest-1343347901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:09:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-70f6e7fd-4896-4ceb-b990-f05c4cc366f2 tempest-TaggedAttachmentsTest-1343347901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:09:02 devstack sudo[90571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:09:02 devstack sudo[90571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:02 devstack sudo[90565]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e96d910b-0ace-4196-9a8b-5c14b5946d88 1G" returned: 0 in 0.393s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:02 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Downloaded image 300700a0-51ab-4ee2-8ef0-e0eeaa8aee29 ((None, [{'url': 'file:///opt/stack/data/glance/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'metadata': {}}])) to volume e96d910b-0ace-4196-9a8b-5c14b5946d88 successfully. {{(pid=87184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 19:09:02 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Temporary image 300700a0-51ab-4ee2-8ef0-e0eeaa8aee29 for user a4ade5547ede44fe822a49ed14705361 is deleted. {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 19:09:02 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Marking volume e96d910b-0ace-4196-9a8b-5c14b5946d88 as bootable. {{(pid=87184) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 19:09:02 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Copying metadata from image 300700a0-51ab-4ee2-8ef0-e0eeaa8aee29 to e96d910b-0ace-4196-9a8b-5c14b5946d88. {{(pid=87184) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 19:09:02 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Creating volume glance metadata for volume e96d910b-0ace-4196-9a8b-5c14b5946d88 backed by image 300700a0-51ab-4ee2-8ef0-e0eeaa8aee29 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87184) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 19:09:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c917bb9f-34a0-4aa6-86e9-78db75451a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e96d910b-0ace-4196-9a8b-5c14b5946d88', 'volume_size': 1, 'image_id': '300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3e813114ebb84b35a5c6eb1b802f157f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'created_at': datetime.datetime(2026, 11, 5, 18, 1, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 18, 1, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x736631df0e90>}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:09:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45b14173-528f-4004-9810-7285addfc591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:09:02 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Volume volume-e96d910b-0ace-4196-9a8b-5c14b5946d88 (e96d910b-0ace-4196-9a8b-5c14b5946d88): created successfully
Nov 05 19:09:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45b14173-528f-4004-9810-7285addfc591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:09:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Flow 'volume_create_manager' (89cd334f-3583-469c-874a-dd9f61b1beab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:09:02 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-0f6f4398-bd7f-4f45-8751-458e5f008d6b tempest-ServerActionsTestOtherA-1201227496 None] Created volume successfully.
Nov 05 19:09:02 devstack sudo[90571]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-70f6e7fd-4896-4ceb-b990-f05c4cc366f2 tempest-TaggedAttachmentsTest-1343347901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.462s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:02 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-70f6e7fd-4896-4ceb-b990-f05c4cc366f2 tempest-TaggedAttachmentsTest-1343347901 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:09:03 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-70f6e7fd-4896-4ceb-b990-f05c4cc366f2 tempest-TaggedAttachmentsTest-1343347901 None] Deleted volume successfully.
Nov 05 19:09:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-70f6e7fd-4896-4ceb-b990-f05c4cc366f2 tempest-TaggedAttachmentsTest-1343347901 None] Lock "cinder-172f5f0e-b51f-4f6a-bd86-7c931f57bd03-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:09:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-210011c6-37ad-4cf2-94e3-336ffc7cccfa req-e00e02eb-2dc9-4500-856c-f7285ad04f0a tempest-VolumesGetTestJSON-1751989804 None] Acquiring lock "cinder-581ecb29-06d3-4314-be61-e4ec57226cec-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:09:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-210011c6-37ad-4cf2-94e3-336ffc7cccfa req-e00e02eb-2dc9-4500-856c-f7285ad04f0a tempest-VolumesGetTestJSON-1751989804 None] Lock "cinder-581ecb29-06d3-4314-be61-e4ec57226cec-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:09:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-210011c6-37ad-4cf2-94e3-336ffc7cccfa req-e00e02eb-2dc9-4500-856c-f7285ad04f0a tempest-VolumesGetTestJSON-1751989804 None] Acquiring lock "cinder-quobyte-581ecb29-06d3-4314-be61-e4ec57226cec" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:09:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-210011c6-37ad-4cf2-94e3-336ffc7cccfa req-e00e02eb-2dc9-4500-856c-f7285ad04f0a tempest-VolumesGetTestJSON-1751989804 None] Lock "cinder-quobyte-581ecb29-06d3-4314-be61-e4ec57226cec" acquired by "delete_volume" :: waited 0.027s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:09:03 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[99999be5-e504-49ca-9d8b-6a6aedd3fda4]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:09:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-210011c6-37ad-4cf2-94e3-336ffc7cccfa req-e00e02eb-2dc9-4500-856c-f7285ad04f0a tempest-VolumesGetTestJSON-1751989804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-581ecb29-06d3-4314-be61-e4ec57226cec {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:09:03 devstack sudo[90574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-581ecb29-06d3-4314-be61-e4ec57226cec
Nov 05 19:09:03 devstack sudo[90574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:03 devstack sudo[90574]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-210011c6-37ad-4cf2-94e3-336ffc7cccfa req-e00e02eb-2dc9-4500-856c-f7285ad04f0a tempest-VolumesGetTestJSON-1751989804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-581ecb29-06d3-4314-be61-e4ec57226cec" returned: 0 in 0.480s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-210011c6-37ad-4cf2-94e3-336ffc7cccfa req-e00e02eb-2dc9-4500-856c-f7285ad04f0a tempest-VolumesGetTestJSON-1751989804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-581ecb29-06d3-4314-be61-e4ec57226cec {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:09:03 devstack sudo[90579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-581ecb29-06d3-4314-be61-e4ec57226cec
Nov 05 19:09:03 devstack sudo[90579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:04 devstack sudo[90579]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-210011c6-37ad-4cf2-94e3-336ffc7cccfa req-e00e02eb-2dc9-4500-856c-f7285ad04f0a tempest-VolumesGetTestJSON-1751989804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-581ecb29-06d3-4314-be61-e4ec57226cec" returned: 0 in 0.315s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-210011c6-37ad-4cf2-94e3-336ffc7cccfa req-e00e02eb-2dc9-4500-856c-f7285ad04f0a tempest-VolumesGetTestJSON-1751989804 None] Lock "cinder-quobyte-581ecb29-06d3-4314-be61-e4ec57226cec" released by "delete_volume" :: held 0.870s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:09:04 devstack cinder-volume[87184]: DEBUG cinder.quota [req-210011c6-37ad-4cf2-94e3-336ffc7cccfa req-e00e02eb-2dc9-4500-856c-f7285ad04f0a tempest-VolumesGetTestJSON-1751989804 None] Created reservations ['1cdff858-ab81-4b34-a04b-047070cf6655', '2ae39262-34fb-49df-b2fe-0a9c4c1e4760', 'a06d1a54-9bbd-41f2-b0a1-03f69fab2ef7', 'babe94b7-4982-4e74-ba7f-573fad091c48'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:09:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-210011c6-37ad-4cf2-94e3-336ffc7cccfa req-e00e02eb-2dc9-4500-856c-f7285ad04f0a tempest-VolumesGetTestJSON-1751989804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:09:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-210011c6-37ad-4cf2-94e3-336ffc7cccfa req-e00e02eb-2dc9-4500-856c-f7285ad04f0a tempest-VolumesGetTestJSON-1751989804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:09:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [req-210011c6-37ad-4cf2-94e3-336ffc7cccfa req-e00e02eb-2dc9-4500-856c-f7285ad04f0a tempest-VolumesGetTestJSON-1751989804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:09:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [req-210011c6-37ad-4cf2-94e3-336ffc7cccfa req-e00e02eb-2dc9-4500-856c-f7285ad04f0a tempest-VolumesGetTestJSON-1751989804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:09:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-210011c6-37ad-4cf2-94e3-336ffc7cccfa req-e00e02eb-2dc9-4500-856c-f7285ad04f0a tempest-VolumesGetTestJSON-1751989804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:09:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-210011c6-37ad-4cf2-94e3-336ffc7cccfa req-e00e02eb-2dc9-4500-856c-f7285ad04f0a tempest-VolumesGetTestJSON-1751989804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:09:04 devstack sudo[90582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:09:04 devstack sudo[90582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:04 devstack sudo[90582]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-210011c6-37ad-4cf2-94e3-336ffc7cccfa req-e00e02eb-2dc9-4500-856c-f7285ad04f0a tempest-VolumesGetTestJSON-1751989804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.392s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:04 devstack cinder-volume[87184]: DEBUG cinder.manager [req-210011c6-37ad-4cf2-94e3-336ffc7cccfa req-e00e02eb-2dc9-4500-856c-f7285ad04f0a tempest-VolumesGetTestJSON-1751989804 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:09:04 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-210011c6-37ad-4cf2-94e3-336ffc7cccfa req-e00e02eb-2dc9-4500-856c-f7285ad04f0a tempest-VolumesGetTestJSON-1751989804 None] Deleted volume successfully.
Nov 05 19:09:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-210011c6-37ad-4cf2-94e3-336ffc7cccfa req-e00e02eb-2dc9-4500-856c-f7285ad04f0a tempest-VolumesGetTestJSON-1751989804 None] Lock "cinder-581ecb29-06d3-4314-be61-e4ec57226cec-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:09:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:09:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:09:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:09:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:09:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:09:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:09:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:09:05 devstack sudo[90586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:09:05 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:05 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.466s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:05 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:09:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:09:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread count: 28 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 19:09:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread info: [<_MainThread(MainThread, started 126882883072128)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126882770872512)>, <Thread(Thread-3 (stat_writer), started daemon 126882769837376)>, <Thread(Rabbit-heartbeat, started daemon 126882768896256)>, <Thread(Thread-5 (_runner), started daemon 126882768980928)>, <Thread(Thread-7 (_runner), started daemon 126882767016448)>, <Thread(fd_logger, started daemon 126882764561216)>, <Thread(privsep_reader, started daemon 126882764568576)>, <Thread(tpool_thread_0, started daemon 126882759292608)>, <Thread(tpool_thread_1, started daemon 126882750899904)>, <Thread(tpool_thread_2, started daemon 126882742507200)>, <Thread(tpool_thread_3, started daemon 126882734114496)>, <Thread(tpool_thread_4, started daemon 126882725721792)>, <Thread(tpool_thread_5, started daemon 126882717329088)>, <Thread(tpool_thread_6, started daemon 126882708920000)>, <Thread(tpool_thread_7, started daemon 126882700510912)>, <Thread(tpool_thread_8, started daemon 126882692101824)>, <Thread(tpool_thread_9, started daemon 126882683692736)>, <Thread(tpool_thread_10, started daemon 126882675283648)>, <Thread(tpool_thread_11, started daemon 126882666874560)>, <Thread(tpool_thread_12, started daemon 126882658465472)>, <Thread(tpool_thread_13, started daemon 126882650056384)>, <Thread(tpool_thread_14, started daemon 126882641647296)>, <Thread(tpool_thread_15, started daemon 126882633238208)>, <Thread(tpool_thread_16, started daemon 126882624829120)>, <Thread(tpool_thread_17, started daemon 126882616420032)>, <Thread(tpool_thread_18, started daemon 126882608010944)>, <Thread(tpool_thread_19, started daemon 126882599601856)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 19:09:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-c1fdc1b9-c2c4-49fb-b9fc-bd7b4959155c req-7e55c20d-f61d-4f37-b251-66387889ddc3 tempest-ServerActionsTestOtherA-1201227496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:09:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-c1fdc1b9-c2c4-49fb-b9fc-bd7b4959155c req-7e55c20d-f61d-4f37-b251-66387889ddc3 tempest-ServerActionsTestOtherA-1201227496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:09:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-c1fdc1b9-c2c4-49fb-b9fc-bd7b4959155c req-7e55c20d-f61d-4f37-b251-66387889ddc3 tempest-ServerActionsTestOtherA-1201227496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:09:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-c1fdc1b9-c2c4-49fb-b9fc-bd7b4959155c req-7e55c20d-f61d-4f37-b251-66387889ddc3 tempest-ServerActionsTestOtherA-1201227496 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec', 'name': 'volume-e96d910b-0ace-4196-9a8b-5c14b5946d88', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6fdc1d96-3bc0-4ecc-883d-2022fa893a87', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 19:09:07 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-c1fdc1b9-c2c4-49fb-b9fc-bd7b4959155c req-7e55c20d-f61d-4f37-b251-66387889ddc3 tempest-ServerActionsTestOtherA-1201227496 None] attachment_update completed successfully.
Nov 05 19:09:09 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-865a953b-2261-40b6-a8ca-6c750b18fbd8 tempest-VolumesTestJSON-551565785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:09:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-865a953b-2261-40b6-a8ca-6c750b18fbd8 tempest-VolumesTestJSON-551565785 None] Flow 'volume_create_manager' (731cf314-8776-466b-a880-55d910873fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:09:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-865a953b-2261-40b6-a8ca-6c750b18fbd8 tempest-VolumesTestJSON-551565785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fafc517b-4aca-4c2a-a73b-b014f163f8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:09:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-865a953b-2261-40b6-a8ca-6c750b18fbd8 tempest-VolumesTestJSON-551565785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fafc517b-4aca-4c2a-a73b-b014f163f8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-29330770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf814c66-de6e-439a-a274-44d9168425f2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4f2570d8990344e5a1c51670a9fe7425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:09:10Z,use_quota=True,user_id='ffbed82c7d374448a71d80d07b28b608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:09:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-865a953b-2261-40b6-a8ca-6c750b18fbd8 tempest-VolumesTestJSON-551565785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd9f175e-8bc1-4ad6-b4a3-237efee7b4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:09:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-865a953b-2261-40b6-a8ca-6c750b18fbd8 tempest-VolumesTestJSON-551565785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd9f175e-8bc1-4ad6-b4a3-237efee7b4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:09:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-865a953b-2261-40b6-a8ca-6c750b18fbd8 tempest-VolumesTestJSON-551565785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08689253-2b83-4fd5-bf52-f58cd23a7d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:09:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-865a953b-2261-40b6-a8ca-6c750b18fbd8 tempest-VolumesTestJSON-551565785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08689253-2b83-4fd5-bf52-f58cd23a7d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf814c66-de6e-439a-a274-44d9168425f2', 'volume_name': 'volume-cf814c66-de6e-439a-a274-44d9168425f2', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:09:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-865a953b-2261-40b6-a8ca-6c750b18fbd8 tempest-VolumesTestJSON-551565785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80eb242d-1944-4097-9775-095d2fc2be6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:09:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-865a953b-2261-40b6-a8ca-6c750b18fbd8 tempest-VolumesTestJSON-551565785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80eb242d-1944-4097-9775-095d2fc2be6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:09:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-865a953b-2261-40b6-a8ca-6c750b18fbd8 tempest-VolumesTestJSON-551565785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24fdbf4b-996e-4284-bca6-92cf1764220c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:09:09 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-865a953b-2261-40b6-a8ca-6c750b18fbd8 tempest-VolumesTestJSON-551565785 None] Volume cf814c66-de6e-439a-a274-44d9168425f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf814c66-de6e-439a-a274-44d9168425f2', 'volume_size': 1}
Nov 05 19:09:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-865a953b-2261-40b6-a8ca-6c750b18fbd8 tempest-VolumesTestJSON-551565785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:09:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-865a953b-2261-40b6-a8ca-6c750b18fbd8 tempest-VolumesTestJSON-551565785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:09:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-865a953b-2261-40b6-a8ca-6c750b18fbd8 tempest-VolumesTestJSON-551565785 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-29330770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf814c66-de6e-439a-a274-44d9168425f2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4f2570d8990344e5a1c51670a9fe7425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:09:10Z,use_quota=True,user_id='ffbed82c7d374448a71d80d07b28b608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:09:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-865a953b-2261-40b6-a8ca-6c750b18fbd8 tempest-VolumesTestJSON-551565785 None] Creating volume cf814c66-de6e-439a-a274-44d9168425f2 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:09:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-865a953b-2261-40b6-a8ca-6c750b18fbd8 tempest-VolumesTestJSON-551565785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:09:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-865a953b-2261-40b6-a8ca-6c750b18fbd8 tempest-VolumesTestJSON-551565785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:09:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-865a953b-2261-40b6-a8ca-6c750b18fbd8 tempest-VolumesTestJSON-551565785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:09:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-865a953b-2261-40b6-a8ca-6c750b18fbd8 tempest-VolumesTestJSON-551565785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:09:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-865a953b-2261-40b6-a8ca-6c750b18fbd8 tempest-VolumesTestJSON-551565785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:09:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-865a953b-2261-40b6-a8ca-6c750b18fbd8 tempest-VolumesTestJSON-551565785 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:09:09 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-865a953b-2261-40b6-a8ca-6c750b18fbd8 tempest-VolumesTestJSON-551565785 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:09:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-865a953b-2261-40b6-a8ca-6c750b18fbd8 tempest-VolumesTestJSON-551565785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cf814c66-de6e-439a-a274-44d9168425f2 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:09:09 devstack sudo[90623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cf814c66-de6e-439a-a274-44d9168425f2 1073741824
Nov 05 19:09:09 devstack sudo[90623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:10 devstack sudo[90623]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-865a953b-2261-40b6-a8ca-6c750b18fbd8 tempest-VolumesTestJSON-551565785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cf814c66-de6e-439a-a274-44d9168425f2 1073741824" returned: 0 in 0.584s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-865a953b-2261-40b6-a8ca-6c750b18fbd8 tempest-VolumesTestJSON-551565785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cf814c66-de6e-439a-a274-44d9168425f2 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:09:10 devstack sudo[90729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cf814c66-de6e-439a-a274-44d9168425f2
Nov 05 19:09:10 devstack sudo[90729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:11 devstack sudo[90729]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-865a953b-2261-40b6-a8ca-6c750b18fbd8 tempest-VolumesTestJSON-551565785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cf814c66-de6e-439a-a274-44d9168425f2" returned: 0 in 0.571s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-865a953b-2261-40b6-a8ca-6c750b18fbd8 tempest-VolumesTestJSON-551565785 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:09:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-865a953b-2261-40b6-a8ca-6c750b18fbd8 tempest-VolumesTestJSON-551565785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:09:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-865a953b-2261-40b6-a8ca-6c750b18fbd8 tempest-VolumesTestJSON-551565785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24fdbf4b-996e-4284-bca6-92cf1764220c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf814c66-de6e-439a-a274-44d9168425f2', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:09:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-865a953b-2261-40b6-a8ca-6c750b18fbd8 tempest-VolumesTestJSON-551565785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc0578e5-9036-49d7-9a58-174b3f0801b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:09:11 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-865a953b-2261-40b6-a8ca-6c750b18fbd8 tempest-VolumesTestJSON-551565785 None] Volume volume-cf814c66-de6e-439a-a274-44d9168425f2 (cf814c66-de6e-439a-a274-44d9168425f2): created successfully
Nov 05 19:09:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-865a953b-2261-40b6-a8ca-6c750b18fbd8 tempest-VolumesTestJSON-551565785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc0578e5-9036-49d7-9a58-174b3f0801b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:09:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-865a953b-2261-40b6-a8ca-6c750b18fbd8 tempest-VolumesTestJSON-551565785 None] Flow 'volume_create_manager' (731cf314-8776-466b-a880-55d910873fb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:09:11 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-865a953b-2261-40b6-a8ca-6c750b18fbd8 tempest-VolumesTestJSON-551565785 None] Created volume successfully.
Nov 05 19:09:13 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-df9d8818-6d70-47ce-872d-bdf169d93316 tempest-VolumesTestJSON-551565785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:09:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-df9d8818-6d70-47ce-872d-bdf169d93316 tempest-VolumesTestJSON-551565785 None] Flow 'volume_create_manager' (a7cd43f4-d521-4105-8f2e-14122373b040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:09:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-df9d8818-6d70-47ce-872d-bdf169d93316 tempest-VolumesTestJSON-551565785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c12cddd2-b6d0-4aa6-8348-66cd67ffa8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:09:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-df9d8818-6d70-47ce-872d-bdf169d93316 tempest-VolumesTestJSON-551565785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c12cddd2-b6d0-4aa6-8348-66cd67ffa8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1783973595',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5966d436-c52b-4eb0-b141-e35d0511a9c0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4f2570d8990344e5a1c51670a9fe7425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:09:13Z,use_quota=True,user_id='ffbed82c7d374448a71d80d07b28b608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:09:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-df9d8818-6d70-47ce-872d-bdf169d93316 tempest-VolumesTestJSON-551565785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4c90584-4a28-47f5-a5d8-b4aee48bf787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:09:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-df9d8818-6d70-47ce-872d-bdf169d93316 tempest-VolumesTestJSON-551565785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4c90584-4a28-47f5-a5d8-b4aee48bf787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:09:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-df9d8818-6d70-47ce-872d-bdf169d93316 tempest-VolumesTestJSON-551565785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e89574-1055-41a7-a238-0da2ba68fd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:09:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-df9d8818-6d70-47ce-872d-bdf169d93316 tempest-VolumesTestJSON-551565785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e89574-1055-41a7-a238-0da2ba68fd5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5966d436-c52b-4eb0-b141-e35d0511a9c0', 'volume_name': 'volume-5966d436-c52b-4eb0-b141-e35d0511a9c0', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:09:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-df9d8818-6d70-47ce-872d-bdf169d93316 tempest-VolumesTestJSON-551565785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30109689-d6c9-4d61-8656-c137511c5ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:09:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-df9d8818-6d70-47ce-872d-bdf169d93316 tempest-VolumesTestJSON-551565785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30109689-d6c9-4d61-8656-c137511c5ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:09:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-df9d8818-6d70-47ce-872d-bdf169d93316 tempest-VolumesTestJSON-551565785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (467a269e-5bfd-4d46-842e-3d8111811139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:09:13 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-df9d8818-6d70-47ce-872d-bdf169d93316 tempest-VolumesTestJSON-551565785 None] Volume 5966d436-c52b-4eb0-b141-e35d0511a9c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5966d436-c52b-4eb0-b141-e35d0511a9c0', 'volume_size': 1}
Nov 05 19:09:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-df9d8818-6d70-47ce-872d-bdf169d93316 tempest-VolumesTestJSON-551565785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:09:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-df9d8818-6d70-47ce-872d-bdf169d93316 tempest-VolumesTestJSON-551565785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:09:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-df9d8818-6d70-47ce-872d-bdf169d93316 tempest-VolumesTestJSON-551565785 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1783973595',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5966d436-c52b-4eb0-b141-e35d0511a9c0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4f2570d8990344e5a1c51670a9fe7425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:09:13Z,use_quota=True,user_id='ffbed82c7d374448a71d80d07b28b608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:09:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-df9d8818-6d70-47ce-872d-bdf169d93316 tempest-VolumesTestJSON-551565785 None] Creating volume 5966d436-c52b-4eb0-b141-e35d0511a9c0 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:09:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-df9d8818-6d70-47ce-872d-bdf169d93316 tempest-VolumesTestJSON-551565785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:09:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-df9d8818-6d70-47ce-872d-bdf169d93316 tempest-VolumesTestJSON-551565785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:09:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-df9d8818-6d70-47ce-872d-bdf169d93316 tempest-VolumesTestJSON-551565785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:09:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-df9d8818-6d70-47ce-872d-bdf169d93316 tempest-VolumesTestJSON-551565785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:09:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-df9d8818-6d70-47ce-872d-bdf169d93316 tempest-VolumesTestJSON-551565785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:09:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-df9d8818-6d70-47ce-872d-bdf169d93316 tempest-VolumesTestJSON-551565785 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:09:13 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-df9d8818-6d70-47ce-872d-bdf169d93316 tempest-VolumesTestJSON-551565785 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:09:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-df9d8818-6d70-47ce-872d-bdf169d93316 tempest-VolumesTestJSON-551565785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5966d436-c52b-4eb0-b141-e35d0511a9c0 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:09:13 devstack sudo[91091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5966d436-c52b-4eb0-b141-e35d0511a9c0 1073741824
Nov 05 19:09:13 devstack sudo[91091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:14 devstack sudo[91091]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-df9d8818-6d70-47ce-872d-bdf169d93316 tempest-VolumesTestJSON-551565785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5966d436-c52b-4eb0-b141-e35d0511a9c0 1073741824" returned: 0 in 0.562s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-df9d8818-6d70-47ce-872d-bdf169d93316 tempest-VolumesTestJSON-551565785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5966d436-c52b-4eb0-b141-e35d0511a9c0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:09:14 devstack sudo[91097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5966d436-c52b-4eb0-b141-e35d0511a9c0
Nov 05 19:09:14 devstack sudo[91097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:14 devstack sudo[91097]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-df9d8818-6d70-47ce-872d-bdf169d93316 tempest-VolumesTestJSON-551565785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5966d436-c52b-4eb0-b141-e35d0511a9c0" returned: 0 in 0.272s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-df9d8818-6d70-47ce-872d-bdf169d93316 tempest-VolumesTestJSON-551565785 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:09:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-df9d8818-6d70-47ce-872d-bdf169d93316 tempest-VolumesTestJSON-551565785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:09:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-df9d8818-6d70-47ce-872d-bdf169d93316 tempest-VolumesTestJSON-551565785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (467a269e-5bfd-4d46-842e-3d8111811139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5966d436-c52b-4eb0-b141-e35d0511a9c0', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:09:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-df9d8818-6d70-47ce-872d-bdf169d93316 tempest-VolumesTestJSON-551565785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8abe0efb-a046-4d1a-917a-f388f9a4db60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:09:14 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-df9d8818-6d70-47ce-872d-bdf169d93316 tempest-VolumesTestJSON-551565785 None] Volume volume-5966d436-c52b-4eb0-b141-e35d0511a9c0 (5966d436-c52b-4eb0-b141-e35d0511a9c0): created successfully
Nov 05 19:09:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-df9d8818-6d70-47ce-872d-bdf169d93316 tempest-VolumesTestJSON-551565785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8abe0efb-a046-4d1a-917a-f388f9a4db60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:09:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-df9d8818-6d70-47ce-872d-bdf169d93316 tempest-VolumesTestJSON-551565785 None] Flow 'volume_create_manager' (a7cd43f4-d521-4105-8f2e-14122373b040) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:09:14 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-df9d8818-6d70-47ce-872d-bdf169d93316 tempest-VolumesTestJSON-551565785 None] Created volume successfully.
Nov 05 19:09:16 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-de5821c2-07b0-4bd5-90b7-790279b1aa18 tempest-VolumesTestJSON-551565785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:09:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-de5821c2-07b0-4bd5-90b7-790279b1aa18 tempest-VolumesTestJSON-551565785 None] Flow 'volume_create_manager' (ed6671da-9207-455a-940a-6b9c44594f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:09:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-de5821c2-07b0-4bd5-90b7-790279b1aa18 tempest-VolumesTestJSON-551565785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c699588-af22-4fb2-97c9-6410a5b372cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:09:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-de5821c2-07b0-4bd5-90b7-790279b1aa18 tempest-VolumesTestJSON-551565785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c699588-af22-4fb2-97c9-6410a5b372cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-378665907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5904a6c3-dba4-4655-8b85-214fee9d5755,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4f2570d8990344e5a1c51670a9fe7425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:09:16Z,use_quota=True,user_id='ffbed82c7d374448a71d80d07b28b608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:09:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-de5821c2-07b0-4bd5-90b7-790279b1aa18 tempest-VolumesTestJSON-551565785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24bdd7a0-5a3c-44ed-96e2-45418715c1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:09:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-de5821c2-07b0-4bd5-90b7-790279b1aa18 tempest-VolumesTestJSON-551565785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24bdd7a0-5a3c-44ed-96e2-45418715c1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:09:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-de5821c2-07b0-4bd5-90b7-790279b1aa18 tempest-VolumesTestJSON-551565785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1442e56-c7c6-4fb3-acbc-73620eb4aff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:09:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-de5821c2-07b0-4bd5-90b7-790279b1aa18 tempest-VolumesTestJSON-551565785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1442e56-c7c6-4fb3-acbc-73620eb4aff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5904a6c3-dba4-4655-8b85-214fee9d5755', 'volume_name': 'volume-5904a6c3-dba4-4655-8b85-214fee9d5755', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:09:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-de5821c2-07b0-4bd5-90b7-790279b1aa18 tempest-VolumesTestJSON-551565785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (894c8458-a86f-4517-8f76-229e365bf70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:09:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-de5821c2-07b0-4bd5-90b7-790279b1aa18 tempest-VolumesTestJSON-551565785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (894c8458-a86f-4517-8f76-229e365bf70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:09:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-de5821c2-07b0-4bd5-90b7-790279b1aa18 tempest-VolumesTestJSON-551565785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6ca789d-8ec0-4a34-8ce4-1246bd336b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:09:16 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-de5821c2-07b0-4bd5-90b7-790279b1aa18 tempest-VolumesTestJSON-551565785 None] Volume 5904a6c3-dba4-4655-8b85-214fee9d5755: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5904a6c3-dba4-4655-8b85-214fee9d5755', 'volume_size': 1}
Nov 05 19:09:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-de5821c2-07b0-4bd5-90b7-790279b1aa18 tempest-VolumesTestJSON-551565785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:09:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-de5821c2-07b0-4bd5-90b7-790279b1aa18 tempest-VolumesTestJSON-551565785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:09:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-de5821c2-07b0-4bd5-90b7-790279b1aa18 tempest-VolumesTestJSON-551565785 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-378665907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5904a6c3-dba4-4655-8b85-214fee9d5755,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4f2570d8990344e5a1c51670a9fe7425',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:09:16Z,use_quota=True,user_id='ffbed82c7d374448a71d80d07b28b608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:09:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-de5821c2-07b0-4bd5-90b7-790279b1aa18 tempest-VolumesTestJSON-551565785 None] Creating volume 5904a6c3-dba4-4655-8b85-214fee9d5755 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:09:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-de5821c2-07b0-4bd5-90b7-790279b1aa18 tempest-VolumesTestJSON-551565785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:09:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-de5821c2-07b0-4bd5-90b7-790279b1aa18 tempest-VolumesTestJSON-551565785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:09:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-de5821c2-07b0-4bd5-90b7-790279b1aa18 tempest-VolumesTestJSON-551565785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:09:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-de5821c2-07b0-4bd5-90b7-790279b1aa18 tempest-VolumesTestJSON-551565785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:09:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-de5821c2-07b0-4bd5-90b7-790279b1aa18 tempest-VolumesTestJSON-551565785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:09:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-de5821c2-07b0-4bd5-90b7-790279b1aa18 tempest-VolumesTestJSON-551565785 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:09:16 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-de5821c2-07b0-4bd5-90b7-790279b1aa18 tempest-VolumesTestJSON-551565785 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:09:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-de5821c2-07b0-4bd5-90b7-790279b1aa18 tempest-VolumesTestJSON-551565785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5904a6c3-dba4-4655-8b85-214fee9d5755 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:09:16 devstack sudo[91102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5904a6c3-dba4-4655-8b85-214fee9d5755 1073741824
Nov 05 19:09:16 devstack sudo[91102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:17 devstack sudo[91102]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-de5821c2-07b0-4bd5-90b7-790279b1aa18 tempest-VolumesTestJSON-551565785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5904a6c3-dba4-4655-8b85-214fee9d5755 1073741824" returned: 0 in 0.552s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-de5821c2-07b0-4bd5-90b7-790279b1aa18 tempest-VolumesTestJSON-551565785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5904a6c3-dba4-4655-8b85-214fee9d5755 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:09:17 devstack sudo[91111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5904a6c3-dba4-4655-8b85-214fee9d5755
Nov 05 19:09:17 devstack sudo[91111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:17 devstack sudo[91111]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-de5821c2-07b0-4bd5-90b7-790279b1aa18 tempest-VolumesTestJSON-551565785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5904a6c3-dba4-4655-8b85-214fee9d5755" returned: 0 in 0.559s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-de5821c2-07b0-4bd5-90b7-790279b1aa18 tempest-VolumesTestJSON-551565785 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:09:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-de5821c2-07b0-4bd5-90b7-790279b1aa18 tempest-VolumesTestJSON-551565785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:09:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-de5821c2-07b0-4bd5-90b7-790279b1aa18 tempest-VolumesTestJSON-551565785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6ca789d-8ec0-4a34-8ce4-1246bd336b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5904a6c3-dba4-4655-8b85-214fee9d5755', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:09:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-de5821c2-07b0-4bd5-90b7-790279b1aa18 tempest-VolumesTestJSON-551565785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18f07954-a73c-4b2b-9f33-4f419bbc4154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:09:17 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-de5821c2-07b0-4bd5-90b7-790279b1aa18 tempest-VolumesTestJSON-551565785 None] Volume volume-5904a6c3-dba4-4655-8b85-214fee9d5755 (5904a6c3-dba4-4655-8b85-214fee9d5755): created successfully
Nov 05 19:09:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-de5821c2-07b0-4bd5-90b7-790279b1aa18 tempest-VolumesTestJSON-551565785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18f07954-a73c-4b2b-9f33-4f419bbc4154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:09:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-de5821c2-07b0-4bd5-90b7-790279b1aa18 tempest-VolumesTestJSON-551565785 None] Flow 'volume_create_manager' (ed6671da-9207-455a-940a-6b9c44594f8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:09:17 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-de5821c2-07b0-4bd5-90b7-790279b1aa18 tempest-VolumesTestJSON-551565785 None] Created volume successfully.
Nov 05 19:09:18 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc0ab0a3-2027-40ee-b6f3-d7dba2062431 tempest-AttachVolumeTestJSON-109518034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:09:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bc0ab0a3-2027-40ee-b6f3-d7dba2062431 tempest-AttachVolumeTestJSON-109518034 None] Flow 'volume_create_manager' (785801aa-7548-453e-aa01-b397280131b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:09:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bc0ab0a3-2027-40ee-b6f3-d7dba2062431 tempest-AttachVolumeTestJSON-109518034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1363ff19-8478-477c-8046-04153aef3b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:09:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bc0ab0a3-2027-40ee-b6f3-d7dba2062431 tempest-AttachVolumeTestJSON-109518034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1363ff19-8478-477c-8046-04153aef3b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-737430746',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=988c0e11-3915-4a98-833f-6982adb369b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434a766411ee4ae2aee44844b8ec847a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:09:19Z,use_quota=True,user_id='0dde3533ca474d829a228c17aa692e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:09:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bc0ab0a3-2027-40ee-b6f3-d7dba2062431 tempest-AttachVolumeTestJSON-109518034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c85c76d5-4fcb-43f1-9151-08b32b4c4f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:09:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bc0ab0a3-2027-40ee-b6f3-d7dba2062431 tempest-AttachVolumeTestJSON-109518034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c85c76d5-4fcb-43f1-9151-08b32b4c4f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:09:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bc0ab0a3-2027-40ee-b6f3-d7dba2062431 tempest-AttachVolumeTestJSON-109518034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9594e674-3bd3-4bb8-a6e4-8523aa9fdcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:09:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bc0ab0a3-2027-40ee-b6f3-d7dba2062431 tempest-AttachVolumeTestJSON-109518034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9594e674-3bd3-4bb8-a6e4-8523aa9fdcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '988c0e11-3915-4a98-833f-6982adb369b8', 'volume_name': 'volume-988c0e11-3915-4a98-833f-6982adb369b8', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:09:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bc0ab0a3-2027-40ee-b6f3-d7dba2062431 tempest-AttachVolumeTestJSON-109518034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43486fd3-0aa3-43ec-bc8b-a6d536295658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:09:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bc0ab0a3-2027-40ee-b6f3-d7dba2062431 tempest-AttachVolumeTestJSON-109518034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43486fd3-0aa3-43ec-bc8b-a6d536295658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:09:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bc0ab0a3-2027-40ee-b6f3-d7dba2062431 tempest-AttachVolumeTestJSON-109518034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3e67810-00e3-4c68-922f-6ef48c86cdb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:09:18 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-bc0ab0a3-2027-40ee-b6f3-d7dba2062431 tempest-AttachVolumeTestJSON-109518034 None] Volume 988c0e11-3915-4a98-833f-6982adb369b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-988c0e11-3915-4a98-833f-6982adb369b8', 'volume_size': 1}
Nov 05 19:09:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bc0ab0a3-2027-40ee-b6f3-d7dba2062431 tempest-AttachVolumeTestJSON-109518034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:09:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bc0ab0a3-2027-40ee-b6f3-d7dba2062431 tempest-AttachVolumeTestJSON-109518034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:09:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bc0ab0a3-2027-40ee-b6f3-d7dba2062431 tempest-AttachVolumeTestJSON-109518034 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-737430746',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=988c0e11-3915-4a98-833f-6982adb369b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434a766411ee4ae2aee44844b8ec847a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:09:19Z,use_quota=True,user_id='0dde3533ca474d829a228c17aa692e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:09:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-bc0ab0a3-2027-40ee-b6f3-d7dba2062431 tempest-AttachVolumeTestJSON-109518034 None] Creating volume 988c0e11-3915-4a98-833f-6982adb369b8 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:09:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bc0ab0a3-2027-40ee-b6f3-d7dba2062431 tempest-AttachVolumeTestJSON-109518034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:09:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bc0ab0a3-2027-40ee-b6f3-d7dba2062431 tempest-AttachVolumeTestJSON-109518034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:09:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bc0ab0a3-2027-40ee-b6f3-d7dba2062431 tempest-AttachVolumeTestJSON-109518034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:09:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bc0ab0a3-2027-40ee-b6f3-d7dba2062431 tempest-AttachVolumeTestJSON-109518034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:09:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bc0ab0a3-2027-40ee-b6f3-d7dba2062431 tempest-AttachVolumeTestJSON-109518034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:09:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bc0ab0a3-2027-40ee-b6f3-d7dba2062431 tempest-AttachVolumeTestJSON-109518034 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:09:18 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-bc0ab0a3-2027-40ee-b6f3-d7dba2062431 tempest-AttachVolumeTestJSON-109518034 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:09:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bc0ab0a3-2027-40ee-b6f3-d7dba2062431 tempest-AttachVolumeTestJSON-109518034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-988c0e11-3915-4a98-833f-6982adb369b8 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:09:19 devstack sudo[91122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-988c0e11-3915-4a98-833f-6982adb369b8 1073741824
Nov 05 19:09:19 devstack sudo[91122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:20 devstack sudo[91122]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bc0ab0a3-2027-40ee-b6f3-d7dba2062431 tempest-AttachVolumeTestJSON-109518034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-988c0e11-3915-4a98-833f-6982adb369b8 1073741824" returned: 0 in 1.100s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bc0ab0a3-2027-40ee-b6f3-d7dba2062431 tempest-AttachVolumeTestJSON-109518034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-988c0e11-3915-4a98-833f-6982adb369b8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:09:20 devstack sudo[91129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-988c0e11-3915-4a98-833f-6982adb369b8
Nov 05 19:09:20 devstack sudo[91129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:20 devstack sudo[91129]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bc0ab0a3-2027-40ee-b6f3-d7dba2062431 tempest-AttachVolumeTestJSON-109518034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-988c0e11-3915-4a98-833f-6982adb369b8" returned: 0 in 0.387s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bc0ab0a3-2027-40ee-b6f3-d7dba2062431 tempest-AttachVolumeTestJSON-109518034 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:09:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bc0ab0a3-2027-40ee-b6f3-d7dba2062431 tempest-AttachVolumeTestJSON-109518034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:09:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bc0ab0a3-2027-40ee-b6f3-d7dba2062431 tempest-AttachVolumeTestJSON-109518034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3e67810-00e3-4c68-922f-6ef48c86cdb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-988c0e11-3915-4a98-833f-6982adb369b8', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:09:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bc0ab0a3-2027-40ee-b6f3-d7dba2062431 tempest-AttachVolumeTestJSON-109518034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15e2a6e2-2fc4-492f-8b0f-348dcb438e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:09:20 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-bc0ab0a3-2027-40ee-b6f3-d7dba2062431 tempest-AttachVolumeTestJSON-109518034 None] Volume volume-988c0e11-3915-4a98-833f-6982adb369b8 (988c0e11-3915-4a98-833f-6982adb369b8): created successfully
Nov 05 19:09:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bc0ab0a3-2027-40ee-b6f3-d7dba2062431 tempest-AttachVolumeTestJSON-109518034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15e2a6e2-2fc4-492f-8b0f-348dcb438e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:09:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bc0ab0a3-2027-40ee-b6f3-d7dba2062431 tempest-AttachVolumeTestJSON-109518034 None] Flow 'volume_create_manager' (785801aa-7548-453e-aa01-b397280131b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:09:20 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-bc0ab0a3-2027-40ee-b6f3-d7dba2062431 tempest-AttachVolumeTestJSON-109518034 None] Created volume successfully.
Nov 05 19:09:20 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5aa9b455-ed20-49d6-ad60-799b0a207708 tempest-VolumesTestJSON-551565785 None] Acquiring lock "cinder-5904a6c3-dba4-4655-8b85-214fee9d5755-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:09:20 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5aa9b455-ed20-49d6-ad60-799b0a207708 tempest-VolumesTestJSON-551565785 None] Lock "cinder-5904a6c3-dba4-4655-8b85-214fee9d5755-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:09:20 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5aa9b455-ed20-49d6-ad60-799b0a207708 tempest-VolumesTestJSON-551565785 None] Acquiring lock "cinder-quobyte-5904a6c3-dba4-4655-8b85-214fee9d5755" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:09:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5aa9b455-ed20-49d6-ad60-799b0a207708 tempest-VolumesTestJSON-551565785 None] Lock "cinder-quobyte-5904a6c3-dba4-4655-8b85-214fee9d5755" acquired by "delete_volume" :: waited 0.026s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:09:21 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e681bb-dd28-41f9-8408-1f4d2a844eae]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:09:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5aa9b455-ed20-49d6-ad60-799b0a207708 tempest-VolumesTestJSON-551565785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5904a6c3-dba4-4655-8b85-214fee9d5755 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:09:21 devstack sudo[91136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5904a6c3-dba4-4655-8b85-214fee9d5755
Nov 05 19:09:21 devstack sudo[91136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:22 devstack sudo[91136]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5aa9b455-ed20-49d6-ad60-799b0a207708 tempest-VolumesTestJSON-551565785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5904a6c3-dba4-4655-8b85-214fee9d5755" returned: 0 in 1.117s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5aa9b455-ed20-49d6-ad60-799b0a207708 tempest-VolumesTestJSON-551565785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5904a6c3-dba4-4655-8b85-214fee9d5755 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:09:22 devstack sudo[91148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5904a6c3-dba4-4655-8b85-214fee9d5755
Nov 05 19:09:22 devstack sudo[91148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:22 devstack sudo[91148]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5aa9b455-ed20-49d6-ad60-799b0a207708 tempest-VolumesTestJSON-551565785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5904a6c3-dba4-4655-8b85-214fee9d5755" returned: 0 in 0.445s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:22 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5aa9b455-ed20-49d6-ad60-799b0a207708 tempest-VolumesTestJSON-551565785 None] Lock "cinder-quobyte-5904a6c3-dba4-4655-8b85-214fee9d5755" released by "delete_volume" :: held 1.665s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:09:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-d9b9a85a-672f-440e-9c41-5f8cd5c3ef05 req-0d1bde7f-e4f4-4fc6-be4e-e553ba3eb25a tempest-AttachVolumeTestJSON-109518034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:09:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-d9b9a85a-672f-440e-9c41-5f8cd5c3ef05 req-0d1bde7f-e4f4-4fc6-be4e-e553ba3eb25a tempest-AttachVolumeTestJSON-109518034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:09:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-d9b9a85a-672f-440e-9c41-5f8cd5c3ef05 req-0d1bde7f-e4f4-4fc6-be4e-e553ba3eb25a tempest-AttachVolumeTestJSON-109518034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:09:22 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-5aa9b455-ed20-49d6-ad60-799b0a207708 tempest-VolumesTestJSON-551565785 None] Created reservations ['c44a64f3-cd63-4cf6-ac0e-d53f2944512d', '34717dc5-efb1-4b76-9436-dad21988146f', '39bc77fd-d7cf-453d-a271-f54d7734db2f', '09a17134-4896-44bb-82a3-43f09f83613e'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:09:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-d9b9a85a-672f-440e-9c41-5f8cd5c3ef05 req-0d1bde7f-e4f4-4fc6-be4e-e553ba3eb25a tempest-AttachVolumeTestJSON-109518034 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec', 'name': 'volume-988c0e11-3915-4a98-833f-6982adb369b8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '30b0bebb-4f12-4a24-8ed2-471766d3afee', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 19:09:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5aa9b455-ed20-49d6-ad60-799b0a207708 tempest-VolumesTestJSON-551565785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:09:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5aa9b455-ed20-49d6-ad60-799b0a207708 tempest-VolumesTestJSON-551565785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:09:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5aa9b455-ed20-49d6-ad60-799b0a207708 tempest-VolumesTestJSON-551565785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:09:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5aa9b455-ed20-49d6-ad60-799b0a207708 tempest-VolumesTestJSON-551565785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:09:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5aa9b455-ed20-49d6-ad60-799b0a207708 tempest-VolumesTestJSON-551565785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:09:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5aa9b455-ed20-49d6-ad60-799b0a207708 tempest-VolumesTestJSON-551565785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:09:23 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-d9b9a85a-672f-440e-9c41-5f8cd5c3ef05 req-0d1bde7f-e4f4-4fc6-be4e-e553ba3eb25a tempest-AttachVolumeTestJSON-109518034 None] attachment_update completed successfully.
Nov 05 19:09:23 devstack sudo[91156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:09:23 devstack sudo[91156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:23 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-42c8eb64-67c8-4864-acc6-370387ebbcd3 tempest-VolumesTestJSON-551565785 None] Acquiring lock "cinder-5966d436-c52b-4eb0-b141-e35d0511a9c0-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:09:23 devstack sudo[91156]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5aa9b455-ed20-49d6-ad60-799b0a207708 tempest-VolumesTestJSON-551565785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.536s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:23 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-5aa9b455-ed20-49d6-ad60-799b0a207708 tempest-VolumesTestJSON-551565785 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:09:23 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-42c8eb64-67c8-4864-acc6-370387ebbcd3 tempest-VolumesTestJSON-551565785 None] Lock "cinder-5966d436-c52b-4eb0-b141-e35d0511a9c0-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:09:23 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-5aa9b455-ed20-49d6-ad60-799b0a207708 tempest-VolumesTestJSON-551565785 None] Deleted volume successfully.
Nov 05 19:09:23 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5aa9b455-ed20-49d6-ad60-799b0a207708 tempest-VolumesTestJSON-551565785 None] Lock "cinder-5904a6c3-dba4-4655-8b85-214fee9d5755-delete_volume" released by "delete_volume" :: held 2.698s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:09:23 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-42c8eb64-67c8-4864-acc6-370387ebbcd3 tempest-VolumesTestJSON-551565785 None] Acquiring lock "cinder-quobyte-5966d436-c52b-4eb0-b141-e35d0511a9c0" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:09:23 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-42c8eb64-67c8-4864-acc6-370387ebbcd3 tempest-VolumesTestJSON-551565785 None] Lock "cinder-quobyte-5966d436-c52b-4eb0-b141-e35d0511a9c0" acquired by "delete_volume" :: waited 0.048s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:09:23 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97e5510-2fee-4279-9da5-027a943f5a74]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:09:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-42c8eb64-67c8-4864-acc6-370387ebbcd3 tempest-VolumesTestJSON-551565785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5966d436-c52b-4eb0-b141-e35d0511a9c0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:09:24 devstack sudo[91161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5966d436-c52b-4eb0-b141-e35d0511a9c0
Nov 05 19:09:24 devstack sudo[91161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-42c8eb64-67c8-4864-acc6-370387ebbcd3 tempest-VolumesTestJSON-551565785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5966d436-c52b-4eb0-b141-e35d0511a9c0" returned: 0 in 0.674s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-42c8eb64-67c8-4864-acc6-370387ebbcd3 tempest-VolumesTestJSON-551565785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5966d436-c52b-4eb0-b141-e35d0511a9c0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:09:24 devstack sudo[91161]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:24 devstack sudo[91168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5966d436-c52b-4eb0-b141-e35d0511a9c0
Nov 05 19:09:24 devstack sudo[91168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:25 devstack sudo[91168]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-42c8eb64-67c8-4864-acc6-370387ebbcd3 tempest-VolumesTestJSON-551565785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5966d436-c52b-4eb0-b141-e35d0511a9c0" returned: 0 in 0.722s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:25 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-42c8eb64-67c8-4864-acc6-370387ebbcd3 tempest-VolumesTestJSON-551565785 None] Lock "cinder-quobyte-5966d436-c52b-4eb0-b141-e35d0511a9c0" released by "delete_volume" :: held 1.494s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:09:25 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-42c8eb64-67c8-4864-acc6-370387ebbcd3 tempest-VolumesTestJSON-551565785 None] Created reservations ['90a7ed4b-c0f5-47d6-8cfc-1657102be653', 'c6a2d7cc-bbff-41ef-b417-a839a86baaa8', '3df3dc11-a60a-4aca-bbe0-8b7f082cedcf', '67d3df2a-b562-4e0f-a465-844e5b6ed039'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:09:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-42c8eb64-67c8-4864-acc6-370387ebbcd3 tempest-VolumesTestJSON-551565785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:09:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-42c8eb64-67c8-4864-acc6-370387ebbcd3 tempest-VolumesTestJSON-551565785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:09:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-42c8eb64-67c8-4864-acc6-370387ebbcd3 tempest-VolumesTestJSON-551565785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:09:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-42c8eb64-67c8-4864-acc6-370387ebbcd3 tempest-VolumesTestJSON-551565785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:09:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-42c8eb64-67c8-4864-acc6-370387ebbcd3 tempest-VolumesTestJSON-551565785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:09:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-42c8eb64-67c8-4864-acc6-370387ebbcd3 tempest-VolumesTestJSON-551565785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:09:25 devstack sudo[91178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:09:25 devstack sudo[91178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:25 devstack sudo[91178]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-42c8eb64-67c8-4864-acc6-370387ebbcd3 tempest-VolumesTestJSON-551565785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.490s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:25 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-42c8eb64-67c8-4864-acc6-370387ebbcd3 tempest-VolumesTestJSON-551565785 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:09:25 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-42c8eb64-67c8-4864-acc6-370387ebbcd3 tempest-VolumesTestJSON-551565785 None] Deleted volume successfully.
Nov 05 19:09:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-42c8eb64-67c8-4864-acc6-370387ebbcd3 tempest-VolumesTestJSON-551565785 None] Lock "cinder-5966d436-c52b-4eb0-b141-e35d0511a9c0-delete_volume" released by "delete_volume" :: held 2.483s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:09:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-66a88cc0-a2d8-4a67-a9ba-b78f7fe9bfa4 tempest-VolumesTestJSON-551565785 None] Acquiring lock "cinder-cf814c66-de6e-439a-a274-44d9168425f2-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:09:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-66a88cc0-a2d8-4a67-a9ba-b78f7fe9bfa4 tempest-VolumesTestJSON-551565785 None] Lock "cinder-cf814c66-de6e-439a-a274-44d9168425f2-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:09:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-66a88cc0-a2d8-4a67-a9ba-b78f7fe9bfa4 tempest-VolumesTestJSON-551565785 None] Acquiring lock "cinder-quobyte-cf814c66-de6e-439a-a274-44d9168425f2" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:09:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-66a88cc0-a2d8-4a67-a9ba-b78f7fe9bfa4 tempest-VolumesTestJSON-551565785 None] Lock "cinder-quobyte-cf814c66-de6e-439a-a274-44d9168425f2" acquired by "delete_volume" :: waited 0.040s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:09:26 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3d9c67-9a6d-40dd-92de-5311bca4f286]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:09:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-66a88cc0-a2d8-4a67-a9ba-b78f7fe9bfa4 tempest-VolumesTestJSON-551565785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cf814c66-de6e-439a-a274-44d9168425f2 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:09:26 devstack sudo[91182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cf814c66-de6e-439a-a274-44d9168425f2
Nov 05 19:09:26 devstack sudo[91182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:26 devstack sudo[91182]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-66a88cc0-a2d8-4a67-a9ba-b78f7fe9bfa4 tempest-VolumesTestJSON-551565785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cf814c66-de6e-439a-a274-44d9168425f2" returned: 0 in 0.582s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-66a88cc0-a2d8-4a67-a9ba-b78f7fe9bfa4 tempest-VolumesTestJSON-551565785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cf814c66-de6e-439a-a274-44d9168425f2 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:09:26 devstack sudo[91188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cf814c66-de6e-439a-a274-44d9168425f2
Nov 05 19:09:26 devstack sudo[91188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:27 devstack sudo[91188]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-66a88cc0-a2d8-4a67-a9ba-b78f7fe9bfa4 tempest-VolumesTestJSON-551565785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cf814c66-de6e-439a-a274-44d9168425f2" returned: 0 in 0.566s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-66a88cc0-a2d8-4a67-a9ba-b78f7fe9bfa4 tempest-VolumesTestJSON-551565785 None] Lock "cinder-quobyte-cf814c66-de6e-439a-a274-44d9168425f2" released by "delete_volume" :: held 1.231s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:09:27 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-66a88cc0-a2d8-4a67-a9ba-b78f7fe9bfa4 tempest-VolumesTestJSON-551565785 None] Created reservations ['5f1221fb-721f-4f1b-85b1-ff8284efc1a5', '1c7f307f-d591-49c0-9fff-65bd71528f87', '2094b916-cf4c-488c-9b73-edca3056d850', '5ca9840e-0e9f-4ba6-8820-90ab0a4fb897'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:09:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-66a88cc0-a2d8-4a67-a9ba-b78f7fe9bfa4 tempest-VolumesTestJSON-551565785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:09:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-66a88cc0-a2d8-4a67-a9ba-b78f7fe9bfa4 tempest-VolumesTestJSON-551565785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:09:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-66a88cc0-a2d8-4a67-a9ba-b78f7fe9bfa4 tempest-VolumesTestJSON-551565785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:09:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-66a88cc0-a2d8-4a67-a9ba-b78f7fe9bfa4 tempest-VolumesTestJSON-551565785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:09:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-66a88cc0-a2d8-4a67-a9ba-b78f7fe9bfa4 tempest-VolumesTestJSON-551565785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:09:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-66a88cc0-a2d8-4a67-a9ba-b78f7fe9bfa4 tempest-VolumesTestJSON-551565785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:09:27 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-4528408f-e1a7-4210-af87-e3fd2ac15cd2 req-de1ecc54-6b35-4281-9700-ed3439426d09 tempest-ServerActionsTestOtherA-1201227496 None] Terminate volume connection completed successfully.
Nov 05 19:09:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-4528408f-e1a7-4210-af87-e3fd2ac15cd2 req-de1ecc54-6b35-4281-9700-ed3439426d09 tempest-ServerActionsTestOtherA-1201227496 None] Deleting attachment 6fdc1d96-3bc0-4ecc-883d-2022fa893a87. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 19:09:27 devstack sudo[91237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:09:27 devstack sudo[91237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:28 devstack sudo[91237]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-66a88cc0-a2d8-4a67-a9ba-b78f7fe9bfa4 tempest-VolumesTestJSON-551565785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.388s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:28 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-66a88cc0-a2d8-4a67-a9ba-b78f7fe9bfa4 tempest-VolumesTestJSON-551565785 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:09:28 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-66a88cc0-a2d8-4a67-a9ba-b78f7fe9bfa4 tempest-VolumesTestJSON-551565785 None] Deleted volume successfully.
Nov 05 19:09:28 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-66a88cc0-a2d8-4a67-a9ba-b78f7fe9bfa4 tempest-VolumesTestJSON-551565785 None] Lock "cinder-cf814c66-de6e-439a-a274-44d9168425f2-delete_volume" released by "delete_volume" :: held 2.060s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:09:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-4528408f-e1a7-4210-af87-e3fd2ac15cd2 req-f85ad964-1ca3-4671-880b-84f93134d5d2 tempest-ServerActionsTestOtherA-1201227496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:09:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-4528408f-e1a7-4210-af87-e3fd2ac15cd2 req-f85ad964-1ca3-4671-880b-84f93134d5d2 tempest-ServerActionsTestOtherA-1201227496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:09:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-4528408f-e1a7-4210-af87-e3fd2ac15cd2 req-f85ad964-1ca3-4671-880b-84f93134d5d2 tempest-ServerActionsTestOtherA-1201227496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:09:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-4528408f-e1a7-4210-af87-e3fd2ac15cd2 req-f85ad964-1ca3-4671-880b-84f93134d5d2 tempest-ServerActionsTestOtherA-1201227496 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec', 'name': 'volume-e96d910b-0ace-4196-9a8b-5c14b5946d88', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a712dfff-6bb8-49be-8c94-fa748884d7ba', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 19:09:34 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-4528408f-e1a7-4210-af87-e3fd2ac15cd2 req-f85ad964-1ca3-4671-880b-84f93134d5d2 tempest-ServerActionsTestOtherA-1201227496 None] attachment_update completed successfully.
Nov 05 19:09:39 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=90,cinder:INSERT=21,cinder:UPDATE=68,cinder:DELETE=5 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:09:39 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-1cf278d8-e3c9-4f0f-a528-24345f0fd8f9 tempest-GroupSnapshotsV319Test-1093469349 None] Group tempest-GroupSnapshotsV319Test-Group-1586590760: creating
Nov 05 19:09:39 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=70,cinder:UPDATE=80,cinder:INSERT=22,cinder:DELETE=7 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:09:39 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-1cf278d8-e3c9-4f0f-a528-24345f0fd8f9 tempest-GroupSnapshotsV319Test-1093469349 None] Group tempest-GroupSnapshotsV319Test-Group-1586590760: created successfully
Nov 05 19:09:39 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-1cf278d8-e3c9-4f0f-a528-24345f0fd8f9 tempest-GroupSnapshotsV319Test-1093469349 None] Create group completed successfully.
Nov 05 19:09:42 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e029e13-5e7d-44cf-ad7c-1fe17f9144f9 tempest-GroupSnapshotsV319Test-1093469349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:09:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7e029e13-5e7d-44cf-ad7c-1fe17f9144f9 tempest-GroupSnapshotsV319Test-1093469349 None] Flow 'volume_create_manager' (28e60022-97b3-48f5-9ef0-ca85d42b8958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:09:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7e029e13-5e7d-44cf-ad7c-1fe17f9144f9 tempest-GroupSnapshotsV319Test-1093469349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29a31572-da4a-4386-bb92-e7f12a2660f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:09:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7e029e13-5e7d-44cf-ad7c-1fe17f9144f9 tempest-GroupSnapshotsV319Test-1093469349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29a31572-da4a-4386-bb92-e7f12a2660f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-847038708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ae55dee5-d2c9-4428-8513-17961ba8cca4,host='devstack@QuobyteHD#QuobyteHD',id=5fd8dc97-cf90-4f9e-ab82-8817c16345bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59997ea0898c4c15a278081c3e860d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:09:42Z,use_quota=True,user_id='c30be003cc2e4e7cbd76ba5b8daebe91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc117022-2182-40e3-a050-5cd260b24276),volume_type_id=fc117022-2182-40e3-a050-5cd260b24276)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:09:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7e029e13-5e7d-44cf-ad7c-1fe17f9144f9 tempest-GroupSnapshotsV319Test-1093469349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a937405a-c927-48ba-897e-5973f3ab0b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:09:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7e029e13-5e7d-44cf-ad7c-1fe17f9144f9 tempest-GroupSnapshotsV319Test-1093469349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a937405a-c927-48ba-897e-5973f3ab0b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:09:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7e029e13-5e7d-44cf-ad7c-1fe17f9144f9 tempest-GroupSnapshotsV319Test-1093469349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2210919-9228-4fca-a919-535ccd5c9004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:09:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7e029e13-5e7d-44cf-ad7c-1fe17f9144f9 tempest-GroupSnapshotsV319Test-1093469349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2210919-9228-4fca-a919-535ccd5c9004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fd8dc97-cf90-4f9e-ab82-8817c16345bb', 'volume_name': 'volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:09:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7e029e13-5e7d-44cf-ad7c-1fe17f9144f9 tempest-GroupSnapshotsV319Test-1093469349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c07d159-b0a2-4786-b473-cee34ca9f211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:09:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7e029e13-5e7d-44cf-ad7c-1fe17f9144f9 tempest-GroupSnapshotsV319Test-1093469349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c07d159-b0a2-4786-b473-cee34ca9f211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:09:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7e029e13-5e7d-44cf-ad7c-1fe17f9144f9 tempest-GroupSnapshotsV319Test-1093469349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8ccf17-513d-4ad6-aced-bed796f4a16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:09:42 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-7e029e13-5e7d-44cf-ad7c-1fe17f9144f9 tempest-GroupSnapshotsV319Test-1093469349 None] Volume 5fd8dc97-cf90-4f9e-ab82-8817c16345bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb', 'volume_size': 1}
Nov 05 19:09:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7e029e13-5e7d-44cf-ad7c-1fe17f9144f9 tempest-GroupSnapshotsV319Test-1093469349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:09:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7e029e13-5e7d-44cf-ad7c-1fe17f9144f9 tempest-GroupSnapshotsV319Test-1093469349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:09:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7e029e13-5e7d-44cf-ad7c-1fe17f9144f9 tempest-GroupSnapshotsV319Test-1093469349 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ae55dee5-d2c9-4428-8513-17961ba8cca4,created_at=2026-11-05T18:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-847038708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ae55dee5-d2c9-4428-8513-17961ba8cca4,host='devstack@QuobyteHD#QuobyteHD',id=5fd8dc97-cf90-4f9e-ab82-8817c16345bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59997ea0898c4c15a278081c3e860d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:09:42Z,use_quota=True,user_id='c30be003cc2e4e7cbd76ba5b8daebe91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc117022-2182-40e3-a050-5cd260b24276),volume_type_id=fc117022-2182-40e3-a050-5cd260b24276)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:09:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-7e029e13-5e7d-44cf-ad7c-1fe17f9144f9 tempest-GroupSnapshotsV319Test-1093469349 None] Creating volume 5fd8dc97-cf90-4f9e-ab82-8817c16345bb {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:09:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7e029e13-5e7d-44cf-ad7c-1fe17f9144f9 tempest-GroupSnapshotsV319Test-1093469349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:09:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7e029e13-5e7d-44cf-ad7c-1fe17f9144f9 tempest-GroupSnapshotsV319Test-1093469349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:09:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7e029e13-5e7d-44cf-ad7c-1fe17f9144f9 tempest-GroupSnapshotsV319Test-1093469349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:09:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7e029e13-5e7d-44cf-ad7c-1fe17f9144f9 tempest-GroupSnapshotsV319Test-1093469349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:09:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7e029e13-5e7d-44cf-ad7c-1fe17f9144f9 tempest-GroupSnapshotsV319Test-1093469349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:09:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7e029e13-5e7d-44cf-ad7c-1fe17f9144f9 tempest-GroupSnapshotsV319Test-1093469349 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:09:42 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-7e029e13-5e7d-44cf-ad7c-1fe17f9144f9 tempest-GroupSnapshotsV319Test-1093469349 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:09:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7e029e13-5e7d-44cf-ad7c-1fe17f9144f9 tempest-GroupSnapshotsV319Test-1093469349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:09:42 devstack sudo[91875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb 1073741824
Nov 05 19:09:42 devstack sudo[91875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:43 devstack sudo[91875]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7e029e13-5e7d-44cf-ad7c-1fe17f9144f9 tempest-GroupSnapshotsV319Test-1093469349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb 1073741824" returned: 0 in 0.998s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7e029e13-5e7d-44cf-ad7c-1fe17f9144f9 tempest-GroupSnapshotsV319Test-1093469349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:09:43 devstack sudo[91882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb
Nov 05 19:09:43 devstack sudo[91882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:44 devstack sudo[91882]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7e029e13-5e7d-44cf-ad7c-1fe17f9144f9 tempest-GroupSnapshotsV319Test-1093469349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb" returned: 0 in 0.608s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7e029e13-5e7d-44cf-ad7c-1fe17f9144f9 tempest-GroupSnapshotsV319Test-1093469349 None] <== create_volume: return (1754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:09:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7e029e13-5e7d-44cf-ad7c-1fe17f9144f9 tempest-GroupSnapshotsV319Test-1093469349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.758s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:09:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7e029e13-5e7d-44cf-ad7c-1fe17f9144f9 tempest-GroupSnapshotsV319Test-1093469349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8ccf17-513d-4ad6-aced-bed796f4a16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:09:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7e029e13-5e7d-44cf-ad7c-1fe17f9144f9 tempest-GroupSnapshotsV319Test-1093469349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e01a86d-1526-4bf7-b2c3-61d441e9b342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:09:44 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-7e029e13-5e7d-44cf-ad7c-1fe17f9144f9 tempest-GroupSnapshotsV319Test-1093469349 None] Volume volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb (5fd8dc97-cf90-4f9e-ab82-8817c16345bb): created successfully
Nov 05 19:09:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7e029e13-5e7d-44cf-ad7c-1fe17f9144f9 tempest-GroupSnapshotsV319Test-1093469349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e01a86d-1526-4bf7-b2c3-61d441e9b342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:09:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7e029e13-5e7d-44cf-ad7c-1fe17f9144f9 tempest-GroupSnapshotsV319Test-1093469349 None] Flow 'volume_create_manager' (28e60022-97b3-48f5-9ef0-ca85d42b8958) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:09:44 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-7e029e13-5e7d-44cf-ad7c-1fe17f9144f9 tempest-GroupSnapshotsV319Test-1093469349 None] Created volume successfully.
Nov 05 19:09:45 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-0834566a-e9f6-465d-9d0f-6005ba62d43a tempest-GroupSnapshotsV319Test-1093469349 None] GroupSnapshot f14187bd-63fb-44c3-be35-2d3d7490265f: creating.
Nov 05 19:09:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0834566a-e9f6-465d-9d0f-6005ba62d43a tempest-GroupSnapshotsV319Test-1093469349 None] Group snapshot f14187bd-63fb-44c3-be35-2d3d7490265f: creating. {{(pid=87184) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 05 19:09:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0834566a-e9f6-465d-9d0f-6005ba62d43a tempest-GroupSnapshotsV319Test-1093469349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:09:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0834566a-e9f6-465d-9d0f-6005ba62d43a tempest-GroupSnapshotsV319Test-1093469349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:09:46 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-0834566a-e9f6-465d-9d0f-6005ba62d43a tempest-GroupSnapshotsV319Test-1093469349 None] Creating offline snapshot 4bbc913d-54be-41f7-b1ae-e521119cd14b of volume 5fd8dc97-cf90-4f9e-ab82-8817c16345bb {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:09:46 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b51779e-04e3-4cfb-bba7-c0ece35186d9]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:09:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0834566a-e9f6-465d-9d0f-6005ba62d43a tempest-GroupSnapshotsV319Test-1093469349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:09:46 devstack sudo[91905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb
Nov 05 19:09:46 devstack sudo[91905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:46 devstack sudo[91905]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0834566a-e9f6-465d-9d0f-6005ba62d43a tempest-GroupSnapshotsV319Test-1093469349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb" returned: 0 in 0.442s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0834566a-e9f6-465d-9d0f-6005ba62d43a tempest-GroupSnapshotsV319Test-1093469349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb.4bbc913d-54be-41f7-b1ae-e521119cd14b 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:09:46 devstack sudo[91913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb.4bbc913d-54be-41f7-b1ae-e521119cd14b 1G
Nov 05 19:09:46 devstack sudo[91913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:47 devstack sudo[91913]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0834566a-e9f6-465d-9d0f-6005ba62d43a tempest-GroupSnapshotsV319Test-1093469349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb.4bbc913d-54be-41f7-b1ae-e521119cd14b 1G" returned: 0 in 0.490s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0834566a-e9f6-465d-9d0f-6005ba62d43a tempest-GroupSnapshotsV319Test-1093469349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb.4bbc913d-54be-41f7-b1ae-e521119cd14b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:09:47 devstack sudo[91920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb.4bbc913d-54be-41f7-b1ae-e521119cd14b
Nov 05 19:09:47 devstack sudo[91920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:47 devstack sudo[91920]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0834566a-e9f6-465d-9d0f-6005ba62d43a tempest-GroupSnapshotsV319Test-1093469349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb.4bbc913d-54be-41f7-b1ae-e521119cd14b" returned: 0 in 0.391s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:47 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-0834566a-e9f6-465d-9d0f-6005ba62d43a tempest-GroupSnapshotsV319Test-1093469349 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb.4bbc913d-54be-41f7-b1ae-e521119cd14b is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 19:09:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0834566a-e9f6-465d-9d0f-6005ba62d43a tempest-GroupSnapshotsV319Test-1093469349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb.4bbc913d-54be-41f7-b1ae-e521119cd14b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:09:47 devstack sudo[91928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb.4bbc913d-54be-41f7-b1ae-e521119cd14b
Nov 05 19:09:47 devstack sudo[91928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:47 devstack sudo[91928]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0834566a-e9f6-465d-9d0f-6005ba62d43a tempest-GroupSnapshotsV319Test-1093469349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb.4bbc913d-54be-41f7-b1ae-e521119cd14b" returned: 0 in 0.248s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0834566a-e9f6-465d-9d0f-6005ba62d43a tempest-GroupSnapshotsV319Test-1093469349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:09:47 devstack sudo[91931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb.info
Nov 05 19:09:47 devstack sudo[91931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:47 devstack sudo[91931]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0834566a-e9f6-465d-9d0f-6005ba62d43a tempest-GroupSnapshotsV319Test-1093469349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb.info" returned: 0 in 0.270s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:47 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-0834566a-e9f6-465d-9d0f-6005ba62d43a tempest-GroupSnapshotsV319Test-1093469349 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 19:09:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0834566a-e9f6-465d-9d0f-6005ba62d43a tempest-GroupSnapshotsV319Test-1093469349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:09:48 devstack sudo[91936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb.info
Nov 05 19:09:48 devstack sudo[91936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:48 devstack sudo[91936]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0834566a-e9f6-465d-9d0f-6005ba62d43a tempest-GroupSnapshotsV319Test-1093469349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb.info" returned: 0 in 0.284s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0834566a-e9f6-465d-9d0f-6005ba62d43a tempest-GroupSnapshotsV319Test-1093469349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.250s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:09:48 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-0834566a-e9f6-465d-9d0f-6005ba62d43a tempest-GroupSnapshotsV319Test-1093469349 None] group_snapshot f14187bd-63fb-44c3-be35-2d3d7490265f: created successfully
Nov 05 19:09:50 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-2d9fd372-a325-48f6-b454-338f9507cbf4 tempest-GroupSnapshotsV319Test-1093469349 None] group_snapshot f14187bd-63fb-44c3-be35-2d3d7490265f: deleting
Nov 05 19:09:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2d9fd372-a325-48f6-b454-338f9507cbf4 tempest-GroupSnapshotsV319Test-1093469349 None] group_snapshot f14187bd-63fb-44c3-be35-2d3d7490265f: deleting {{(pid=87184) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 05 19:09:50 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2d9fd372-a325-48f6-b454-338f9507cbf4 tempest-GroupSnapshotsV319Test-1093469349 None] Acquiring lock "cinder-quobyte-5fd8dc97-cf90-4f9e-ab82-8817c16345bb" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:09:50 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2d9fd372-a325-48f6-b454-338f9507cbf4 tempest-GroupSnapshotsV319Test-1093469349 None] Lock "cinder-quobyte-5fd8dc97-cf90-4f9e-ab82-8817c16345bb" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:09:50 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2d9fd372-a325-48f6-b454-338f9507cbf4 tempest-GroupSnapshotsV319Test-1093469349 None] Acquiring lock "cinder-quobyte-4bbc913d-54be-41f7-b1ae-e521119cd14b" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:09:50 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2d9fd372-a325-48f6-b454-338f9507cbf4 tempest-GroupSnapshotsV319Test-1093469349 None] Lock "cinder-quobyte-4bbc913d-54be-41f7-b1ae-e521119cd14b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:09:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-2d9fd372-a325-48f6-b454-338f9507cbf4 tempest-GroupSnapshotsV319Test-1093469349 None] Deleting offline snapshot 4bbc913d-54be-41f7-b1ae-e521119cd14b of volume 5fd8dc97-cf90-4f9e-ab82-8817c16345bb {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:09:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-2d9fd372-a325-48f6-b454-338f9507cbf4 tempest-GroupSnapshotsV319Test-1093469349 None] snapshot_file for this snap is: volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb.4bbc913d-54be-41f7-b1ae-e521119cd14b {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:09:50 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[862944e7-8286-4621-adeb-bb1236c92d19]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:09:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2d9fd372-a325-48f6-b454-338f9507cbf4 tempest-GroupSnapshotsV319Test-1093469349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb.4bbc913d-54be-41f7-b1ae-e521119cd14b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:09:50 devstack sudo[91979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb.4bbc913d-54be-41f7-b1ae-e521119cd14b
Nov 05 19:09:50 devstack sudo[91979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:50 devstack sudo[91979]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2d9fd372-a325-48f6-b454-338f9507cbf4 tempest-GroupSnapshotsV319Test-1093469349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb.4bbc913d-54be-41f7-b1ae-e521119cd14b" returned: 0 in 0.496s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-2d9fd372-a325-48f6-b454-338f9507cbf4 tempest-GroupSnapshotsV319Test-1093469349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:09:51 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9ac59f-aa00-4df9-a167-b07da5a9465b]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:09:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2d9fd372-a325-48f6-b454-338f9507cbf4 tempest-GroupSnapshotsV319Test-1093469349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:09:51 devstack sudo[91985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb
Nov 05 19:09:51 devstack sudo[91985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:51 devstack sudo[91985]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2d9fd372-a325-48f6-b454-338f9507cbf4 tempest-GroupSnapshotsV319Test-1093469349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb" returned: 0 in 0.483s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2d9fd372-a325-48f6-b454-338f9507cbf4 tempest-GroupSnapshotsV319Test-1093469349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb.4bbc913d-54be-41f7-b1ae-e521119cd14b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:09:51 devstack sudo[91990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb.4bbc913d-54be-41f7-b1ae-e521119cd14b
Nov 05 19:09:51 devstack sudo[91990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:52 devstack sudo[91990]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2d9fd372-a325-48f6-b454-338f9507cbf4 tempest-GroupSnapshotsV319Test-1093469349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb.4bbc913d-54be-41f7-b1ae-e521119cd14b" returned: 0 in 0.813s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2d9fd372-a325-48f6-b454-338f9507cbf4 tempest-GroupSnapshotsV319Test-1093469349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb.4bbc913d-54be-41f7-b1ae-e521119cd14b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:09:52 devstack sudo[92048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb.4bbc913d-54be-41f7-b1ae-e521119cd14b
Nov 05 19:09:52 devstack sudo[92048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:53 devstack sudo[92048]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2d9fd372-a325-48f6-b454-338f9507cbf4 tempest-GroupSnapshotsV319Test-1093469349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb.4bbc913d-54be-41f7-b1ae-e521119cd14b" returned: 0 in 0.704s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2d9fd372-a325-48f6-b454-338f9507cbf4 tempest-GroupSnapshotsV319Test-1093469349 None] Lock "cinder-quobyte-4bbc913d-54be-41f7-b1ae-e521119cd14b" released by "_delete_snapshot" :: held 2.644s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:09:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2d9fd372-a325-48f6-b454-338f9507cbf4 tempest-GroupSnapshotsV319Test-1093469349 None] Lock "cinder-quobyte-5fd8dc97-cf90-4f9e-ab82-8817c16345bb" released by "delete_snapshot" :: held 2.670s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:09:53 devstack cinder-volume[87184]: WARNING cinder.quota [None req-2d9fd372-a325-48f6-b454-338f9507cbf4 tempest-GroupSnapshotsV319Test-1093469349 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-125491411 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-125491411, it is now deprecated. Please use the default quota class for default quota.
Nov 05 19:09:53 devstack cinder-volume[87184]: WARNING cinder.quota [None req-2d9fd372-a325-48f6-b454-338f9507cbf4 tempest-GroupSnapshotsV319Test-1093469349 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-125491411 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-125491411, it is now deprecated. Please use the default quota class for default quota.
Nov 05 19:09:53 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-2d9fd372-a325-48f6-b454-338f9507cbf4 tempest-GroupSnapshotsV319Test-1093469349 None] Created reservations ['410c8fc9-00e9-47eb-833a-b2588ec8ff5c', 'dd43643b-62e5-4929-a53a-e408e350dcb5', '04f1ac72-6ad3-417a-ab96-2160c1792bee', 'f75d1bd9-0627-41b2-b1da-978379c111df'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:09:53 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-2d9fd372-a325-48f6-b454-338f9507cbf4 tempest-GroupSnapshotsV319Test-1093469349 None] group_snapshot f14187bd-63fb-44c3-be35-2d3d7490265f: deleted successfully
Nov 05 19:09:54 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1f4bfac7-8ec6-4fa1-808a-36a52d848888 tempest-GroupSnapshotsV319Test-1093469349 None] Acquiring lock "cinder-quobyte-5fd8dc97-cf90-4f9e-ab82-8817c16345bb" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:09:54 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1f4bfac7-8ec6-4fa1-808a-36a52d848888 tempest-GroupSnapshotsV319Test-1093469349 None] Lock "cinder-quobyte-5fd8dc97-cf90-4f9e-ab82-8817c16345bb" acquired by "delete_volume" :: waited 0.049s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:09:54 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78f349d-419d-4a0b-b79a-fd097f2dd9af]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:09:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1f4bfac7-8ec6-4fa1-808a-36a52d848888 tempest-GroupSnapshotsV319Test-1093469349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:09:54 devstack sudo[92070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb
Nov 05 19:09:54 devstack sudo[92070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:55 devstack sudo[92070]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1f4bfac7-8ec6-4fa1-808a-36a52d848888 tempest-GroupSnapshotsV319Test-1093469349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb" returned: 0 in 0.562s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1f4bfac7-8ec6-4fa1-808a-36a52d848888 tempest-GroupSnapshotsV319Test-1093469349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:09:55 devstack sudo[92075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb
Nov 05 19:09:55 devstack sudo[92075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:55 devstack sudo[92075]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1f4bfac7-8ec6-4fa1-808a-36a52d848888 tempest-GroupSnapshotsV319Test-1093469349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5fd8dc97-cf90-4f9e-ab82-8817c16345bb" returned: 0 in 0.426s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1f4bfac7-8ec6-4fa1-808a-36a52d848888 tempest-GroupSnapshotsV319Test-1093469349 None] Lock "cinder-quobyte-5fd8dc97-cf90-4f9e-ab82-8817c16345bb" released by "delete_volume" :: held 1.208s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:09:55 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-1f4bfac7-8ec6-4fa1-808a-36a52d848888 tempest-GroupSnapshotsV319Test-1093469349 None] Created reservations ['3db4e18c-f18a-4799-8604-50031764319c'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:09:55 devstack cinder-volume[87184]: WARNING cinder.quota [None req-1f4bfac7-8ec6-4fa1-808a-36a52d848888 tempest-GroupSnapshotsV319Test-1093469349 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-125491411 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-125491411, it is now deprecated. Please use the default quota class for default quota.
Nov 05 19:09:55 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-1f4bfac7-8ec6-4fa1-808a-36a52d848888 tempest-GroupSnapshotsV319Test-1093469349 None] Created reservations ['d49ec166-1d4f-409e-b911-c6de8cc10761', 'c228ae1f-abaf-4fcf-8882-1f1316d01432', 'f023fb81-70be-44ea-b3c9-4a64ea98516c', '8c46fe2e-8f9d-4d2c-958f-e7709e5a7cd1'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:09:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1f4bfac7-8ec6-4fa1-808a-36a52d848888 tempest-GroupSnapshotsV319Test-1093469349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:09:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1f4bfac7-8ec6-4fa1-808a-36a52d848888 tempest-GroupSnapshotsV319Test-1093469349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:09:56 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1f4bfac7-8ec6-4fa1-808a-36a52d848888 tempest-GroupSnapshotsV319Test-1093469349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:09:56 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1f4bfac7-8ec6-4fa1-808a-36a52d848888 tempest-GroupSnapshotsV319Test-1093469349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:09:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1f4bfac7-8ec6-4fa1-808a-36a52d848888 tempest-GroupSnapshotsV319Test-1093469349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:09:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1f4bfac7-8ec6-4fa1-808a-36a52d848888 tempest-GroupSnapshotsV319Test-1093469349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:09:56 devstack sudo[92083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:09:56 devstack sudo[92083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:09:56 devstack sudo[92083]: pam_unix(sudo:session): session closed for user root
Nov 05 19:09:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1f4bfac7-8ec6-4fa1-808a-36a52d848888 tempest-GroupSnapshotsV319Test-1093469349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.455s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:09:56 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-1f4bfac7-8ec6-4fa1-808a-36a52d848888 tempest-GroupSnapshotsV319Test-1093469349 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:09:56 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-1f4bfac7-8ec6-4fa1-808a-36a52d848888 tempest-GroupSnapshotsV319Test-1093469349 None] Delete group completed successfully.
Nov 05 19:09:57 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-97b3d3b6-2fa5-4a1b-abb0-324a315d53d9 req-e7626128-4cbd-43b5-b05a-ee2e4d12fa8d tempest-AttachVolumeTestJSON-109518034 None] Terminate volume connection completed successfully.
Nov 05 19:09:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-97b3d3b6-2fa5-4a1b-abb0-324a315d53d9 req-e7626128-4cbd-43b5-b05a-ee2e4d12fa8d tempest-AttachVolumeTestJSON-109518034 None] Deleting attachment 30b0bebb-4f12-4a24-8ed2-471766d3afee. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 19:10:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:10:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:10:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:10:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:10:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:10:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:10:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:10:05 devstack sudo[92220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:10:05 devstack sudo[92220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:10:06 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:UPDATE=24,cinder:SELECT=24,cinder:INSERT=4 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:10:06 devstack sudo[92220]: pam_unix(sudo:session): session closed for user root
Nov 05 19:10:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 1.270s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:10:06 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:10:06 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:10:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread count: 28 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 19:10:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread info: [<_MainThread(MainThread, started 126882883072128)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126882770872512)>, <Thread(Thread-3 (stat_writer), started daemon 126882769837376)>, <Thread(Rabbit-heartbeat, started daemon 126882768896256)>, <Thread(Thread-5 (_runner), started daemon 126882768980928)>, <Thread(Thread-7 (_runner), started daemon 126882767016448)>, <Thread(fd_logger, started daemon 126882764561216)>, <Thread(privsep_reader, started daemon 126882764568576)>, <Thread(tpool_thread_0, started daemon 126882759292608)>, <Thread(tpool_thread_1, started daemon 126882750899904)>, <Thread(tpool_thread_2, started daemon 126882742507200)>, <Thread(tpool_thread_3, started daemon 126882734114496)>, <Thread(tpool_thread_4, started daemon 126882725721792)>, <Thread(tpool_thread_5, started daemon 126882717329088)>, <Thread(tpool_thread_6, started daemon 126882708920000)>, <Thread(tpool_thread_7, started daemon 126882700510912)>, <Thread(tpool_thread_8, started daemon 126882692101824)>, <Thread(tpool_thread_9, started daemon 126882683692736)>, <Thread(tpool_thread_10, started daemon 126882675283648)>, <Thread(tpool_thread_11, started daemon 126882666874560)>, <Thread(tpool_thread_12, started daemon 126882658465472)>, <Thread(tpool_thread_13, started daemon 126882650056384)>, <Thread(tpool_thread_14, started daemon 126882641647296)>, <Thread(tpool_thread_15, started daemon 126882633238208)>, <Thread(tpool_thread_16, started daemon 126882624829120)>, <Thread(tpool_thread_17, started daemon 126882616420032)>, <Thread(tpool_thread_18, started daemon 126882608010944)>, <Thread(tpool_thread_19, started daemon 126882599601856)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 19:10:07 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:UPDATE=22,cinder:SELECT=25,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:10:11 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b7830c8b-f859-4d41-bd8b-62e04e950ec9 tempest-GroupsTest-1405641847 None] Group tempest-Group1-826606790: creating
Nov 05 19:10:11 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b7830c8b-f859-4d41-bd8b-62e04e950ec9 tempest-GroupsTest-1405641847 None] Group tempest-Group1-826606790: created successfully
Nov 05 19:10:11 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b7830c8b-f859-4d41-bd8b-62e04e950ec9 tempest-GroupsTest-1405641847 None] Create group completed successfully.
Nov 05 19:10:12 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-80b86d09-9921-48d7-8fde-707411ae0b01 tempest-GroupsTest-1405641847 None] Group tempest-Group2-1212336989: creating
Nov 05 19:10:12 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-80b86d09-9921-48d7-8fde-707411ae0b01 tempest-GroupsTest-1405641847 None] Group tempest-Group2-1212336989: created successfully
Nov 05 19:10:12 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-80b86d09-9921-48d7-8fde-707411ae0b01 tempest-GroupsTest-1405641847 None] Create group completed successfully.
Nov 05 19:10:13 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcaa57b8-497f-440c-b0ac-58371a685410 tempest-ServersNegativeTestJSON-36159918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:10:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dcaa57b8-497f-440c-b0ac-58371a685410 tempest-ServersNegativeTestJSON-36159918 None] Flow 'volume_create_manager' (befb2205-3c9b-4f4c-9628-cb5e500df4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:10:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dcaa57b8-497f-440c-b0ac-58371a685410 tempest-ServersNegativeTestJSON-36159918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a32e89-b140-4450-90b8-21257e1890a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:10:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dcaa57b8-497f-440c-b0ac-58371a685410 tempest-ServersNegativeTestJSON-36159918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a32e89-b140-4450-90b8-21257e1890a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1197421254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f2b317b-c0d6-4f26-9794-049146c2a3e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c526fe4e4bd458199eeb08cacd4e0a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:10:13Z,use_quota=True,user_id='0264983842ce4661a5ba1aa5e0d14ca4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:10:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dcaa57b8-497f-440c-b0ac-58371a685410 tempest-ServersNegativeTestJSON-36159918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7edea1d0-3967-4fa6-a928-944dc3ff2709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:10:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dcaa57b8-497f-440c-b0ac-58371a685410 tempest-ServersNegativeTestJSON-36159918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7edea1d0-3967-4fa6-a928-944dc3ff2709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:10:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dcaa57b8-497f-440c-b0ac-58371a685410 tempest-ServersNegativeTestJSON-36159918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca4d8151-5322-443b-8406-a8cefc9668d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:10:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dcaa57b8-497f-440c-b0ac-58371a685410 tempest-ServersNegativeTestJSON-36159918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca4d8151-5322-443b-8406-a8cefc9668d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f2b317b-c0d6-4f26-9794-049146c2a3e1', 'volume_name': 'volume-9f2b317b-c0d6-4f26-9794-049146c2a3e1', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:10:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dcaa57b8-497f-440c-b0ac-58371a685410 tempest-ServersNegativeTestJSON-36159918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d48e72bd-0f88-4fae-8f74-1b4e317bc9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:10:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dcaa57b8-497f-440c-b0ac-58371a685410 tempest-ServersNegativeTestJSON-36159918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d48e72bd-0f88-4fae-8f74-1b4e317bc9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:10:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dcaa57b8-497f-440c-b0ac-58371a685410 tempest-ServersNegativeTestJSON-36159918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18d28d47-3bdd-4d69-abfb-24aab2cb1d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:10:13 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-dcaa57b8-497f-440c-b0ac-58371a685410 tempest-ServersNegativeTestJSON-36159918 None] Volume 9f2b317b-c0d6-4f26-9794-049146c2a3e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f2b317b-c0d6-4f26-9794-049146c2a3e1', 'volume_size': 1}
Nov 05 19:10:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dcaa57b8-497f-440c-b0ac-58371a685410 tempest-ServersNegativeTestJSON-36159918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:10:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dcaa57b8-497f-440c-b0ac-58371a685410 tempest-ServersNegativeTestJSON-36159918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:10:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dcaa57b8-497f-440c-b0ac-58371a685410 tempest-ServersNegativeTestJSON-36159918 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1197421254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f2b317b-c0d6-4f26-9794-049146c2a3e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c526fe4e4bd458199eeb08cacd4e0a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:10:13Z,use_quota=True,user_id='0264983842ce4661a5ba1aa5e0d14ca4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:10:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-dcaa57b8-497f-440c-b0ac-58371a685410 tempest-ServersNegativeTestJSON-36159918 None] Creating volume 9f2b317b-c0d6-4f26-9794-049146c2a3e1 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:10:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dcaa57b8-497f-440c-b0ac-58371a685410 tempest-ServersNegativeTestJSON-36159918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:10:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dcaa57b8-497f-440c-b0ac-58371a685410 tempest-ServersNegativeTestJSON-36159918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:10:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dcaa57b8-497f-440c-b0ac-58371a685410 tempest-ServersNegativeTestJSON-36159918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:10:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dcaa57b8-497f-440c-b0ac-58371a685410 tempest-ServersNegativeTestJSON-36159918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:10:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dcaa57b8-497f-440c-b0ac-58371a685410 tempest-ServersNegativeTestJSON-36159918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:10:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dcaa57b8-497f-440c-b0ac-58371a685410 tempest-ServersNegativeTestJSON-36159918 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:10:13 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-dcaa57b8-497f-440c-b0ac-58371a685410 tempest-ServersNegativeTestJSON-36159918 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:10:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dcaa57b8-497f-440c-b0ac-58371a685410 tempest-ServersNegativeTestJSON-36159918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9f2b317b-c0d6-4f26-9794-049146c2a3e1 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:10:13 devstack sudo[92340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9f2b317b-c0d6-4f26-9794-049146c2a3e1 1073741824
Nov 05 19:10:13 devstack sudo[92340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:10:13 devstack sudo[92340]: pam_unix(sudo:session): session closed for user root
Nov 05 19:10:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dcaa57b8-497f-440c-b0ac-58371a685410 tempest-ServersNegativeTestJSON-36159918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9f2b317b-c0d6-4f26-9794-049146c2a3e1 1073741824" returned: 0 in 0.453s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:10:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dcaa57b8-497f-440c-b0ac-58371a685410 tempest-ServersNegativeTestJSON-36159918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9f2b317b-c0d6-4f26-9794-049146c2a3e1 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:10:13 devstack sudo[92345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9f2b317b-c0d6-4f26-9794-049146c2a3e1
Nov 05 19:10:13 devstack sudo[92345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:10:14 devstack sudo[92345]: pam_unix(sudo:session): session closed for user root
Nov 05 19:10:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dcaa57b8-497f-440c-b0ac-58371a685410 tempest-ServersNegativeTestJSON-36159918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9f2b317b-c0d6-4f26-9794-049146c2a3e1" returned: 0 in 0.274s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:10:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dcaa57b8-497f-440c-b0ac-58371a685410 tempest-ServersNegativeTestJSON-36159918 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:10:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dcaa57b8-497f-440c-b0ac-58371a685410 tempest-ServersNegativeTestJSON-36159918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:10:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dcaa57b8-497f-440c-b0ac-58371a685410 tempest-ServersNegativeTestJSON-36159918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18d28d47-3bdd-4d69-abfb-24aab2cb1d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f2b317b-c0d6-4f26-9794-049146c2a3e1', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:10:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dcaa57b8-497f-440c-b0ac-58371a685410 tempest-ServersNegativeTestJSON-36159918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9125b59-483c-4b0f-a829-f059c4437c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:10:14 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-dcaa57b8-497f-440c-b0ac-58371a685410 tempest-ServersNegativeTestJSON-36159918 None] Volume volume-9f2b317b-c0d6-4f26-9794-049146c2a3e1 (9f2b317b-c0d6-4f26-9794-049146c2a3e1): created successfully
Nov 05 19:10:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dcaa57b8-497f-440c-b0ac-58371a685410 tempest-ServersNegativeTestJSON-36159918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9125b59-483c-4b0f-a829-f059c4437c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:10:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dcaa57b8-497f-440c-b0ac-58371a685410 tempest-ServersNegativeTestJSON-36159918 None] Flow 'volume_create_manager' (befb2205-3c9b-4f4c-9628-cb5e500df4b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:10:14 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-dcaa57b8-497f-440c-b0ac-58371a685410 tempest-ServersNegativeTestJSON-36159918 None] Created volume successfully.
Nov 05 19:10:14 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2197c9b-8208-406f-8058-7ca13b1421f4 tempest-GroupsTest-1405641847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:10:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d2197c9b-8208-406f-8058-7ca13b1421f4 tempest-GroupsTest-1405641847 None] Flow 'volume_create_manager' (f3367d81-d883-4b2c-9e70-0d5a337589c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:10:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d2197c9b-8208-406f-8058-7ca13b1421f4 tempest-GroupsTest-1405641847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b4a5d89-9c0a-4eeb-acf6-da5a72060310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:10:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d2197c9b-8208-406f-8058-7ca13b1421f4 tempest-GroupsTest-1405641847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b4a5d89-9c0a-4eeb-acf6-da5a72060310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1272766319',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=03b6cf3c-97d0-45de-9939-83ca585a4303,host='devstack@QuobyteHD#QuobyteHD',id=9ac2e535-e983-42d4-b7a6-095e7aed1f80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aac9fa8eda44f16b653749e907496f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:10:14Z,use_quota=True,user_id='11c30d2454d444f6931c184280be74df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d083813-f369-4799-89c1-9f56596e2df3),volume_type_id=8d083813-f369-4799-89c1-9f56596e2df3)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:10:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d2197c9b-8208-406f-8058-7ca13b1421f4 tempest-GroupsTest-1405641847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcf92be1-1f40-47b4-b0a9-acc247bbf85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:10:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d2197c9b-8208-406f-8058-7ca13b1421f4 tempest-GroupsTest-1405641847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcf92be1-1f40-47b4-b0a9-acc247bbf85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:10:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d2197c9b-8208-406f-8058-7ca13b1421f4 tempest-GroupsTest-1405641847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a23e406-2fc1-40e8-901a-933175a3b5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:10:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d2197c9b-8208-406f-8058-7ca13b1421f4 tempest-GroupsTest-1405641847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a23e406-2fc1-40e8-901a-933175a3b5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ac2e535-e983-42d4-b7a6-095e7aed1f80', 'volume_name': 'volume-9ac2e535-e983-42d4-b7a6-095e7aed1f80', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:10:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d2197c9b-8208-406f-8058-7ca13b1421f4 tempest-GroupsTest-1405641847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea54d1ce-a84d-49c9-bc15-f285b4c71ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:10:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d2197c9b-8208-406f-8058-7ca13b1421f4 tempest-GroupsTest-1405641847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea54d1ce-a84d-49c9-bc15-f285b4c71ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:10:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d2197c9b-8208-406f-8058-7ca13b1421f4 tempest-GroupsTest-1405641847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fbf9ddb-a7bb-4a4a-907d-631adc13b961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:10:14 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-d2197c9b-8208-406f-8058-7ca13b1421f4 tempest-GroupsTest-1405641847 None] Volume 9ac2e535-e983-42d4-b7a6-095e7aed1f80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ac2e535-e983-42d4-b7a6-095e7aed1f80', 'volume_size': 1}
Nov 05 19:10:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d2197c9b-8208-406f-8058-7ca13b1421f4 tempest-GroupsTest-1405641847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:10:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d2197c9b-8208-406f-8058-7ca13b1421f4 tempest-GroupsTest-1405641847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:10:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d2197c9b-8208-406f-8058-7ca13b1421f4 tempest-GroupsTest-1405641847 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=03b6cf3c-97d0-45de-9939-83ca585a4303,created_at=2026-11-05T18:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1272766319',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=03b6cf3c-97d0-45de-9939-83ca585a4303,host='devstack@QuobyteHD#QuobyteHD',id=9ac2e535-e983-42d4-b7a6-095e7aed1f80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aac9fa8eda44f16b653749e907496f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:10:14Z,use_quota=True,user_id='11c30d2454d444f6931c184280be74df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d083813-f369-4799-89c1-9f56596e2df3),volume_type_id=8d083813-f369-4799-89c1-9f56596e2df3)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:10:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-d2197c9b-8208-406f-8058-7ca13b1421f4 tempest-GroupsTest-1405641847 None] Creating volume 9ac2e535-e983-42d4-b7a6-095e7aed1f80 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:10:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d2197c9b-8208-406f-8058-7ca13b1421f4 tempest-GroupsTest-1405641847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:10:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d2197c9b-8208-406f-8058-7ca13b1421f4 tempest-GroupsTest-1405641847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:10:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d2197c9b-8208-406f-8058-7ca13b1421f4 tempest-GroupsTest-1405641847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:10:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d2197c9b-8208-406f-8058-7ca13b1421f4 tempest-GroupsTest-1405641847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:10:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d2197c9b-8208-406f-8058-7ca13b1421f4 tempest-GroupsTest-1405641847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:10:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d2197c9b-8208-406f-8058-7ca13b1421f4 tempest-GroupsTest-1405641847 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:10:14 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-d2197c9b-8208-406f-8058-7ca13b1421f4 tempest-GroupsTest-1405641847 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:10:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d2197c9b-8208-406f-8058-7ca13b1421f4 tempest-GroupsTest-1405641847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ac2e535-e983-42d4-b7a6-095e7aed1f80 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:10:14 devstack sudo[92348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ac2e535-e983-42d4-b7a6-095e7aed1f80 1073741824
Nov 05 19:10:14 devstack sudo[92348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:10:14 devstack sudo[92348]: pam_unix(sudo:session): session closed for user root
Nov 05 19:10:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d2197c9b-8208-406f-8058-7ca13b1421f4 tempest-GroupsTest-1405641847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ac2e535-e983-42d4-b7a6-095e7aed1f80 1073741824" returned: 0 in 0.388s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:10:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d2197c9b-8208-406f-8058-7ca13b1421f4 tempest-GroupsTest-1405641847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ac2e535-e983-42d4-b7a6-095e7aed1f80 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:10:14 devstack sudo[92353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ac2e535-e983-42d4-b7a6-095e7aed1f80
Nov 05 19:10:14 devstack sudo[92353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:10:15 devstack sudo[92353]: pam_unix(sudo:session): session closed for user root
Nov 05 19:10:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d2197c9b-8208-406f-8058-7ca13b1421f4 tempest-GroupsTest-1405641847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ac2e535-e983-42d4-b7a6-095e7aed1f80" returned: 0 in 0.240s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:10:15 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d2197c9b-8208-406f-8058-7ca13b1421f4 tempest-GroupsTest-1405641847 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:10:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d2197c9b-8208-406f-8058-7ca13b1421f4 tempest-GroupsTest-1405641847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:10:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d2197c9b-8208-406f-8058-7ca13b1421f4 tempest-GroupsTest-1405641847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fbf9ddb-a7bb-4a4a-907d-631adc13b961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ac2e535-e983-42d4-b7a6-095e7aed1f80', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:10:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d2197c9b-8208-406f-8058-7ca13b1421f4 tempest-GroupsTest-1405641847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d3d1bc8-e4e9-46b8-b368-39e5d87933cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:10:15 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-d2197c9b-8208-406f-8058-7ca13b1421f4 tempest-GroupsTest-1405641847 None] Volume volume-9ac2e535-e983-42d4-b7a6-095e7aed1f80 (9ac2e535-e983-42d4-b7a6-095e7aed1f80): created successfully
Nov 05 19:10:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d2197c9b-8208-406f-8058-7ca13b1421f4 tempest-GroupsTest-1405641847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d3d1bc8-e4e9-46b8-b368-39e5d87933cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:10:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d2197c9b-8208-406f-8058-7ca13b1421f4 tempest-GroupsTest-1405641847 None] Flow 'volume_create_manager' (f3367d81-d883-4b2c-9e70-0d5a337589c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:10:15 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-d2197c9b-8208-406f-8058-7ca13b1421f4 tempest-GroupsTest-1405641847 None] Created volume successfully.
Nov 05 19:10:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c635a96b-d8ee-40dd-ae81-36afb3bd55fd tempest-GroupsTest-1405641847 None] Acquiring lock "cinder-quobyte-9ac2e535-e983-42d4-b7a6-095e7aed1f80" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:10:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c635a96b-d8ee-40dd-ae81-36afb3bd55fd tempest-GroupsTest-1405641847 None] Lock "cinder-quobyte-9ac2e535-e983-42d4-b7a6-095e7aed1f80" acquired by "delete_volume" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:10:16 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[227e8b3d-3982-4131-b599-e4670cb8755b]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:10:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c635a96b-d8ee-40dd-ae81-36afb3bd55fd tempest-GroupsTest-1405641847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ac2e535-e983-42d4-b7a6-095e7aed1f80 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:10:16 devstack sudo[92357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ac2e535-e983-42d4-b7a6-095e7aed1f80
Nov 05 19:10:16 devstack sudo[92357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:10:17 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-2def6e55-5403-4888-a939-cf6f52968975 tempest-ServersNegativeTestJSON-36159918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:10:17 devstack sudo[92357]: pam_unix(sudo:session): session closed for user root
Nov 05 19:10:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2def6e55-5403-4888-a939-cf6f52968975 tempest-ServersNegativeTestJSON-36159918 None] Flow 'volume_create_manager' (290c55d5-49f5-40d3-bf8d-8fada1da2077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:10:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2def6e55-5403-4888-a939-cf6f52968975 tempest-ServersNegativeTestJSON-36159918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a45f0e8e-8ffa-4d4c-afd9-bd48f85e6ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:10:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c635a96b-d8ee-40dd-ae81-36afb3bd55fd tempest-GroupsTest-1405641847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ac2e535-e983-42d4-b7a6-095e7aed1f80" returned: 0 in 0.615s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:10:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c635a96b-d8ee-40dd-ae81-36afb3bd55fd tempest-GroupsTest-1405641847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ac2e535-e983-42d4-b7a6-095e7aed1f80 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:10:17 devstack sudo[92362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ac2e535-e983-42d4-b7a6-095e7aed1f80
Nov 05 19:10:17 devstack sudo[92362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:10:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2def6e55-5403-4888-a939-cf6f52968975 tempest-ServersNegativeTestJSON-36159918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a45f0e8e-8ffa-4d4c-afd9-bd48f85e6ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1608098413',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4521d089-5c9c-4eba-a201-d8852be33cfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c526fe4e4bd458199eeb08cacd4e0a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:10:17Z,use_quota=True,user_id='0264983842ce4661a5ba1aa5e0d14ca4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:10:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2def6e55-5403-4888-a939-cf6f52968975 tempest-ServersNegativeTestJSON-36159918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c695549b-9d0b-4113-b3a7-54c75b3efb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:10:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2def6e55-5403-4888-a939-cf6f52968975 tempest-ServersNegativeTestJSON-36159918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c695549b-9d0b-4113-b3a7-54c75b3efb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:10:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2def6e55-5403-4888-a939-cf6f52968975 tempest-ServersNegativeTestJSON-36159918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6141ff7-35d1-4ed5-ac4e-5845e5a67e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:10:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2def6e55-5403-4888-a939-cf6f52968975 tempest-ServersNegativeTestJSON-36159918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6141ff7-35d1-4ed5-ac4e-5845e5a67e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4521d089-5c9c-4eba-a201-d8852be33cfb', 'volume_name': 'volume-4521d089-5c9c-4eba-a201-d8852be33cfb', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:10:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2def6e55-5403-4888-a939-cf6f52968975 tempest-ServersNegativeTestJSON-36159918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2c78429-a5f7-4d12-9a2f-c6029ac275c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:10:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2def6e55-5403-4888-a939-cf6f52968975 tempest-ServersNegativeTestJSON-36159918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2c78429-a5f7-4d12-9a2f-c6029ac275c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:10:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2def6e55-5403-4888-a939-cf6f52968975 tempest-ServersNegativeTestJSON-36159918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c000adcc-1449-4ea4-aaf8-2baf3548ce5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:10:17 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-2def6e55-5403-4888-a939-cf6f52968975 tempest-ServersNegativeTestJSON-36159918 None] Volume 4521d089-5c9c-4eba-a201-d8852be33cfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4521d089-5c9c-4eba-a201-d8852be33cfb', 'volume_size': 1}
Nov 05 19:10:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2def6e55-5403-4888-a939-cf6f52968975 tempest-ServersNegativeTestJSON-36159918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:10:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2def6e55-5403-4888-a939-cf6f52968975 tempest-ServersNegativeTestJSON-36159918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:10:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2def6e55-5403-4888-a939-cf6f52968975 tempest-ServersNegativeTestJSON-36159918 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1608098413',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4521d089-5c9c-4eba-a201-d8852be33cfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c526fe4e4bd458199eeb08cacd4e0a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:10:17Z,use_quota=True,user_id='0264983842ce4661a5ba1aa5e0d14ca4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:10:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-2def6e55-5403-4888-a939-cf6f52968975 tempest-ServersNegativeTestJSON-36159918 None] Creating volume 4521d089-5c9c-4eba-a201-d8852be33cfb {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:10:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2def6e55-5403-4888-a939-cf6f52968975 tempest-ServersNegativeTestJSON-36159918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:10:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2def6e55-5403-4888-a939-cf6f52968975 tempest-ServersNegativeTestJSON-36159918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:10:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2def6e55-5403-4888-a939-cf6f52968975 tempest-ServersNegativeTestJSON-36159918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:10:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2def6e55-5403-4888-a939-cf6f52968975 tempest-ServersNegativeTestJSON-36159918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:10:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2def6e55-5403-4888-a939-cf6f52968975 tempest-ServersNegativeTestJSON-36159918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:10:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2def6e55-5403-4888-a939-cf6f52968975 tempest-ServersNegativeTestJSON-36159918 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:10:17 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-2def6e55-5403-4888-a939-cf6f52968975 tempest-ServersNegativeTestJSON-36159918 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:10:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2def6e55-5403-4888-a939-cf6f52968975 tempest-ServersNegativeTestJSON-36159918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-4521d089-5c9c-4eba-a201-d8852be33cfb 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:10:17 devstack sudo[92364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-4521d089-5c9c-4eba-a201-d8852be33cfb 1073741824
Nov 05 19:10:17 devstack sudo[92364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:10:17 devstack sudo[92362]: pam_unix(sudo:session): session closed for user root
Nov 05 19:10:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c635a96b-d8ee-40dd-ae81-36afb3bd55fd tempest-GroupsTest-1405641847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ac2e535-e983-42d4-b7a6-095e7aed1f80" returned: 0 in 0.371s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:10:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c635a96b-d8ee-40dd-ae81-36afb3bd55fd tempest-GroupsTest-1405641847 None] Lock "cinder-quobyte-9ac2e535-e983-42d4-b7a6-095e7aed1f80" released by "delete_volume" :: held 1.050s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:10:17 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-c635a96b-d8ee-40dd-ae81-36afb3bd55fd tempest-GroupsTest-1405641847 None] Created reservations ['f0675eb6-f052-4bd4-92da-a7c8ab7bb5de'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:10:17 devstack cinder-volume[87184]: WARNING cinder.quota [None req-c635a96b-d8ee-40dd-ae81-36afb3bd55fd tempest-GroupsTest-1405641847 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1874447643 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1874447643, it is now deprecated. Please use the default quota class for default quota.
Nov 05 19:10:17 devstack cinder-volume[87184]: WARNING cinder.quota [None req-c635a96b-d8ee-40dd-ae81-36afb3bd55fd tempest-GroupsTest-1405641847 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1874447643 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1874447643, it is now deprecated. Please use the default quota class for default quota.
Nov 05 19:10:17 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-c635a96b-d8ee-40dd-ae81-36afb3bd55fd tempest-GroupsTest-1405641847 None] Created reservations ['d8eba536-6f76-41a2-98e1-1b25ee2e346e', 'c32b659b-5bff-49e7-8117-aac812d20fc2', 'f697995c-9099-4c49-8c59-1e876a399cc8', 'd0fa05e7-81fc-4822-8121-6e982381d248'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:10:17 devstack sudo[92364]: pam_unix(sudo:session): session closed for user root
Nov 05 19:10:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2def6e55-5403-4888-a939-cf6f52968975 tempest-ServersNegativeTestJSON-36159918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-4521d089-5c9c-4eba-a201-d8852be33cfb 1073741824" returned: 0 in 0.582s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:10:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2def6e55-5403-4888-a939-cf6f52968975 tempest-ServersNegativeTestJSON-36159918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-4521d089-5c9c-4eba-a201-d8852be33cfb {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:10:17 devstack sudo[92371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-4521d089-5c9c-4eba-a201-d8852be33cfb
Nov 05 19:10:17 devstack sudo[92371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:10:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c635a96b-d8ee-40dd-ae81-36afb3bd55fd tempest-GroupsTest-1405641847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:10:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c635a96b-d8ee-40dd-ae81-36afb3bd55fd tempest-GroupsTest-1405641847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:10:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c635a96b-d8ee-40dd-ae81-36afb3bd55fd tempest-GroupsTest-1405641847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:10:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c635a96b-d8ee-40dd-ae81-36afb3bd55fd tempest-GroupsTest-1405641847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:10:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c635a96b-d8ee-40dd-ae81-36afb3bd55fd tempest-GroupsTest-1405641847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:10:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c635a96b-d8ee-40dd-ae81-36afb3bd55fd tempest-GroupsTest-1405641847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:10:18 devstack sudo[92373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:10:18 devstack sudo[92373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:10:18 devstack sudo[92371]: pam_unix(sudo:session): session closed for user root
Nov 05 19:10:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2def6e55-5403-4888-a939-cf6f52968975 tempest-ServersNegativeTestJSON-36159918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-4521d089-5c9c-4eba-a201-d8852be33cfb" returned: 0 in 0.266s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:10:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2def6e55-5403-4888-a939-cf6f52968975 tempest-ServersNegativeTestJSON-36159918 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:10:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2def6e55-5403-4888-a939-cf6f52968975 tempest-ServersNegativeTestJSON-36159918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:10:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2def6e55-5403-4888-a939-cf6f52968975 tempest-ServersNegativeTestJSON-36159918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c000adcc-1449-4ea4-aaf8-2baf3548ce5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4521d089-5c9c-4eba-a201-d8852be33cfb', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:10:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2def6e55-5403-4888-a939-cf6f52968975 tempest-ServersNegativeTestJSON-36159918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff9e11b5-991c-4dc0-b5d8-f84c426fd38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:10:18 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-2def6e55-5403-4888-a939-cf6f52968975 tempest-ServersNegativeTestJSON-36159918 None] Volume volume-4521d089-5c9c-4eba-a201-d8852be33cfb (4521d089-5c9c-4eba-a201-d8852be33cfb): created successfully
Nov 05 19:10:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2def6e55-5403-4888-a939-cf6f52968975 tempest-ServersNegativeTestJSON-36159918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff9e11b5-991c-4dc0-b5d8-f84c426fd38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:10:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2def6e55-5403-4888-a939-cf6f52968975 tempest-ServersNegativeTestJSON-36159918 None] Flow 'volume_create_manager' (290c55d5-49f5-40d3-bf8d-8fada1da2077) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:10:18 devstack sudo[92373]: pam_unix(sudo:session): session closed for user root
Nov 05 19:10:18 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-2def6e55-5403-4888-a939-cf6f52968975 tempest-ServersNegativeTestJSON-36159918 None] Created volume successfully.
Nov 05 19:10:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c635a96b-d8ee-40dd-ae81-36afb3bd55fd tempest-GroupsTest-1405641847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.272s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:10:18 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-c635a96b-d8ee-40dd-ae81-36afb3bd55fd tempest-GroupsTest-1405641847 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:10:18 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-c635a96b-d8ee-40dd-ae81-36afb3bd55fd tempest-GroupsTest-1405641847 None] Delete group completed successfully.
Nov 05 19:10:19 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-239cc14a-1911-44d1-9084-605df6488793 tempest-GroupsTest-1405641847 None] Created reservations ['e01746a2-6f6c-4048-917f-9f588a3ea342'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:10:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-239cc14a-1911-44d1-9084-605df6488793 tempest-GroupsTest-1405641847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:10:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-239cc14a-1911-44d1-9084-605df6488793 tempest-GroupsTest-1405641847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:10:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-239cc14a-1911-44d1-9084-605df6488793 tempest-GroupsTest-1405641847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:10:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-239cc14a-1911-44d1-9084-605df6488793 tempest-GroupsTest-1405641847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:10:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-239cc14a-1911-44d1-9084-605df6488793 tempest-GroupsTest-1405641847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:10:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-239cc14a-1911-44d1-9084-605df6488793 tempest-GroupsTest-1405641847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:10:19 devstack sudo[92377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:10:19 devstack sudo[92377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:10:19 devstack sudo[92377]: pam_unix(sudo:session): session closed for user root
Nov 05 19:10:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-239cc14a-1911-44d1-9084-605df6488793 tempest-GroupsTest-1405641847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.262s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:10:19 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-239cc14a-1911-44d1-9084-605df6488793 tempest-GroupsTest-1405641847 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:10:19 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-239cc14a-1911-44d1-9084-605df6488793 tempest-GroupsTest-1405641847 None] Delete group completed successfully.
Nov 05 19:10:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9321e252-8d02-4499-b79a-237b952bbc45 tempest-ServersNegativeTestJSON-36159918 None] Acquiring lock "cinder-4521d089-5c9c-4eba-a201-d8852be33cfb-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:10:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9321e252-8d02-4499-b79a-237b952bbc45 tempest-ServersNegativeTestJSON-36159918 None] Lock "cinder-4521d089-5c9c-4eba-a201-d8852be33cfb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:10:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9321e252-8d02-4499-b79a-237b952bbc45 tempest-ServersNegativeTestJSON-36159918 None] Acquiring lock "cinder-quobyte-4521d089-5c9c-4eba-a201-d8852be33cfb" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:10:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9321e252-8d02-4499-b79a-237b952bbc45 tempest-ServersNegativeTestJSON-36159918 None] Lock "cinder-quobyte-4521d089-5c9c-4eba-a201-d8852be33cfb" acquired by "delete_volume" :: waited 0.015s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:10:19 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9192d0ac-1323-4482-9dcd-49c7d5680b1b]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:10:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9321e252-8d02-4499-b79a-237b952bbc45 tempest-ServersNegativeTestJSON-36159918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-4521d089-5c9c-4eba-a201-d8852be33cfb {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:10:19 devstack sudo[92380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-4521d089-5c9c-4eba-a201-d8852be33cfb
Nov 05 19:10:19 devstack sudo[92380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:10:20 devstack sudo[92380]: pam_unix(sudo:session): session closed for user root
Nov 05 19:10:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9321e252-8d02-4499-b79a-237b952bbc45 tempest-ServersNegativeTestJSON-36159918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-4521d089-5c9c-4eba-a201-d8852be33cfb" returned: 0 in 0.357s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:10:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9321e252-8d02-4499-b79a-237b952bbc45 tempest-ServersNegativeTestJSON-36159918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-4521d089-5c9c-4eba-a201-d8852be33cfb {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:10:20 devstack sudo[92385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-4521d089-5c9c-4eba-a201-d8852be33cfb
Nov 05 19:10:20 devstack sudo[92385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:10:20 devstack sudo[92385]: pam_unix(sudo:session): session closed for user root
Nov 05 19:10:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9321e252-8d02-4499-b79a-237b952bbc45 tempest-ServersNegativeTestJSON-36159918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-4521d089-5c9c-4eba-a201-d8852be33cfb" returned: 0 in 0.265s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:10:20 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9321e252-8d02-4499-b79a-237b952bbc45 tempest-ServersNegativeTestJSON-36159918 None] Lock "cinder-quobyte-4521d089-5c9c-4eba-a201-d8852be33cfb" released by "delete_volume" :: held 0.681s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:10:20 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-9321e252-8d02-4499-b79a-237b952bbc45 tempest-ServersNegativeTestJSON-36159918 None] Created reservations ['25264ad8-9ac9-414e-931d-c5d4bc881117', '9cbf9609-9094-43fb-86fc-b7e294a8ca11', '8f31b7f0-abce-4a5f-9ae0-05c619a6175b', 'bd4fea73-98c6-4fc9-af19-0fb659898883'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:10:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9321e252-8d02-4499-b79a-237b952bbc45 tempest-ServersNegativeTestJSON-36159918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:10:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9321e252-8d02-4499-b79a-237b952bbc45 tempest-ServersNegativeTestJSON-36159918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:10:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9321e252-8d02-4499-b79a-237b952bbc45 tempest-ServersNegativeTestJSON-36159918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:10:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9321e252-8d02-4499-b79a-237b952bbc45 tempest-ServersNegativeTestJSON-36159918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:10:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9321e252-8d02-4499-b79a-237b952bbc45 tempest-ServersNegativeTestJSON-36159918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:10:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9321e252-8d02-4499-b79a-237b952bbc45 tempest-ServersNegativeTestJSON-36159918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:10:20 devstack sudo[92388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:10:20 devstack sudo[92388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:10:20 devstack sudo[92388]: pam_unix(sudo:session): session closed for user root
Nov 05 19:10:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9321e252-8d02-4499-b79a-237b952bbc45 tempest-ServersNegativeTestJSON-36159918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.289s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:10:20 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-9321e252-8d02-4499-b79a-237b952bbc45 tempest-ServersNegativeTestJSON-36159918 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:10:20 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fd73372b-e650-49bf-ba87-8692d4726e4d tempest-ServersNegativeTestJSON-36159918 None] Acquiring lock "cinder-9f2b317b-c0d6-4f26-9794-049146c2a3e1-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:10:20 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-9321e252-8d02-4499-b79a-237b952bbc45 tempest-ServersNegativeTestJSON-36159918 None] Deleted volume successfully.
Nov 05 19:10:20 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9321e252-8d02-4499-b79a-237b952bbc45 tempest-ServersNegativeTestJSON-36159918 None] Lock "cinder-4521d089-5c9c-4eba-a201-d8852be33cfb-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:10:20 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fd73372b-e650-49bf-ba87-8692d4726e4d tempest-ServersNegativeTestJSON-36159918 None] Lock "cinder-9f2b317b-c0d6-4f26-9794-049146c2a3e1-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:10:20 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-8fa5958c-6412-45e5-826a-7aa62440c8da tempest-GroupsTest-1405641847 None] Group tempest-GroupsTest-Group-32133660: creating
Nov 05 19:10:21 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-8fa5958c-6412-45e5-826a-7aa62440c8da tempest-GroupsTest-1405641847 None] Group tempest-GroupsTest-Group-32133660: created successfully
Nov 05 19:10:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fd73372b-e650-49bf-ba87-8692d4726e4d tempest-ServersNegativeTestJSON-36159918 None] Acquiring lock "cinder-quobyte-9f2b317b-c0d6-4f26-9794-049146c2a3e1" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:10:21 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-8fa5958c-6412-45e5-826a-7aa62440c8da tempest-GroupsTest-1405641847 None] Create group completed successfully.
Nov 05 19:10:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fd73372b-e650-49bf-ba87-8692d4726e4d tempest-ServersNegativeTestJSON-36159918 None] Lock "cinder-quobyte-9f2b317b-c0d6-4f26-9794-049146c2a3e1" acquired by "delete_volume" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:10:21 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4592e255-96a8-4113-8dfd-8c65fc3db171]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:10:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fd73372b-e650-49bf-ba87-8692d4726e4d tempest-ServersNegativeTestJSON-36159918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9f2b317b-c0d6-4f26-9794-049146c2a3e1 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:10:21 devstack sudo[92393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9f2b317b-c0d6-4f26-9794-049146c2a3e1
Nov 05 19:10:21 devstack sudo[92393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:10:21 devstack sudo[92393]: pam_unix(sudo:session): session closed for user root
Nov 05 19:10:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fd73372b-e650-49bf-ba87-8692d4726e4d tempest-ServersNegativeTestJSON-36159918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9f2b317b-c0d6-4f26-9794-049146c2a3e1" returned: 0 in 0.460s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:10:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fd73372b-e650-49bf-ba87-8692d4726e4d tempest-ServersNegativeTestJSON-36159918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9f2b317b-c0d6-4f26-9794-049146c2a3e1 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:10:21 devstack sudo[92401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9f2b317b-c0d6-4f26-9794-049146c2a3e1
Nov 05 19:10:21 devstack sudo[92401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:10:21 devstack sudo[92401]: pam_unix(sudo:session): session closed for user root
Nov 05 19:10:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fd73372b-e650-49bf-ba87-8692d4726e4d tempest-ServersNegativeTestJSON-36159918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9f2b317b-c0d6-4f26-9794-049146c2a3e1" returned: 0 in 0.316s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:10:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fd73372b-e650-49bf-ba87-8692d4726e4d tempest-ServersNegativeTestJSON-36159918 None] Lock "cinder-quobyte-9f2b317b-c0d6-4f26-9794-049146c2a3e1" released by "delete_volume" :: held 0.832s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:10:21 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-fd73372b-e650-49bf-ba87-8692d4726e4d tempest-ServersNegativeTestJSON-36159918 None] Created reservations ['c8fc12b1-ce70-4ec0-879a-dbc6637391fa', '17d297f5-0616-4396-9325-1ededacf3018', '32e4e04a-eedc-452a-93c3-69c1b5c9231f', 'd61843f4-c868-4053-8d92-313ef7ea1fb9'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:10:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fd73372b-e650-49bf-ba87-8692d4726e4d tempest-ServersNegativeTestJSON-36159918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:10:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fd73372b-e650-49bf-ba87-8692d4726e4d tempest-ServersNegativeTestJSON-36159918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:10:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fd73372b-e650-49bf-ba87-8692d4726e4d tempest-ServersNegativeTestJSON-36159918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:10:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fd73372b-e650-49bf-ba87-8692d4726e4d tempest-ServersNegativeTestJSON-36159918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:10:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fd73372b-e650-49bf-ba87-8692d4726e4d tempest-ServersNegativeTestJSON-36159918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:10:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fd73372b-e650-49bf-ba87-8692d4726e4d tempest-ServersNegativeTestJSON-36159918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:10:22 devstack sudo[92408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:10:22 devstack sudo[92408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:10:22 devstack sudo[92408]: pam_unix(sudo:session): session closed for user root
Nov 05 19:10:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fd73372b-e650-49bf-ba87-8692d4726e4d tempest-ServersNegativeTestJSON-36159918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.681s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:10:22 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-fd73372b-e650-49bf-ba87-8692d4726e4d tempest-ServersNegativeTestJSON-36159918 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:10:22 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-fd73372b-e650-49bf-ba87-8692d4726e4d tempest-ServersNegativeTestJSON-36159918 None] Deleted volume successfully.
Nov 05 19:10:22 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fd73372b-e650-49bf-ba87-8692d4726e4d tempest-ServersNegativeTestJSON-36159918 None] Lock "cinder-9f2b317b-c0d6-4f26-9794-049146c2a3e1-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:10:22 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-71c37ce7-d685-40d1-ae84-92642852cce9 tempest-GroupsTest-1405641847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:10:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-71c37ce7-d685-40d1-ae84-92642852cce9 tempest-GroupsTest-1405641847 None] Flow 'volume_create_manager' (efc8b3a8-2a6d-4adf-8738-4c013fb4b0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:10:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-71c37ce7-d685-40d1-ae84-92642852cce9 tempest-GroupsTest-1405641847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a02c100-76ee-41b5-8ce8-f424c8ec11a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:10:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-71c37ce7-d685-40d1-ae84-92642852cce9 tempest-GroupsTest-1405641847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a02c100-76ee-41b5-8ce8-f424c8ec11a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1801273832',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=195c9e66-fc25-42f5-bde1-cec9afe28344,host='devstack@QuobyteHD#QuobyteHD',id=de492e13-7012-4f40-b4b6-5dfbe7361001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aac9fa8eda44f16b653749e907496f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:10:23Z,use_quota=True,user_id='11c30d2454d444f6931c184280be74df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb408b63-5c47-49c3-9148-4cbd6d03a13e),volume_type_id=eb408b63-5c47-49c3-9148-4cbd6d03a13e)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:10:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-71c37ce7-d685-40d1-ae84-92642852cce9 tempest-GroupsTest-1405641847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (143dc4a9-6d98-4b6c-920e-88109d3b8a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:10:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-71c37ce7-d685-40d1-ae84-92642852cce9 tempest-GroupsTest-1405641847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (143dc4a9-6d98-4b6c-920e-88109d3b8a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:10:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-71c37ce7-d685-40d1-ae84-92642852cce9 tempest-GroupsTest-1405641847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b38377-e2ef-430e-bbc1-7e1c6b149ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:10:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-71c37ce7-d685-40d1-ae84-92642852cce9 tempest-GroupsTest-1405641847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b38377-e2ef-430e-bbc1-7e1c6b149ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de492e13-7012-4f40-b4b6-5dfbe7361001', 'volume_name': 'volume-de492e13-7012-4f40-b4b6-5dfbe7361001', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:10:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-71c37ce7-d685-40d1-ae84-92642852cce9 tempest-GroupsTest-1405641847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f06cf18-184f-48a2-8345-d931fa4c602c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:10:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-71c37ce7-d685-40d1-ae84-92642852cce9 tempest-GroupsTest-1405641847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f06cf18-184f-48a2-8345-d931fa4c602c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:10:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-71c37ce7-d685-40d1-ae84-92642852cce9 tempest-GroupsTest-1405641847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eef78da2-15d1-4c78-bc39-266fcb040a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:10:23 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-71c37ce7-d685-40d1-ae84-92642852cce9 tempest-GroupsTest-1405641847 None] Volume de492e13-7012-4f40-b4b6-5dfbe7361001: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de492e13-7012-4f40-b4b6-5dfbe7361001', 'volume_size': 1}
Nov 05 19:10:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-71c37ce7-d685-40d1-ae84-92642852cce9 tempest-GroupsTest-1405641847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:10:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-71c37ce7-d685-40d1-ae84-92642852cce9 tempest-GroupsTest-1405641847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:10:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-71c37ce7-d685-40d1-ae84-92642852cce9 tempest-GroupsTest-1405641847 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=195c9e66-fc25-42f5-bde1-cec9afe28344,created_at=2026-11-05T18:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1801273832',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=195c9e66-fc25-42f5-bde1-cec9afe28344,host='devstack@QuobyteHD#QuobyteHD',id=de492e13-7012-4f40-b4b6-5dfbe7361001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aac9fa8eda44f16b653749e907496f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:10:23Z,use_quota=True,user_id='11c30d2454d444f6931c184280be74df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb408b63-5c47-49c3-9148-4cbd6d03a13e),volume_type_id=eb408b63-5c47-49c3-9148-4cbd6d03a13e)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:10:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-71c37ce7-d685-40d1-ae84-92642852cce9 tempest-GroupsTest-1405641847 None] Creating volume de492e13-7012-4f40-b4b6-5dfbe7361001 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:10:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-71c37ce7-d685-40d1-ae84-92642852cce9 tempest-GroupsTest-1405641847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:10:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-71c37ce7-d685-40d1-ae84-92642852cce9 tempest-GroupsTest-1405641847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:10:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-71c37ce7-d685-40d1-ae84-92642852cce9 tempest-GroupsTest-1405641847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:10:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-71c37ce7-d685-40d1-ae84-92642852cce9 tempest-GroupsTest-1405641847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:10:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-71c37ce7-d685-40d1-ae84-92642852cce9 tempest-GroupsTest-1405641847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:10:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-71c37ce7-d685-40d1-ae84-92642852cce9 tempest-GroupsTest-1405641847 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:10:23 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-71c37ce7-d685-40d1-ae84-92642852cce9 tempest-GroupsTest-1405641847 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:10:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-71c37ce7-d685-40d1-ae84-92642852cce9 tempest-GroupsTest-1405641847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de492e13-7012-4f40-b4b6-5dfbe7361001 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:10:23 devstack sudo[92437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de492e13-7012-4f40-b4b6-5dfbe7361001 1073741824
Nov 05 19:10:23 devstack sudo[92437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:10:23 devstack sudo[92437]: pam_unix(sudo:session): session closed for user root
Nov 05 19:10:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-71c37ce7-d685-40d1-ae84-92642852cce9 tempest-GroupsTest-1405641847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de492e13-7012-4f40-b4b6-5dfbe7361001 1073741824" returned: 0 in 0.731s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:10:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-71c37ce7-d685-40d1-ae84-92642852cce9 tempest-GroupsTest-1405641847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de492e13-7012-4f40-b4b6-5dfbe7361001 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:10:23 devstack sudo[92459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de492e13-7012-4f40-b4b6-5dfbe7361001
Nov 05 19:10:23 devstack sudo[92459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:10:24 devstack sudo[92459]: pam_unix(sudo:session): session closed for user root
Nov 05 19:10:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-71c37ce7-d685-40d1-ae84-92642852cce9 tempest-GroupsTest-1405641847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de492e13-7012-4f40-b4b6-5dfbe7361001" returned: 0 in 0.301s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:10:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-71c37ce7-d685-40d1-ae84-92642852cce9 tempest-GroupsTest-1405641847 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:10:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-71c37ce7-d685-40d1-ae84-92642852cce9 tempest-GroupsTest-1405641847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:10:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-71c37ce7-d685-40d1-ae84-92642852cce9 tempest-GroupsTest-1405641847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eef78da2-15d1-4c78-bc39-266fcb040a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de492e13-7012-4f40-b4b6-5dfbe7361001', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:10:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-71c37ce7-d685-40d1-ae84-92642852cce9 tempest-GroupsTest-1405641847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d396af-99b0-4c7a-9579-14648064643a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:10:24 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-71c37ce7-d685-40d1-ae84-92642852cce9 tempest-GroupsTest-1405641847 None] Volume volume-de492e13-7012-4f40-b4b6-5dfbe7361001 (de492e13-7012-4f40-b4b6-5dfbe7361001): created successfully
Nov 05 19:10:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-71c37ce7-d685-40d1-ae84-92642852cce9 tempest-GroupsTest-1405641847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d396af-99b0-4c7a-9579-14648064643a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:10:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-71c37ce7-d685-40d1-ae84-92642852cce9 tempest-GroupsTest-1405641847 None] Flow 'volume_create_manager' (efc8b3a8-2a6d-4adf-8738-4c013fb4b0f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:10:24 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-71c37ce7-d685-40d1-ae84-92642852cce9 tempest-GroupsTest-1405641847 None] Created volume successfully.
Nov 05 19:10:24 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-e8ad2cc7-6865-46f2-af98-d0a627cf25d4 req-5ec80fd5-495b-405c-b9e2-b36733e388ad tempest-ServerActionsTestOtherA-1201227496 None] Terminate volume connection completed successfully.
Nov 05 19:10:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-e8ad2cc7-6865-46f2-af98-d0a627cf25d4 req-5ec80fd5-495b-405c-b9e2-b36733e388ad tempest-ServerActionsTestOtherA-1201227496 None] Deleting attachment a712dfff-6bb8-49be-8c94-fa748884d7ba. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 19:10:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-e8ad2cc7-6865-46f2-af98-d0a627cf25d4 req-d3e2acc2-7535-445f-8077-16a9d817e1dd tempest-ServerActionsTestOtherA-1201227496 None] Acquiring lock "cinder-e96d910b-0ace-4196-9a8b-5c14b5946d88-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:10:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-e8ad2cc7-6865-46f2-af98-d0a627cf25d4 req-d3e2acc2-7535-445f-8077-16a9d817e1dd tempest-ServerActionsTestOtherA-1201227496 None] Lock "cinder-e96d910b-0ace-4196-9a8b-5c14b5946d88-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:10:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-e8ad2cc7-6865-46f2-af98-d0a627cf25d4 req-d3e2acc2-7535-445f-8077-16a9d817e1dd tempest-ServerActionsTestOtherA-1201227496 None] Acquiring lock "cinder-quobyte-e96d910b-0ace-4196-9a8b-5c14b5946d88" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:10:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-e8ad2cc7-6865-46f2-af98-d0a627cf25d4 req-d3e2acc2-7535-445f-8077-16a9d817e1dd tempest-ServerActionsTestOtherA-1201227496 None] Lock "cinder-quobyte-e96d910b-0ace-4196-9a8b-5c14b5946d88" acquired by "delete_volume" :: waited 0.026s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:10:24 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[820d7c36-958d-4c14-b3af-17ad5bc5a49b]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:10:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-e8ad2cc7-6865-46f2-af98-d0a627cf25d4 req-d3e2acc2-7535-445f-8077-16a9d817e1dd tempest-ServerActionsTestOtherA-1201227496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e96d910b-0ace-4196-9a8b-5c14b5946d88 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:10:24 devstack sudo[92466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e96d910b-0ace-4196-9a8b-5c14b5946d88
Nov 05 19:10:24 devstack sudo[92466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:10:25 devstack sudo[92466]: pam_unix(sudo:session): session closed for user root
Nov 05 19:10:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-e8ad2cc7-6865-46f2-af98-d0a627cf25d4 req-d3e2acc2-7535-445f-8077-16a9d817e1dd tempest-ServerActionsTestOtherA-1201227496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e96d910b-0ace-4196-9a8b-5c14b5946d88" returned: 0 in 0.412s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:10:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-e8ad2cc7-6865-46f2-af98-d0a627cf25d4 req-d3e2acc2-7535-445f-8077-16a9d817e1dd tempest-ServerActionsTestOtherA-1201227496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e96d910b-0ace-4196-9a8b-5c14b5946d88 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:10:25 devstack sudo[92471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e96d910b-0ace-4196-9a8b-5c14b5946d88
Nov 05 19:10:25 devstack sudo[92471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:10:25 devstack sudo[92471]: pam_unix(sudo:session): session closed for user root
Nov 05 19:10:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-e8ad2cc7-6865-46f2-af98-d0a627cf25d4 req-d3e2acc2-7535-445f-8077-16a9d817e1dd tempest-ServerActionsTestOtherA-1201227496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e96d910b-0ace-4196-9a8b-5c14b5946d88" returned: 0 in 0.257s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:10:25 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-e8ad2cc7-6865-46f2-af98-d0a627cf25d4 req-d3e2acc2-7535-445f-8077-16a9d817e1dd tempest-ServerActionsTestOtherA-1201227496 None] Lock "cinder-quobyte-e96d910b-0ace-4196-9a8b-5c14b5946d88" released by "delete_volume" :: held 0.733s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:10:25 devstack cinder-volume[87184]: DEBUG cinder.quota [req-e8ad2cc7-6865-46f2-af98-d0a627cf25d4 req-d3e2acc2-7535-445f-8077-16a9d817e1dd tempest-ServerActionsTestOtherA-1201227496 None] Created reservations ['ba8a1e86-41a0-4e9d-afea-3311cd1f9204', '3ddad3e0-8510-42e4-8fb4-b109eb275133', '46da6907-b7af-47f1-90f1-db328698513b', 'a2ad58a5-6d27-4d6f-b403-7a05b95339c7'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:10:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-e8ad2cc7-6865-46f2-af98-d0a627cf25d4 req-d3e2acc2-7535-445f-8077-16a9d817e1dd tempest-ServerActionsTestOtherA-1201227496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:10:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-e8ad2cc7-6865-46f2-af98-d0a627cf25d4 req-d3e2acc2-7535-445f-8077-16a9d817e1dd tempest-ServerActionsTestOtherA-1201227496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:10:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [req-e8ad2cc7-6865-46f2-af98-d0a627cf25d4 req-d3e2acc2-7535-445f-8077-16a9d817e1dd tempest-ServerActionsTestOtherA-1201227496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:10:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [req-e8ad2cc7-6865-46f2-af98-d0a627cf25d4 req-d3e2acc2-7535-445f-8077-16a9d817e1dd tempest-ServerActionsTestOtherA-1201227496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:10:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-e8ad2cc7-6865-46f2-af98-d0a627cf25d4 req-d3e2acc2-7535-445f-8077-16a9d817e1dd tempest-ServerActionsTestOtherA-1201227496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:10:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-e8ad2cc7-6865-46f2-af98-d0a627cf25d4 req-d3e2acc2-7535-445f-8077-16a9d817e1dd tempest-ServerActionsTestOtherA-1201227496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:10:25 devstack sudo[92474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:10:25 devstack sudo[92474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:10:25 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2d90004-e7e2-44a7-81cd-365617817f92 tempest-GroupsTest-1405641847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:10:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b2d90004-e7e2-44a7-81cd-365617817f92 tempest-GroupsTest-1405641847 None] Flow 'volume_create_manager' (a8b1b68c-21c6-4a24-b837-14df658675dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:10:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b2d90004-e7e2-44a7-81cd-365617817f92 tempest-GroupsTest-1405641847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69444698-46c4-46c8-8cf8-f964a20bc0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:10:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c6e81adc-0dc6-4e9f-acd9-08d30be30ffc tempest-ServerActionsTestOtherA-1201227496 None] Acquiring lock "cinder-d9c78cd6-0fef-4f57-8c93-e32f92c3e52f-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:10:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b2d90004-e7e2-44a7-81cd-365617817f92 tempest-GroupsTest-1405641847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69444698-46c4-46c8-8cf8-f964a20bc0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1525057314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=195c9e66-fc25-42f5-bde1-cec9afe28344,host='devstack@QuobyteHD#QuobyteHD',id=431149b4-723b-4109-bf32-3a1539ba499c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aac9fa8eda44f16b653749e907496f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:10:26Z,use_quota=True,user_id='11c30d2454d444f6931c184280be74df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb408b63-5c47-49c3-9148-4cbd6d03a13e),volume_type_id=eb408b63-5c47-49c3-9148-4cbd6d03a13e)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:10:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b2d90004-e7e2-44a7-81cd-365617817f92 tempest-GroupsTest-1405641847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d8d86dd-0b68-4c7e-899e-9347f214c5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:10:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b2d90004-e7e2-44a7-81cd-365617817f92 tempest-GroupsTest-1405641847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d8d86dd-0b68-4c7e-899e-9347f214c5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:10:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b2d90004-e7e2-44a7-81cd-365617817f92 tempest-GroupsTest-1405641847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d165b9e-2ba0-4ea8-8d12-866f31d2523b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:10:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b2d90004-e7e2-44a7-81cd-365617817f92 tempest-GroupsTest-1405641847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d165b9e-2ba0-4ea8-8d12-866f31d2523b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '431149b4-723b-4109-bf32-3a1539ba499c', 'volume_name': 'volume-431149b4-723b-4109-bf32-3a1539ba499c', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:10:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b2d90004-e7e2-44a7-81cd-365617817f92 tempest-GroupsTest-1405641847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7d19955-6846-42a8-84a4-c70165eb1376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:10:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b2d90004-e7e2-44a7-81cd-365617817f92 tempest-GroupsTest-1405641847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7d19955-6846-42a8-84a4-c70165eb1376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:10:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b2d90004-e7e2-44a7-81cd-365617817f92 tempest-GroupsTest-1405641847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b3688da-5b18-488b-9ce6-ba54fd25790e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:10:26 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-b2d90004-e7e2-44a7-81cd-365617817f92 tempest-GroupsTest-1405641847 None] Volume 431149b4-723b-4109-bf32-3a1539ba499c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-431149b4-723b-4109-bf32-3a1539ba499c', 'volume_size': 1}
Nov 05 19:10:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b2d90004-e7e2-44a7-81cd-365617817f92 tempest-GroupsTest-1405641847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:10:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b2d90004-e7e2-44a7-81cd-365617817f92 tempest-GroupsTest-1405641847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:10:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b2d90004-e7e2-44a7-81cd-365617817f92 tempest-GroupsTest-1405641847 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=195c9e66-fc25-42f5-bde1-cec9afe28344,created_at=2026-11-05T18:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1525057314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=195c9e66-fc25-42f5-bde1-cec9afe28344,host='devstack@QuobyteHD#QuobyteHD',id=431149b4-723b-4109-bf32-3a1539ba499c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aac9fa8eda44f16b653749e907496f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:10:26Z,use_quota=True,user_id='11c30d2454d444f6931c184280be74df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb408b63-5c47-49c3-9148-4cbd6d03a13e),volume_type_id=eb408b63-5c47-49c3-9148-4cbd6d03a13e)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:10:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-b2d90004-e7e2-44a7-81cd-365617817f92 tempest-GroupsTest-1405641847 None] Creating volume 431149b4-723b-4109-bf32-3a1539ba499c {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:10:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b2d90004-e7e2-44a7-81cd-365617817f92 tempest-GroupsTest-1405641847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:10:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b2d90004-e7e2-44a7-81cd-365617817f92 tempest-GroupsTest-1405641847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:10:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b2d90004-e7e2-44a7-81cd-365617817f92 tempest-GroupsTest-1405641847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:10:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b2d90004-e7e2-44a7-81cd-365617817f92 tempest-GroupsTest-1405641847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:10:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b2d90004-e7e2-44a7-81cd-365617817f92 tempest-GroupsTest-1405641847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:10:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b2d90004-e7e2-44a7-81cd-365617817f92 tempest-GroupsTest-1405641847 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:10:26 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-b2d90004-e7e2-44a7-81cd-365617817f92 tempest-GroupsTest-1405641847 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:10:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b2d90004-e7e2-44a7-81cd-365617817f92 tempest-GroupsTest-1405641847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-431149b4-723b-4109-bf32-3a1539ba499c 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:10:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c6e81adc-0dc6-4e9f-acd9-08d30be30ffc tempest-ServerActionsTestOtherA-1201227496 None] Lock "cinder-d9c78cd6-0fef-4f57-8c93-e32f92c3e52f-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:10:26 devstack sudo[92474]: pam_unix(sudo:session): session closed for user root
Nov 05 19:10:26 devstack sudo[92477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-431149b4-723b-4109-bf32-3a1539ba499c 1073741824
Nov 05 19:10:26 devstack sudo[92477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:10:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-e8ad2cc7-6865-46f2-af98-d0a627cf25d4 req-d3e2acc2-7535-445f-8077-16a9d817e1dd tempest-ServerActionsTestOtherA-1201227496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.448s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:10:26 devstack cinder-volume[87184]: DEBUG cinder.manager [req-e8ad2cc7-6865-46f2-af98-d0a627cf25d4 req-d3e2acc2-7535-445f-8077-16a9d817e1dd tempest-ServerActionsTestOtherA-1201227496 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:10:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c6e81adc-0dc6-4e9f-acd9-08d30be30ffc tempest-ServerActionsTestOtherA-1201227496 None] Acquiring lock "cinder-quobyte-d9c78cd6-0fef-4f57-8c93-e32f92c3e52f" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:10:26 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-e8ad2cc7-6865-46f2-af98-d0a627cf25d4 req-d3e2acc2-7535-445f-8077-16a9d817e1dd tempest-ServerActionsTestOtherA-1201227496 None] Deleted volume successfully.
Nov 05 19:10:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c6e81adc-0dc6-4e9f-acd9-08d30be30ffc tempest-ServerActionsTestOtherA-1201227496 None] Lock "cinder-quobyte-d9c78cd6-0fef-4f57-8c93-e32f92c3e52f" acquired by "delete_volume" :: waited 0.027s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:10:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-e8ad2cc7-6865-46f2-af98-d0a627cf25d4 req-d3e2acc2-7535-445f-8077-16a9d817e1dd tempest-ServerActionsTestOtherA-1201227496 None] Lock "cinder-e96d910b-0ace-4196-9a8b-5c14b5946d88-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:10:26 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e9b841-c9a2-4e44-90c1-141797e5d92d]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:10:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c6e81adc-0dc6-4e9f-acd9-08d30be30ffc tempest-ServerActionsTestOtherA-1201227496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d9c78cd6-0fef-4f57-8c93-e32f92c3e52f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:10:26 devstack sudo[92479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d9c78cd6-0fef-4f57-8c93-e32f92c3e52f
Nov 05 19:10:26 devstack sudo[92479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:10:26 devstack sudo[92477]: pam_unix(sudo:session): session closed for user root
Nov 05 19:10:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b2d90004-e7e2-44a7-81cd-365617817f92 tempest-GroupsTest-1405641847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-431149b4-723b-4109-bf32-3a1539ba499c 1073741824" returned: 0 in 0.535s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:10:26 devstack sudo[92479]: pam_unix(sudo:session): session closed for user root
Nov 05 19:10:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c6e81adc-0dc6-4e9f-acd9-08d30be30ffc tempest-ServerActionsTestOtherA-1201227496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d9c78cd6-0fef-4f57-8c93-e32f92c3e52f" returned: 0 in 0.438s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:10:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c6e81adc-0dc6-4e9f-acd9-08d30be30ffc tempest-ServerActionsTestOtherA-1201227496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d9c78cd6-0fef-4f57-8c93-e32f92c3e52f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:10:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b2d90004-e7e2-44a7-81cd-365617817f92 tempest-GroupsTest-1405641847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-431149b4-723b-4109-bf32-3a1539ba499c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:10:26 devstack sudo[92489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d9c78cd6-0fef-4f57-8c93-e32f92c3e52f
Nov 05 19:10:26 devstack sudo[92489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:10:26 devstack sudo[92490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-431149b4-723b-4109-bf32-3a1539ba499c
Nov 05 19:10:26 devstack sudo[92490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:10:26 devstack sudo[92490]: pam_unix(sudo:session): session closed for user root
Nov 05 19:10:26 devstack sudo[92489]: pam_unix(sudo:session): session closed for user root
Nov 05 19:10:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b2d90004-e7e2-44a7-81cd-365617817f92 tempest-GroupsTest-1405641847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-431149b4-723b-4109-bf32-3a1539ba499c" returned: 0 in 0.247s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:10:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b2d90004-e7e2-44a7-81cd-365617817f92 tempest-GroupsTest-1405641847 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:10:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b2d90004-e7e2-44a7-81cd-365617817f92 tempest-GroupsTest-1405641847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:10:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c6e81adc-0dc6-4e9f-acd9-08d30be30ffc tempest-ServerActionsTestOtherA-1201227496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d9c78cd6-0fef-4f57-8c93-e32f92c3e52f" returned: 0 in 0.268s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:10:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b2d90004-e7e2-44a7-81cd-365617817f92 tempest-GroupsTest-1405641847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b3688da-5b18-488b-9ce6-ba54fd25790e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-431149b4-723b-4109-bf32-3a1539ba499c', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:10:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b2d90004-e7e2-44a7-81cd-365617817f92 tempest-GroupsTest-1405641847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea6faa5e-8d8b-4255-9f35-64ee4b020fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:10:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c6e81adc-0dc6-4e9f-acd9-08d30be30ffc tempest-ServerActionsTestOtherA-1201227496 None] Lock "cinder-quobyte-d9c78cd6-0fef-4f57-8c93-e32f92c3e52f" released by "delete_volume" :: held 0.765s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:10:26 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-b2d90004-e7e2-44a7-81cd-365617817f92 tempest-GroupsTest-1405641847 None] Volume volume-431149b4-723b-4109-bf32-3a1539ba499c (431149b4-723b-4109-bf32-3a1539ba499c): created successfully
Nov 05 19:10:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b2d90004-e7e2-44a7-81cd-365617817f92 tempest-GroupsTest-1405641847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea6faa5e-8d8b-4255-9f35-64ee4b020fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:10:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b2d90004-e7e2-44a7-81cd-365617817f92 tempest-GroupsTest-1405641847 None] Flow 'volume_create_manager' (a8b1b68c-21c6-4a24-b837-14df658675dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:10:27 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b2d90004-e7e2-44a7-81cd-365617817f92 tempest-GroupsTest-1405641847 None] Created volume successfully.
Nov 05 19:10:27 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-c6e81adc-0dc6-4e9f-acd9-08d30be30ffc tempest-ServerActionsTestOtherA-1201227496 None] Created reservations ['d9a7329a-e377-409b-a21e-07760a356b2f', '3f3f94cc-73ee-49e0-af61-db29f8e3a887', 'eac51178-6601-4fad-82fd-c3490714a633', '98e5069e-d67c-4114-9179-375386367ecd'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:10:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c6e81adc-0dc6-4e9f-acd9-08d30be30ffc tempest-ServerActionsTestOtherA-1201227496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:10:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c6e81adc-0dc6-4e9f-acd9-08d30be30ffc tempest-ServerActionsTestOtherA-1201227496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:10:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c6e81adc-0dc6-4e9f-acd9-08d30be30ffc tempest-ServerActionsTestOtherA-1201227496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:10:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c6e81adc-0dc6-4e9f-acd9-08d30be30ffc tempest-ServerActionsTestOtherA-1201227496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:10:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c6e81adc-0dc6-4e9f-acd9-08d30be30ffc tempest-ServerActionsTestOtherA-1201227496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:10:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c6e81adc-0dc6-4e9f-acd9-08d30be30ffc tempest-ServerActionsTestOtherA-1201227496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:10:27 devstack sudo[92495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:10:27 devstack sudo[92495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:10:27 devstack sudo[92495]: pam_unix(sudo:session): session closed for user root
Nov 05 19:10:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c6e81adc-0dc6-4e9f-acd9-08d30be30ffc tempest-ServerActionsTestOtherA-1201227496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.396s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:10:27 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-c6e81adc-0dc6-4e9f-acd9-08d30be30ffc tempest-ServerActionsTestOtherA-1201227496 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:10:27 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-c6e81adc-0dc6-4e9f-acd9-08d30be30ffc tempest-ServerActionsTestOtherA-1201227496 None] Deleted volume successfully.
Nov 05 19:10:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c6e81adc-0dc6-4e9f-acd9-08d30be30ffc tempest-ServerActionsTestOtherA-1201227496 None] Lock "cinder-d9c78cd6-0fef-4f57-8c93-e32f92c3e52f-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:10:27 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-3690dc7f-1aee-4f63-9945-27dbd27fdd42 tempest-GroupsTest-1405641847 None] Update group completed successfully.
Nov 05 19:10:29 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-77397cbe-90ea-4dee-97d9-8709b7828e61 tempest-GroupsTest-1405641847 None] Update group completed successfully.
Nov 05 19:10:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-52b02660-526b-40ec-8fac-e6fd4e2274a1 tempest-GroupsTest-1405641847 None] Acquiring lock "cinder-quobyte-431149b4-723b-4109-bf32-3a1539ba499c" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:10:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-52b02660-526b-40ec-8fac-e6fd4e2274a1 tempest-GroupsTest-1405641847 None] Lock "cinder-quobyte-431149b4-723b-4109-bf32-3a1539ba499c" acquired by "delete_volume" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:10:30 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cbcbf6-7f9f-4989-8628-91161ec66d19]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:10:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-52b02660-526b-40ec-8fac-e6fd4e2274a1 tempest-GroupsTest-1405641847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-431149b4-723b-4109-bf32-3a1539ba499c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:10:31 devstack sudo[92524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-431149b4-723b-4109-bf32-3a1539ba499c
Nov 05 19:10:31 devstack sudo[92524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:10:31 devstack sudo[92524]: pam_unix(sudo:session): session closed for user root
Nov 05 19:10:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-52b02660-526b-40ec-8fac-e6fd4e2274a1 tempest-GroupsTest-1405641847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-431149b4-723b-4109-bf32-3a1539ba499c" returned: 0 in 0.427s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:10:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-52b02660-526b-40ec-8fac-e6fd4e2274a1 tempest-GroupsTest-1405641847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-431149b4-723b-4109-bf32-3a1539ba499c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:10:31 devstack sudo[92531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-431149b4-723b-4109-bf32-3a1539ba499c
Nov 05 19:10:31 devstack sudo[92531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:10:31 devstack sudo[92531]: pam_unix(sudo:session): session closed for user root
Nov 05 19:10:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-52b02660-526b-40ec-8fac-e6fd4e2274a1 tempest-GroupsTest-1405641847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-431149b4-723b-4109-bf32-3a1539ba499c" returned: 0 in 0.461s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:10:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-52b02660-526b-40ec-8fac-e6fd4e2274a1 tempest-GroupsTest-1405641847 None] Lock "cinder-quobyte-431149b4-723b-4109-bf32-3a1539ba499c" released by "delete_volume" :: held 0.947s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:10:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-52b02660-526b-40ec-8fac-e6fd4e2274a1 tempest-GroupsTest-1405641847 None] Acquiring lock "cinder-quobyte-de492e13-7012-4f40-b4b6-5dfbe7361001" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:10:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-52b02660-526b-40ec-8fac-e6fd4e2274a1 tempest-GroupsTest-1405641847 None] Lock "cinder-quobyte-de492e13-7012-4f40-b4b6-5dfbe7361001" acquired by "delete_volume" :: waited 0.031s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:10:31 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0c8537-740b-4d39-b392-066c071de1e5]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:10:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-52b02660-526b-40ec-8fac-e6fd4e2274a1 tempest-GroupsTest-1405641847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de492e13-7012-4f40-b4b6-5dfbe7361001 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:10:32 devstack sudo[92536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de492e13-7012-4f40-b4b6-5dfbe7361001
Nov 05 19:10:32 devstack sudo[92536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:10:32 devstack sudo[92536]: pam_unix(sudo:session): session closed for user root
Nov 05 19:10:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-52b02660-526b-40ec-8fac-e6fd4e2274a1 tempest-GroupsTest-1405641847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de492e13-7012-4f40-b4b6-5dfbe7361001" returned: 0 in 0.677s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:10:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-52b02660-526b-40ec-8fac-e6fd4e2274a1 tempest-GroupsTest-1405641847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de492e13-7012-4f40-b4b6-5dfbe7361001 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:10:32 devstack sudo[92557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de492e13-7012-4f40-b4b6-5dfbe7361001
Nov 05 19:10:32 devstack sudo[92557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:10:32 devstack sudo[92557]: pam_unix(sudo:session): session closed for user root
Nov 05 19:10:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-52b02660-526b-40ec-8fac-e6fd4e2274a1 tempest-GroupsTest-1405641847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de492e13-7012-4f40-b4b6-5dfbe7361001" returned: 0 in 0.318s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:10:32 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-52b02660-526b-40ec-8fac-e6fd4e2274a1 tempest-GroupsTest-1405641847 None] Lock "cinder-quobyte-de492e13-7012-4f40-b4b6-5dfbe7361001" released by "delete_volume" :: held 1.054s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:10:33 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-52b02660-526b-40ec-8fac-e6fd4e2274a1 tempest-GroupsTest-1405641847 None] Created reservations ['e40fd0f1-ab30-4a98-bcdf-db42153d3e11'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:10:33 devstack cinder-volume[87184]: WARNING cinder.quota [None req-52b02660-526b-40ec-8fac-e6fd4e2274a1 tempest-GroupsTest-1405641847 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1955751740 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1955751740, it is now deprecated. Please use the default quota class for default quota.
Nov 05 19:10:33 devstack cinder-volume[87184]: WARNING cinder.quota [None req-52b02660-526b-40ec-8fac-e6fd4e2274a1 tempest-GroupsTest-1405641847 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1955751740 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1955751740, it is now deprecated. Please use the default quota class for default quota.
Nov 05 19:10:33 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-52b02660-526b-40ec-8fac-e6fd4e2274a1 tempest-GroupsTest-1405641847 None] Created reservations ['f5383803-1158-4f6f-9e94-4ec87bd4c1e7', '37e5d20b-f196-4c13-87c3-a886191c4a3a', '41d43de8-910d-4965-97ca-1f43f8a381be', '4be34e4d-c6a3-4b04-8d37-6eb016edbb92'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:10:33 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-52b02660-526b-40ec-8fac-e6fd4e2274a1 tempest-GroupsTest-1405641847 None] Created reservations ['2f4b3aa8-823c-4062-be7a-d3916f956af1', '0bf19af3-8ec4-4077-b025-3284f9e0b83e', '361f88c5-48e3-4903-b1f0-49620c2ce938', '6641691b-1808-404b-a55d-50338c4fa600'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:10:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-52b02660-526b-40ec-8fac-e6fd4e2274a1 tempest-GroupsTest-1405641847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:10:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-52b02660-526b-40ec-8fac-e6fd4e2274a1 tempest-GroupsTest-1405641847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:10:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-52b02660-526b-40ec-8fac-e6fd4e2274a1 tempest-GroupsTest-1405641847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:10:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-52b02660-526b-40ec-8fac-e6fd4e2274a1 tempest-GroupsTest-1405641847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:10:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-52b02660-526b-40ec-8fac-e6fd4e2274a1 tempest-GroupsTest-1405641847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:10:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-52b02660-526b-40ec-8fac-e6fd4e2274a1 tempest-GroupsTest-1405641847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:10:33 devstack sudo[92569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:10:33 devstack sudo[92569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:10:33 devstack sudo[92569]: pam_unix(sudo:session): session closed for user root
Nov 05 19:10:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-52b02660-526b-40ec-8fac-e6fd4e2274a1 tempest-GroupsTest-1405641847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.487s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:10:33 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-52b02660-526b-40ec-8fac-e6fd4e2274a1 tempest-GroupsTest-1405641847 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:10:33 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-52b02660-526b-40ec-8fac-e6fd4e2274a1 tempest-GroupsTest-1405641847 None] Delete group completed successfully.
Nov 05 19:10:43 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=64,cinder:UPDATE=78,cinder:INSERT=17,cinder:DELETE=5 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:10:43 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=68,cinder:UPDATE=89,cinder:INSERT=19,cinder:DELETE=4 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:10:55 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-03ec4450-1b98-487b-ab89-078bf0027c8f tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:10:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-03ec4450-1b98-487b-ab89-078bf0027c8f tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Flow 'volume_create_manager' (72c8c32b-41d2-4f2e-969f-605bf33e0be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:10:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-03ec4450-1b98-487b-ab89-078bf0027c8f tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8971bfa1-c05b-4073-b6ee-2e6d943348fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:10:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-03ec4450-1b98-487b-ab89-078bf0027c8f tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8971bfa1-c05b-4073-b6ee-2e6d943348fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2109335590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe0ed3db-aa11-41f9-881b-46c0bc0cda34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d2295ba8fe545dab4a613d12dcac927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:10:55Z,use_quota=True,user_id='add6cc7dc118451b96ce3bc663808430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:10:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-03ec4450-1b98-487b-ab89-078bf0027c8f tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82d02fca-2581-45ed-b89d-c68ffdf7ecb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:10:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-03ec4450-1b98-487b-ab89-078bf0027c8f tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82d02fca-2581-45ed-b89d-c68ffdf7ecb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:10:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-03ec4450-1b98-487b-ab89-078bf0027c8f tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5a1f086-ee7b-4e2e-bcd4-f937702a74ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:10:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-03ec4450-1b98-487b-ab89-078bf0027c8f tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5a1f086-ee7b-4e2e-bcd4-f937702a74ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe0ed3db-aa11-41f9-881b-46c0bc0cda34', 'volume_name': 'volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:10:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-03ec4450-1b98-487b-ab89-078bf0027c8f tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2104eafd-a467-48a9-b35f-1cc7bce1675d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:10:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-03ec4450-1b98-487b-ab89-078bf0027c8f tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2104eafd-a467-48a9-b35f-1cc7bce1675d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:10:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-03ec4450-1b98-487b-ab89-078bf0027c8f tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eac2777-5ac9-4631-b7cc-51e0dd2a5389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:10:55 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-03ec4450-1b98-487b-ab89-078bf0027c8f tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Volume fe0ed3db-aa11-41f9-881b-46c0bc0cda34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34', 'volume_size': 1}
Nov 05 19:10:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-03ec4450-1b98-487b-ab89-078bf0027c8f tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:10:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-03ec4450-1b98-487b-ab89-078bf0027c8f tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:10:55 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-03ec4450-1b98-487b-ab89-078bf0027c8f tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2109335590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe0ed3db-aa11-41f9-881b-46c0bc0cda34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d2295ba8fe545dab4a613d12dcac927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:10:55Z,use_quota=True,user_id='add6cc7dc118451b96ce3bc663808430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:10:55 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-03ec4450-1b98-487b-ab89-078bf0027c8f tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Creating volume fe0ed3db-aa11-41f9-881b-46c0bc0cda34 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:10:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-03ec4450-1b98-487b-ab89-078bf0027c8f tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:10:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-03ec4450-1b98-487b-ab89-078bf0027c8f tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:10:55 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-03ec4450-1b98-487b-ab89-078bf0027c8f tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:10:55 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-03ec4450-1b98-487b-ab89-078bf0027c8f tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:10:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-03ec4450-1b98-487b-ab89-078bf0027c8f tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:10:55 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-03ec4450-1b98-487b-ab89-078bf0027c8f tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:10:55 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-03ec4450-1b98-487b-ab89-078bf0027c8f tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:10:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-03ec4450-1b98-487b-ab89-078bf0027c8f tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:10:55 devstack sudo[92650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34 1073741824
Nov 05 19:10:55 devstack sudo[92650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:10:56 devstack sudo[92650]: pam_unix(sudo:session): session closed for user root
Nov 05 19:10:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-03ec4450-1b98-487b-ab89-078bf0027c8f tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34 1073741824" returned: 0 in 0.620s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:10:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-03ec4450-1b98-487b-ab89-078bf0027c8f tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:10:56 devstack sudo[92667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34
Nov 05 19:10:56 devstack sudo[92667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:10:56 devstack sudo[92667]: pam_unix(sudo:session): session closed for user root
Nov 05 19:10:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-03ec4450-1b98-487b-ab89-078bf0027c8f tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34" returned: 0 in 0.353s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:10:56 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-03ec4450-1b98-487b-ab89-078bf0027c8f tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:10:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-03ec4450-1b98-487b-ab89-078bf0027c8f tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:10:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-03ec4450-1b98-487b-ab89-078bf0027c8f tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eac2777-5ac9-4631-b7cc-51e0dd2a5389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:10:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-03ec4450-1b98-487b-ab89-078bf0027c8f tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a388453-e5ff-4e34-9563-161960d4fb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:10:56 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-03ec4450-1b98-487b-ab89-078bf0027c8f tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Volume volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34 (fe0ed3db-aa11-41f9-881b-46c0bc0cda34): created successfully
Nov 05 19:10:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-03ec4450-1b98-487b-ab89-078bf0027c8f tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a388453-e5ff-4e34-9563-161960d4fb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:10:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-03ec4450-1b98-487b-ab89-078bf0027c8f tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Flow 'volume_create_manager' (72c8c32b-41d2-4f2e-969f-605bf33e0be2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:10:56 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-03ec4450-1b98-487b-ab89-078bf0027c8f tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Created volume successfully.
Nov 05 19:10:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d9afe6a3-db7a-426a-bb4d-bd7f1bde5914 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:10:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d9afe6a3-db7a-426a-bb4d-bd7f1bde5914 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:10:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-d9afe6a3-db7a-426a-bb4d-bd7f1bde5914 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Creating offline snapshot f1613182-feb1-4cf8-817a-45df515ed350 of volume fe0ed3db-aa11-41f9-881b-46c0bc0cda34 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:10:57 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c489da-60cc-45c8-8a2e-7855018cc13d]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:10:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d9afe6a3-db7a-426a-bb4d-bd7f1bde5914 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:10:57 devstack sudo[92682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34
Nov 05 19:10:57 devstack sudo[92682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:10:58 devstack sudo[92682]: pam_unix(sudo:session): session closed for user root
Nov 05 19:10:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d9afe6a3-db7a-426a-bb4d-bd7f1bde5914 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34" returned: 0 in 0.662s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:10:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d9afe6a3-db7a-426a-bb4d-bd7f1bde5914 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34.f1613182-feb1-4cf8-817a-45df515ed350 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:10:58 devstack sudo[92703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34.f1613182-feb1-4cf8-817a-45df515ed350 1G
Nov 05 19:10:58 devstack sudo[92703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:10:59 devstack sudo[92703]: pam_unix(sudo:session): session closed for user root
Nov 05 19:10:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d9afe6a3-db7a-426a-bb4d-bd7f1bde5914 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34.f1613182-feb1-4cf8-817a-45df515ed350 1G" returned: 0 in 0.994s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:10:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d9afe6a3-db7a-426a-bb4d-bd7f1bde5914 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34.f1613182-feb1-4cf8-817a-45df515ed350 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:10:59 devstack sudo[92763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34.f1613182-feb1-4cf8-817a-45df515ed350
Nov 05 19:10:59 devstack sudo[92763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:11:00 devstack sudo[92763]: pam_unix(sudo:session): session closed for user root
Nov 05 19:11:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d9afe6a3-db7a-426a-bb4d-bd7f1bde5914 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34.f1613182-feb1-4cf8-817a-45df515ed350" returned: 0 in 0.787s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:11:00 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-d9afe6a3-db7a-426a-bb4d-bd7f1bde5914 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34.f1613182-feb1-4cf8-817a-45df515ed350 is being set with open permissions: ugo+rw
Nov 05 19:11:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d9afe6a3-db7a-426a-bb4d-bd7f1bde5914 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34.f1613182-feb1-4cf8-817a-45df515ed350 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:11:00 devstack sudo[92793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34.f1613182-feb1-4cf8-817a-45df515ed350
Nov 05 19:11:00 devstack sudo[92793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:11:00 devstack sudo[92793]: pam_unix(sudo:session): session closed for user root
Nov 05 19:11:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d9afe6a3-db7a-426a-bb4d-bd7f1bde5914 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34.f1613182-feb1-4cf8-817a-45df515ed350" returned: 0 in 0.656s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:11:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d9afe6a3-db7a-426a-bb4d-bd7f1bde5914 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:11:01 devstack sudo[92819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34.info
Nov 05 19:11:01 devstack sudo[92819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:11:01 devstack sudo[92819]: pam_unix(sudo:session): session closed for user root
Nov 05 19:11:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d9afe6a3-db7a-426a-bb4d-bd7f1bde5914 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34.info" returned: 0 in 0.692s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:11:01 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-d9afe6a3-db7a-426a-bb4d-bd7f1bde5914 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34.info is being set with open permissions: ugo+rw
Nov 05 19:11:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d9afe6a3-db7a-426a-bb4d-bd7f1bde5914 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:11:01 devstack sudo[92842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34.info
Nov 05 19:11:01 devstack sudo[92842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:11:02 devstack sudo[92842]: pam_unix(sudo:session): session closed for user root
Nov 05 19:11:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d9afe6a3-db7a-426a-bb4d-bd7f1bde5914 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34.info" returned: 0 in 0.487s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:11:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d9afe6a3-db7a-426a-bb4d-bd7f1bde5914 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.531s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:11:02 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-d9afe6a3-db7a-426a-bb4d-bd7f1bde5914 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Create snapshot completed successfully
Nov 05 19:11:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3ca4c5df-ad6b-4779-aa55-167740138b30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Acquiring lock "cinder-f1613182-feb1-4cf8-817a-45df515ed350-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:11:05 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3ca4c5df-ad6b-4779-aa55-167740138b30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Lock "cinder-f1613182-feb1-4cf8-817a-45df515ed350-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:11:05 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3ca4c5df-ad6b-4779-aa55-167740138b30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Acquiring lock "cinder-quobyte-fe0ed3db-aa11-41f9-881b-46c0bc0cda34" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:11:05 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3ca4c5df-ad6b-4779-aa55-167740138b30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Lock "cinder-quobyte-fe0ed3db-aa11-41f9-881b-46c0bc0cda34" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:11:05 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3ca4c5df-ad6b-4779-aa55-167740138b30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Acquiring lock "cinder-quobyte-f1613182-feb1-4cf8-817a-45df515ed350" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:11:05 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3ca4c5df-ad6b-4779-aa55-167740138b30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Lock "cinder-quobyte-f1613182-feb1-4cf8-817a-45df515ed350" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:11:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-3ca4c5df-ad6b-4779-aa55-167740138b30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Deleting offline snapshot f1613182-feb1-4cf8-817a-45df515ed350 of volume fe0ed3db-aa11-41f9-881b-46c0bc0cda34 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:11:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-3ca4c5df-ad6b-4779-aa55-167740138b30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] snapshot_file for this snap is: volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34.f1613182-feb1-4cf8-817a-45df515ed350 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:11:05 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2335fd-4f79-4b01-ae07-605692e8721e]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:11:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3ca4c5df-ad6b-4779-aa55-167740138b30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34.f1613182-feb1-4cf8-817a-45df515ed350 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:11:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:11:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:11:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:11:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:11:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:11:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:11:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:11:05 devstack sudo[92859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34.f1613182-feb1-4cf8-817a-45df515ed350
Nov 05 19:11:05 devstack sudo[92859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:11:05 devstack sudo[92861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:11:05 devstack sudo[92861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:11:05 devstack sudo[92861]: pam_unix(sudo:session): session closed for user root
Nov 05 19:11:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.499s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:11:05 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:11:05 devstack sudo[92859]: pam_unix(sudo:session): session closed for user root
Nov 05 19:11:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3ca4c5df-ad6b-4779-aa55-167740138b30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34.f1613182-feb1-4cf8-817a-45df515ed350" returned: 0 in 0.685s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:11:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-3ca4c5df-ad6b-4779-aa55-167740138b30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:11:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:11:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread count: 28 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 19:11:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread info: [<_MainThread(MainThread, started 126882883072128)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126882770872512)>, <Thread(Thread-3 (stat_writer), started daemon 126882769837376)>, <Thread(Rabbit-heartbeat, started daemon 126882768896256)>, <Thread(Thread-5 (_runner), started daemon 126882768980928)>, <Thread(Thread-7 (_runner), started daemon 126882767016448)>, <Thread(fd_logger, started daemon 126882764561216)>, <Thread(privsep_reader, started daemon 126882764568576)>, <Thread(tpool_thread_0, started daemon 126882759292608)>, <Thread(tpool_thread_1, started daemon 126882750899904)>, <Thread(tpool_thread_2, started daemon 126882742507200)>, <Thread(tpool_thread_3, started daemon 126882734114496)>, <Thread(tpool_thread_4, started daemon 126882725721792)>, <Thread(tpool_thread_5, started daemon 126882717329088)>, <Thread(tpool_thread_6, started daemon 126882708920000)>, <Thread(tpool_thread_7, started daemon 126882700510912)>, <Thread(tpool_thread_8, started daemon 126882692101824)>, <Thread(tpool_thread_9, started daemon 126882683692736)>, <Thread(tpool_thread_10, started daemon 126882675283648)>, <Thread(tpool_thread_11, started daemon 126882666874560)>, <Thread(tpool_thread_12, started daemon 126882658465472)>, <Thread(tpool_thread_13, started daemon 126882650056384)>, <Thread(tpool_thread_14, started daemon 126882641647296)>, <Thread(tpool_thread_15, started daemon 126882633238208)>, <Thread(tpool_thread_16, started daemon 126882624829120)>, <Thread(tpool_thread_17, started daemon 126882616420032)>, <Thread(tpool_thread_18, started daemon 126882608010944)>, <Thread(tpool_thread_19, started daemon 126882599601856)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 19:11:05 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c984f731-caf7-4b30-85c7-5c989b6a3541]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:11:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3ca4c5df-ad6b-4779-aa55-167740138b30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:11:06 devstack sudo[92871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34
Nov 05 19:11:06 devstack sudo[92871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:11:06 devstack sudo[92871]: pam_unix(sudo:session): session closed for user root
Nov 05 19:11:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3ca4c5df-ad6b-4779-aa55-167740138b30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34" returned: 0 in 0.899s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:11:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3ca4c5df-ad6b-4779-aa55-167740138b30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34.f1613182-feb1-4cf8-817a-45df515ed350 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:11:06 devstack sudo[92886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34.f1613182-feb1-4cf8-817a-45df515ed350
Nov 05 19:11:06 devstack sudo[92886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:11:07 devstack sudo[92886]: pam_unix(sudo:session): session closed for user root
Nov 05 19:11:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3ca4c5df-ad6b-4779-aa55-167740138b30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34.f1613182-feb1-4cf8-817a-45df515ed350" returned: 0 in 0.521s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:11:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3ca4c5df-ad6b-4779-aa55-167740138b30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34.f1613182-feb1-4cf8-817a-45df515ed350 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:11:07 devstack sudo[92896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34.f1613182-feb1-4cf8-817a-45df515ed350
Nov 05 19:11:07 devstack sudo[92896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:11:07 devstack sudo[92896]: pam_unix(sudo:session): session closed for user root
Nov 05 19:11:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3ca4c5df-ad6b-4779-aa55-167740138b30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34.f1613182-feb1-4cf8-817a-45df515ed350" returned: 0 in 0.343s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:11:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3ca4c5df-ad6b-4779-aa55-167740138b30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Lock "cinder-quobyte-f1613182-feb1-4cf8-817a-45df515ed350" released by "_delete_snapshot" :: held 2.715s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:11:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3ca4c5df-ad6b-4779-aa55-167740138b30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Lock "cinder-quobyte-fe0ed3db-aa11-41f9-881b-46c0bc0cda34" released by "delete_snapshot" :: held 2.763s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:11:07 devstack cinder-volume[87184]: WARNING cinder.quota [None req-3ca4c5df-ad6b-4779-aa55-167740138b30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 05 19:11:07 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-3ca4c5df-ad6b-4779-aa55-167740138b30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Created reservations ['5eb498de-e303-4cf5-a43e-d58a97398f47', '8d148b83-e47e-45f2-991c-18460adaf23b', 'd1467ac6-29da-41bc-bde4-42998bb90b6c', '627a6c43-44a8-4f6e-98f2-4459b55e95ac'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:11:07 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-3ca4c5df-ad6b-4779-aa55-167740138b30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Delete snapshot completed successfully.
Nov 05 19:11:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3ca4c5df-ad6b-4779-aa55-167740138b30 tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Lock "cinder-f1613182-feb1-4cf8-817a-45df515ed350-delete_snapshot" released by "delete_snapshot" :: held 2.987s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:11:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-63658377-6501-4a25-b6e8-b98327bab19b tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Acquiring lock "cinder-fe0ed3db-aa11-41f9-881b-46c0bc0cda34-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:11:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-63658377-6501-4a25-b6e8-b98327bab19b tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Lock "cinder-fe0ed3db-aa11-41f9-881b-46c0bc0cda34-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:11:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-63658377-6501-4a25-b6e8-b98327bab19b tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Acquiring lock "cinder-quobyte-fe0ed3db-aa11-41f9-881b-46c0bc0cda34" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:11:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-63658377-6501-4a25-b6e8-b98327bab19b tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Lock "cinder-quobyte-fe0ed3db-aa11-41f9-881b-46c0bc0cda34" acquired by "delete_volume" :: waited 0.027s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:11:08 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51e2d87-ea2e-4946-93aa-d3a70c4cc91d]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:11:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-63658377-6501-4a25-b6e8-b98327bab19b tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:11:09 devstack sudo[92900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34
Nov 05 19:11:09 devstack sudo[92900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:11:09 devstack sudo[92900]: pam_unix(sudo:session): session closed for user root
Nov 05 19:11:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-63658377-6501-4a25-b6e8-b98327bab19b tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34" returned: 0 in 0.735s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:11:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-63658377-6501-4a25-b6e8-b98327bab19b tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:11:09 devstack sudo[92906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34
Nov 05 19:11:09 devstack sudo[92906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:11:09 devstack sudo[92906]: pam_unix(sudo:session): session closed for user root
Nov 05 19:11:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-63658377-6501-4a25-b6e8-b98327bab19b tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fe0ed3db-aa11-41f9-881b-46c0bc0cda34" returned: 0 in 0.405s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:11:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-63658377-6501-4a25-b6e8-b98327bab19b tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Lock "cinder-quobyte-fe0ed3db-aa11-41f9-881b-46c0bc0cda34" released by "delete_volume" :: held 1.292s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:11:10 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-63658377-6501-4a25-b6e8-b98327bab19b tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Created reservations ['335ba354-cf62-496e-9f55-0d80615d5f6f', '3b3c4bdf-f77b-4be6-9144-3d8324150e1f', '393e6a3e-6318-4f0b-a504-5840ed4aba49', '1b35fc03-5da6-4c4c-b727-62f03695cae5'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:11:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-63658377-6501-4a25-b6e8-b98327bab19b tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:11:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-63658377-6501-4a25-b6e8-b98327bab19b tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:11:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-63658377-6501-4a25-b6e8-b98327bab19b tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:11:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-63658377-6501-4a25-b6e8-b98327bab19b tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:11:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-63658377-6501-4a25-b6e8-b98327bab19b tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:11:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-63658377-6501-4a25-b6e8-b98327bab19b tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:11:10 devstack sudo[92909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:11:10 devstack sudo[92909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:11:10 devstack sudo[92909]: pam_unix(sudo:session): session closed for user root
Nov 05 19:11:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-63658377-6501-4a25-b6e8-b98327bab19b tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.445s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:11:10 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-63658377-6501-4a25-b6e8-b98327bab19b tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:11:10 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-63658377-6501-4a25-b6e8-b98327bab19b tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Deleted volume successfully.
Nov 05 19:11:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-63658377-6501-4a25-b6e8-b98327bab19b tempest-VolumeSnapshotQuotasNegativeTestJSON-1977658852 None] Lock "cinder-fe0ed3db-aa11-41f9-881b-46c0bc0cda34-delete_volume" released by "delete_volume" :: held 2.178s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:11:20 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=17,cinder:UPDATE=16,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:11:20 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:UPDATE=20,cinder:SELECT=15,cinder:DELETE=2,cinder:INSERT=3 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:11:22 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bd3b434-74df-4dcb-912d-cd4094cb73d8 tempest-SnapshotMetadataTestJSON-1197784354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:11:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4bd3b434-74df-4dcb-912d-cd4094cb73d8 tempest-SnapshotMetadataTestJSON-1197784354 None] Flow 'volume_create_manager' (61a1e989-134a-4287-ba5a-fbc791953de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:11:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4bd3b434-74df-4dcb-912d-cd4094cb73d8 tempest-SnapshotMetadataTestJSON-1197784354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12b3d916-27c8-46e1-9373-09271f7b98a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:11:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4bd3b434-74df-4dcb-912d-cd4094cb73d8 tempest-SnapshotMetadataTestJSON-1197784354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12b3d916-27c8-46e1-9373-09271f7b98a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1910911949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac16fbaa-cc24-49e4-b74c-7a0be873816a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cb23e716bce4d8c94de08a764682a8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:11:23Z,use_quota=True,user_id='26d9e21f151c4cea8948efa2a9839172',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:11:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4bd3b434-74df-4dcb-912d-cd4094cb73d8 tempest-SnapshotMetadataTestJSON-1197784354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c521a9d-4330-45d8-878a-a8546c9c5876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:11:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4bd3b434-74df-4dcb-912d-cd4094cb73d8 tempest-SnapshotMetadataTestJSON-1197784354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c521a9d-4330-45d8-878a-a8546c9c5876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:11:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4bd3b434-74df-4dcb-912d-cd4094cb73d8 tempest-SnapshotMetadataTestJSON-1197784354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bacb8a8-8c84-4e64-97b0-da73102bd4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:11:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4bd3b434-74df-4dcb-912d-cd4094cb73d8 tempest-SnapshotMetadataTestJSON-1197784354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bacb8a8-8c84-4e64-97b0-da73102bd4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac16fbaa-cc24-49e4-b74c-7a0be873816a', 'volume_name': 'volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:11:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4bd3b434-74df-4dcb-912d-cd4094cb73d8 tempest-SnapshotMetadataTestJSON-1197784354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53df632b-2e08-4ca4-b7c2-198ab92cb70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:11:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4bd3b434-74df-4dcb-912d-cd4094cb73d8 tempest-SnapshotMetadataTestJSON-1197784354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53df632b-2e08-4ca4-b7c2-198ab92cb70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:11:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4bd3b434-74df-4dcb-912d-cd4094cb73d8 tempest-SnapshotMetadataTestJSON-1197784354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fd33827-900e-44aa-825c-5f142938deee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:11:22 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-4bd3b434-74df-4dcb-912d-cd4094cb73d8 tempest-SnapshotMetadataTestJSON-1197784354 None] Volume ac16fbaa-cc24-49e4-b74c-7a0be873816a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a', 'volume_size': 1}
Nov 05 19:11:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4bd3b434-74df-4dcb-912d-cd4094cb73d8 tempest-SnapshotMetadataTestJSON-1197784354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:11:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4bd3b434-74df-4dcb-912d-cd4094cb73d8 tempest-SnapshotMetadataTestJSON-1197784354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:11:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4bd3b434-74df-4dcb-912d-cd4094cb73d8 tempest-SnapshotMetadataTestJSON-1197784354 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1910911949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac16fbaa-cc24-49e4-b74c-7a0be873816a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cb23e716bce4d8c94de08a764682a8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:11:23Z,use_quota=True,user_id='26d9e21f151c4cea8948efa2a9839172',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:11:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-4bd3b434-74df-4dcb-912d-cd4094cb73d8 tempest-SnapshotMetadataTestJSON-1197784354 None] Creating volume ac16fbaa-cc24-49e4-b74c-7a0be873816a {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:11:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4bd3b434-74df-4dcb-912d-cd4094cb73d8 tempest-SnapshotMetadataTestJSON-1197784354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:11:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4bd3b434-74df-4dcb-912d-cd4094cb73d8 tempest-SnapshotMetadataTestJSON-1197784354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:11:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4bd3b434-74df-4dcb-912d-cd4094cb73d8 tempest-SnapshotMetadataTestJSON-1197784354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:11:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4bd3b434-74df-4dcb-912d-cd4094cb73d8 tempest-SnapshotMetadataTestJSON-1197784354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:11:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4bd3b434-74df-4dcb-912d-cd4094cb73d8 tempest-SnapshotMetadataTestJSON-1197784354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:11:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4bd3b434-74df-4dcb-912d-cd4094cb73d8 tempest-SnapshotMetadataTestJSON-1197784354 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:11:22 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-4bd3b434-74df-4dcb-912d-cd4094cb73d8 tempest-SnapshotMetadataTestJSON-1197784354 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:11:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4bd3b434-74df-4dcb-912d-cd4094cb73d8 tempest-SnapshotMetadataTestJSON-1197784354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:11:22 devstack sudo[93092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a 1073741824
Nov 05 19:11:22 devstack sudo[93092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:11:23 devstack sudo[93092]: pam_unix(sudo:session): session closed for user root
Nov 05 19:11:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4bd3b434-74df-4dcb-912d-cd4094cb73d8 tempest-SnapshotMetadataTestJSON-1197784354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a 1073741824" returned: 0 in 0.474s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:11:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4bd3b434-74df-4dcb-912d-cd4094cb73d8 tempest-SnapshotMetadataTestJSON-1197784354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:11:23 devstack sudo[93122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a
Nov 05 19:11:23 devstack sudo[93122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:11:23 devstack sudo[93122]: pam_unix(sudo:session): session closed for user root
Nov 05 19:11:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4bd3b434-74df-4dcb-912d-cd4094cb73d8 tempest-SnapshotMetadataTestJSON-1197784354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a" returned: 0 in 0.276s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:11:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4bd3b434-74df-4dcb-912d-cd4094cb73d8 tempest-SnapshotMetadataTestJSON-1197784354 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:11:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4bd3b434-74df-4dcb-912d-cd4094cb73d8 tempest-SnapshotMetadataTestJSON-1197784354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:11:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4bd3b434-74df-4dcb-912d-cd4094cb73d8 tempest-SnapshotMetadataTestJSON-1197784354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fd33827-900e-44aa-825c-5f142938deee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:11:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4bd3b434-74df-4dcb-912d-cd4094cb73d8 tempest-SnapshotMetadataTestJSON-1197784354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e1cf8a7-2453-4d4b-9989-8962cf9623a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:11:23 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-4bd3b434-74df-4dcb-912d-cd4094cb73d8 tempest-SnapshotMetadataTestJSON-1197784354 None] Volume volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a (ac16fbaa-cc24-49e4-b74c-7a0be873816a): created successfully
Nov 05 19:11:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4bd3b434-74df-4dcb-912d-cd4094cb73d8 tempest-SnapshotMetadataTestJSON-1197784354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e1cf8a7-2453-4d4b-9989-8962cf9623a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:11:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4bd3b434-74df-4dcb-912d-cd4094cb73d8 tempest-SnapshotMetadataTestJSON-1197784354 None] Flow 'volume_create_manager' (61a1e989-134a-4287-ba5a-fbc791953de2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:11:23 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-4bd3b434-74df-4dcb-912d-cd4094cb73d8 tempest-SnapshotMetadataTestJSON-1197784354 None] Created volume successfully.
Nov 05 19:11:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-62cbc657-2cc8-419a-9602-722106d673f0 tempest-SnapshotMetadataTestJSON-1197784354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:11:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-62cbc657-2cc8-419a-9602-722106d673f0 tempest-SnapshotMetadataTestJSON-1197784354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:11:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-62cbc657-2cc8-419a-9602-722106d673f0 tempest-SnapshotMetadataTestJSON-1197784354 None] Creating offline snapshot 8e5c9a09-5bf7-4f7c-bd00-30a1c343851e of volume ac16fbaa-cc24-49e4-b74c-7a0be873816a {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:11:24 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f45f7d-875e-4d13-8fb3-1c26383e0b5f]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:11:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-62cbc657-2cc8-419a-9602-722106d673f0 tempest-SnapshotMetadataTestJSON-1197784354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:11:25 devstack sudo[93128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a
Nov 05 19:11:25 devstack sudo[93128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:11:25 devstack sudo[93128]: pam_unix(sudo:session): session closed for user root
Nov 05 19:11:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-62cbc657-2cc8-419a-9602-722106d673f0 tempest-SnapshotMetadataTestJSON-1197784354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a" returned: 0 in 0.502s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:11:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-62cbc657-2cc8-419a-9602-722106d673f0 tempest-SnapshotMetadataTestJSON-1197784354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a.8e5c9a09-5bf7-4f7c-bd00-30a1c343851e 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:11:25 devstack sudo[93133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a.8e5c9a09-5bf7-4f7c-bd00-30a1c343851e 1G
Nov 05 19:11:25 devstack sudo[93133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:11:26 devstack sudo[93133]: pam_unix(sudo:session): session closed for user root
Nov 05 19:11:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-62cbc657-2cc8-419a-9602-722106d673f0 tempest-SnapshotMetadataTestJSON-1197784354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a.8e5c9a09-5bf7-4f7c-bd00-30a1c343851e 1G" returned: 0 in 1.065s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:11:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-62cbc657-2cc8-419a-9602-722106d673f0 tempest-SnapshotMetadataTestJSON-1197784354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a.8e5c9a09-5bf7-4f7c-bd00-30a1c343851e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:11:26 devstack sudo[93140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a.8e5c9a09-5bf7-4f7c-bd00-30a1c343851e
Nov 05 19:11:26 devstack sudo[93140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:11:27 devstack sudo[93140]: pam_unix(sudo:session): session closed for user root
Nov 05 19:11:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-62cbc657-2cc8-419a-9602-722106d673f0 tempest-SnapshotMetadataTestJSON-1197784354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a.8e5c9a09-5bf7-4f7c-bd00-30a1c343851e" returned: 0 in 0.704s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:11:27 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-62cbc657-2cc8-419a-9602-722106d673f0 tempest-SnapshotMetadataTestJSON-1197784354 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a.8e5c9a09-5bf7-4f7c-bd00-30a1c343851e is being set with open permissions: ugo+rw
Nov 05 19:11:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-62cbc657-2cc8-419a-9602-722106d673f0 tempest-SnapshotMetadataTestJSON-1197784354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a.8e5c9a09-5bf7-4f7c-bd00-30a1c343851e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:11:27 devstack sudo[93146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a.8e5c9a09-5bf7-4f7c-bd00-30a1c343851e
Nov 05 19:11:27 devstack sudo[93146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:11:27 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a535a97-76a2-401e-bb73-35d09b1de21c tempest-ServerRescueNegativeTestJSON-1819476679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:11:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9a535a97-76a2-401e-bb73-35d09b1de21c tempest-ServerRescueNegativeTestJSON-1819476679 None] Flow 'volume_create_manager' (269cbbdb-69c3-4ec9-ab7a-9b0f0f32dc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:11:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9a535a97-76a2-401e-bb73-35d09b1de21c tempest-ServerRescueNegativeTestJSON-1819476679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9456337c-e16d-4f8b-a5fc-a5d59e67e72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:11:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9a535a97-76a2-401e-bb73-35d09b1de21c tempest-ServerRescueNegativeTestJSON-1819476679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9456337c-e16d-4f8b-a5fc-a5d59e67e72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1205825000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=164b8b7d-0210-47c4-a621-264864903088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36f6edb0581546289e034d0f8114ea23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:11:27Z,use_quota=True,user_id='24843c07a93e479f9222736d13533433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:11:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9a535a97-76a2-401e-bb73-35d09b1de21c tempest-ServerRescueNegativeTestJSON-1819476679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e2c2b42-2c3d-42ec-ab15-a0deae2f4d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:11:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9a535a97-76a2-401e-bb73-35d09b1de21c tempest-ServerRescueNegativeTestJSON-1819476679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e2c2b42-2c3d-42ec-ab15-a0deae2f4d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:11:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9a535a97-76a2-401e-bb73-35d09b1de21c tempest-ServerRescueNegativeTestJSON-1819476679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20a02b79-d8ae-417a-b0c2-5c0def381374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:11:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9a535a97-76a2-401e-bb73-35d09b1de21c tempest-ServerRescueNegativeTestJSON-1819476679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20a02b79-d8ae-417a-b0c2-5c0def381374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '164b8b7d-0210-47c4-a621-264864903088', 'volume_name': 'volume-164b8b7d-0210-47c4-a621-264864903088', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:11:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9a535a97-76a2-401e-bb73-35d09b1de21c tempest-ServerRescueNegativeTestJSON-1819476679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4082061a-c5a4-4bae-aab6-e9b04d3d55a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:11:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9a535a97-76a2-401e-bb73-35d09b1de21c tempest-ServerRescueNegativeTestJSON-1819476679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4082061a-c5a4-4bae-aab6-e9b04d3d55a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:11:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9a535a97-76a2-401e-bb73-35d09b1de21c tempest-ServerRescueNegativeTestJSON-1819476679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63cbb9df-a327-427c-a720-9eca54d5fa0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:11:27 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-9a535a97-76a2-401e-bb73-35d09b1de21c tempest-ServerRescueNegativeTestJSON-1819476679 None] Volume 164b8b7d-0210-47c4-a621-264864903088: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-164b8b7d-0210-47c4-a621-264864903088', 'volume_size': 1}
Nov 05 19:11:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9a535a97-76a2-401e-bb73-35d09b1de21c tempest-ServerRescueNegativeTestJSON-1819476679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:11:27 devstack sudo[93146]: pam_unix(sudo:session): session closed for user root
Nov 05 19:11:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-62cbc657-2cc8-419a-9602-722106d673f0 tempest-SnapshotMetadataTestJSON-1197784354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a.8e5c9a09-5bf7-4f7c-bd00-30a1c343851e" returned: 0 in 0.340s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:11:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-62cbc657-2cc8-419a-9602-722106d673f0 tempest-SnapshotMetadataTestJSON-1197784354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:11:27 devstack sudo[93149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a.info
Nov 05 19:11:27 devstack sudo[93149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:11:27 devstack sudo[93149]: pam_unix(sudo:session): session closed for user root
Nov 05 19:11:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-62cbc657-2cc8-419a-9602-722106d673f0 tempest-SnapshotMetadataTestJSON-1197784354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a.info" returned: 0 in 0.295s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:11:27 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-62cbc657-2cc8-419a-9602-722106d673f0 tempest-SnapshotMetadataTestJSON-1197784354 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a.info is being set with open permissions: ugo+rw
Nov 05 19:11:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-62cbc657-2cc8-419a-9602-722106d673f0 tempest-SnapshotMetadataTestJSON-1197784354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:11:27 devstack sudo[93152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a.info
Nov 05 19:11:27 devstack sudo[93152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:11:28 devstack sudo[93152]: pam_unix(sudo:session): session closed for user root
Nov 05 19:11:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-62cbc657-2cc8-419a-9602-722106d673f0 tempest-SnapshotMetadataTestJSON-1197784354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a.info" returned: 0 in 0.388s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:11:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-62cbc657-2cc8-419a-9602-722106d673f0 tempest-SnapshotMetadataTestJSON-1197784354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.412s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:11:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9a535a97-76a2-401e-bb73-35d09b1de21c tempest-ServerRescueNegativeTestJSON-1819476679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.852s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:11:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9a535a97-76a2-401e-bb73-35d09b1de21c tempest-ServerRescueNegativeTestJSON-1819476679 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1205825000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=164b8b7d-0210-47c4-a621-264864903088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36f6edb0581546289e034d0f8114ea23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:11:27Z,use_quota=True,user_id='24843c07a93e479f9222736d13533433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:11:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-9a535a97-76a2-401e-bb73-35d09b1de21c tempest-ServerRescueNegativeTestJSON-1819476679 None] Creating volume 164b8b7d-0210-47c4-a621-264864903088 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:11:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9a535a97-76a2-401e-bb73-35d09b1de21c tempest-ServerRescueNegativeTestJSON-1819476679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:11:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9a535a97-76a2-401e-bb73-35d09b1de21c tempest-ServerRescueNegativeTestJSON-1819476679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:11:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9a535a97-76a2-401e-bb73-35d09b1de21c tempest-ServerRescueNegativeTestJSON-1819476679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:11:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9a535a97-76a2-401e-bb73-35d09b1de21c tempest-ServerRescueNegativeTestJSON-1819476679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:11:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9a535a97-76a2-401e-bb73-35d09b1de21c tempest-ServerRescueNegativeTestJSON-1819476679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:11:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9a535a97-76a2-401e-bb73-35d09b1de21c tempest-ServerRescueNegativeTestJSON-1819476679 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:11:28 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-9a535a97-76a2-401e-bb73-35d09b1de21c tempest-ServerRescueNegativeTestJSON-1819476679 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:11:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9a535a97-76a2-401e-bb73-35d09b1de21c tempest-ServerRescueNegativeTestJSON-1819476679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-164b8b7d-0210-47c4-a621-264864903088 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:11:28 devstack sudo[93155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-164b8b7d-0210-47c4-a621-264864903088 1073741824
Nov 05 19:11:28 devstack sudo[93155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:11:28 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-62cbc657-2cc8-419a-9602-722106d673f0 tempest-SnapshotMetadataTestJSON-1197784354 None] Create snapshot completed successfully
Nov 05 19:11:28 devstack sudo[93155]: pam_unix(sudo:session): session closed for user root
Nov 05 19:11:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9a535a97-76a2-401e-bb73-35d09b1de21c tempest-ServerRescueNegativeTestJSON-1819476679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-164b8b7d-0210-47c4-a621-264864903088 1073741824" returned: 0 in 0.585s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:11:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9a535a97-76a2-401e-bb73-35d09b1de21c tempest-ServerRescueNegativeTestJSON-1819476679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-164b8b7d-0210-47c4-a621-264864903088 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:11:29 devstack sudo[93160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-164b8b7d-0210-47c4-a621-264864903088
Nov 05 19:11:29 devstack sudo[93160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:11:29 devstack sudo[93160]: pam_unix(sudo:session): session closed for user root
Nov 05 19:11:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9a535a97-76a2-401e-bb73-35d09b1de21c tempest-ServerRescueNegativeTestJSON-1819476679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-164b8b7d-0210-47c4-a621-264864903088" returned: 0 in 0.384s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:11:29 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9a535a97-76a2-401e-bb73-35d09b1de21c tempest-ServerRescueNegativeTestJSON-1819476679 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:11:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9a535a97-76a2-401e-bb73-35d09b1de21c tempest-ServerRescueNegativeTestJSON-1819476679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:11:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9a535a97-76a2-401e-bb73-35d09b1de21c tempest-ServerRescueNegativeTestJSON-1819476679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63cbb9df-a327-427c-a720-9eca54d5fa0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-164b8b7d-0210-47c4-a621-264864903088', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:11:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9a535a97-76a2-401e-bb73-35d09b1de21c tempest-ServerRescueNegativeTestJSON-1819476679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (877c1865-32d1-4c21-9d4c-187e7856250a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:11:29 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-9a535a97-76a2-401e-bb73-35d09b1de21c tempest-ServerRescueNegativeTestJSON-1819476679 None] Volume volume-164b8b7d-0210-47c4-a621-264864903088 (164b8b7d-0210-47c4-a621-264864903088): created successfully
Nov 05 19:11:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9a535a97-76a2-401e-bb73-35d09b1de21c tempest-ServerRescueNegativeTestJSON-1819476679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (877c1865-32d1-4c21-9d4c-187e7856250a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:11:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9a535a97-76a2-401e-bb73-35d09b1de21c tempest-ServerRescueNegativeTestJSON-1819476679 None] Flow 'volume_create_manager' (269cbbdb-69c3-4ec9-ab7a-9b0f0f32dc33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:11:29 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-9a535a97-76a2-401e-bb73-35d09b1de21c tempest-ServerRescueNegativeTestJSON-1819476679 None] Created volume successfully.
Nov 05 19:11:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0dfb662f-642c-46c3-9072-4dc4f15d719c tempest-SnapshotMetadataTestJSON-1197784354 None] Acquiring lock "cinder-8e5c9a09-5bf7-4f7c-bd00-30a1c343851e-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:11:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0dfb662f-642c-46c3-9072-4dc4f15d719c tempest-SnapshotMetadataTestJSON-1197784354 None] Lock "cinder-8e5c9a09-5bf7-4f7c-bd00-30a1c343851e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:11:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0dfb662f-642c-46c3-9072-4dc4f15d719c tempest-SnapshotMetadataTestJSON-1197784354 None] Acquiring lock "cinder-quobyte-ac16fbaa-cc24-49e4-b74c-7a0be873816a" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:11:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0dfb662f-642c-46c3-9072-4dc4f15d719c tempest-SnapshotMetadataTestJSON-1197784354 None] Lock "cinder-quobyte-ac16fbaa-cc24-49e4-b74c-7a0be873816a" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:11:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0dfb662f-642c-46c3-9072-4dc4f15d719c tempest-SnapshotMetadataTestJSON-1197784354 None] Acquiring lock "cinder-quobyte-8e5c9a09-5bf7-4f7c-bd00-30a1c343851e" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:11:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0dfb662f-642c-46c3-9072-4dc4f15d719c tempest-SnapshotMetadataTestJSON-1197784354 None] Lock "cinder-quobyte-8e5c9a09-5bf7-4f7c-bd00-30a1c343851e" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:11:30 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-0dfb662f-642c-46c3-9072-4dc4f15d719c tempest-SnapshotMetadataTestJSON-1197784354 None] Deleting offline snapshot 8e5c9a09-5bf7-4f7c-bd00-30a1c343851e of volume ac16fbaa-cc24-49e4-b74c-7a0be873816a {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:11:30 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-0dfb662f-642c-46c3-9072-4dc4f15d719c tempest-SnapshotMetadataTestJSON-1197784354 None] snapshot_file for this snap is: volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a.8e5c9a09-5bf7-4f7c-bd00-30a1c343851e {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:11:30 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc88db84-3f51-4f4c-97fb-2426c031310d]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:11:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0dfb662f-642c-46c3-9072-4dc4f15d719c tempest-SnapshotMetadataTestJSON-1197784354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a.8e5c9a09-5bf7-4f7c-bd00-30a1c343851e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:11:30 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9b430af-087c-4eab-a7ff-25d6af7dfe67 tempest-AttachVolumeNegativeTest-1202125091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:11:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f9b430af-087c-4eab-a7ff-25d6af7dfe67 tempest-AttachVolumeNegativeTest-1202125091 None] Flow 'volume_create_manager' (505a0247-a208-4b43-b120-229b33a8c4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:11:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f9b430af-087c-4eab-a7ff-25d6af7dfe67 tempest-AttachVolumeNegativeTest-1202125091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (306ee638-fc66-4042-8602-e27fbcd827e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:11:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f9b430af-087c-4eab-a7ff-25d6af7dfe67 tempest-AttachVolumeNegativeTest-1202125091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (306ee638-fc66-4042-8602-e27fbcd827e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-803158486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6ee83b9-d5a3-4b43-889d-9ca2e7f5b769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a74259972a364a99b263b8035b2e6352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:11:31Z,use_quota=True,user_id='b68aef3a93d64fb7a1957146d2ec0757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:11:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f9b430af-087c-4eab-a7ff-25d6af7dfe67 tempest-AttachVolumeNegativeTest-1202125091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95f1b1e2-b303-4415-8775-84b205a08860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:11:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f9b430af-087c-4eab-a7ff-25d6af7dfe67 tempest-AttachVolumeNegativeTest-1202125091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95f1b1e2-b303-4415-8775-84b205a08860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:11:30 devstack sudo[93167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a.8e5c9a09-5bf7-4f7c-bd00-30a1c343851e
Nov 05 19:11:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f9b430af-087c-4eab-a7ff-25d6af7dfe67 tempest-AttachVolumeNegativeTest-1202125091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6eeddb1-a1f3-4eb8-9651-e9686784c633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:11:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f9b430af-087c-4eab-a7ff-25d6af7dfe67 tempest-AttachVolumeNegativeTest-1202125091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6eeddb1-a1f3-4eb8-9651-e9686784c633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6ee83b9-d5a3-4b43-889d-9ca2e7f5b769', 'volume_name': 'volume-f6ee83b9-d5a3-4b43-889d-9ca2e7f5b769', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:11:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f9b430af-087c-4eab-a7ff-25d6af7dfe67 tempest-AttachVolumeNegativeTest-1202125091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70fc6f1d-693b-4554-ab52-a5dfa1c666d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:11:30 devstack sudo[93167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:11:31 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f9b430af-087c-4eab-a7ff-25d6af7dfe67 tempest-AttachVolumeNegativeTest-1202125091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70fc6f1d-693b-4554-ab52-a5dfa1c666d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:11:31 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f9b430af-087c-4eab-a7ff-25d6af7dfe67 tempest-AttachVolumeNegativeTest-1202125091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bb89a7d-6dc0-4ac8-9629-6a510a19fb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:11:31 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-f9b430af-087c-4eab-a7ff-25d6af7dfe67 tempest-AttachVolumeNegativeTest-1202125091 None] Volume f6ee83b9-d5a3-4b43-889d-9ca2e7f5b769: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6ee83b9-d5a3-4b43-889d-9ca2e7f5b769', 'volume_size': 1}
Nov 05 19:11:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f9b430af-087c-4eab-a7ff-25d6af7dfe67 tempest-AttachVolumeNegativeTest-1202125091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:11:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f9b430af-087c-4eab-a7ff-25d6af7dfe67 tempest-AttachVolumeNegativeTest-1202125091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:11:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f9b430af-087c-4eab-a7ff-25d6af7dfe67 tempest-AttachVolumeNegativeTest-1202125091 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-803158486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6ee83b9-d5a3-4b43-889d-9ca2e7f5b769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a74259972a364a99b263b8035b2e6352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:11:31Z,use_quota=True,user_id='b68aef3a93d64fb7a1957146d2ec0757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:11:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-f9b430af-087c-4eab-a7ff-25d6af7dfe67 tempest-AttachVolumeNegativeTest-1202125091 None] Creating volume f6ee83b9-d5a3-4b43-889d-9ca2e7f5b769 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:11:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f9b430af-087c-4eab-a7ff-25d6af7dfe67 tempest-AttachVolumeNegativeTest-1202125091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:11:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f9b430af-087c-4eab-a7ff-25d6af7dfe67 tempest-AttachVolumeNegativeTest-1202125091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:11:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f9b430af-087c-4eab-a7ff-25d6af7dfe67 tempest-AttachVolumeNegativeTest-1202125091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:11:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f9b430af-087c-4eab-a7ff-25d6af7dfe67 tempest-AttachVolumeNegativeTest-1202125091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:11:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f9b430af-087c-4eab-a7ff-25d6af7dfe67 tempest-AttachVolumeNegativeTest-1202125091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:11:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f9b430af-087c-4eab-a7ff-25d6af7dfe67 tempest-AttachVolumeNegativeTest-1202125091 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:11:31 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-f9b430af-087c-4eab-a7ff-25d6af7dfe67 tempest-AttachVolumeNegativeTest-1202125091 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:11:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f9b430af-087c-4eab-a7ff-25d6af7dfe67 tempest-AttachVolumeNegativeTest-1202125091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f6ee83b9-d5a3-4b43-889d-9ca2e7f5b769 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:11:31 devstack sudo[93170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f6ee83b9-d5a3-4b43-889d-9ca2e7f5b769 1073741824
Nov 05 19:11:31 devstack sudo[93170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:11:31 devstack sudo[93167]: pam_unix(sudo:session): session closed for user root
Nov 05 19:11:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0dfb662f-642c-46c3-9072-4dc4f15d719c tempest-SnapshotMetadataTestJSON-1197784354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a.8e5c9a09-5bf7-4f7c-bd00-30a1c343851e" returned: 0 in 0.952s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:11:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-0dfb662f-642c-46c3-9072-4dc4f15d719c tempest-SnapshotMetadataTestJSON-1197784354 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:11:31 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd61f5f-4ed8-46ee-afae-1254189ae608]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:11:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0dfb662f-642c-46c3-9072-4dc4f15d719c tempest-SnapshotMetadataTestJSON-1197784354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:11:31 devstack sudo[93179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a
Nov 05 19:11:31 devstack sudo[93179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:11:31 devstack sudo[93170]: pam_unix(sudo:session): session closed for user root
Nov 05 19:11:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f9b430af-087c-4eab-a7ff-25d6af7dfe67 tempest-AttachVolumeNegativeTest-1202125091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f6ee83b9-d5a3-4b43-889d-9ca2e7f5b769 1073741824" returned: 0 in 0.928s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:11:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f9b430af-087c-4eab-a7ff-25d6af7dfe67 tempest-AttachVolumeNegativeTest-1202125091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f6ee83b9-d5a3-4b43-889d-9ca2e7f5b769 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:11:32 devstack sudo[93200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f6ee83b9-d5a3-4b43-889d-9ca2e7f5b769
Nov 05 19:11:32 devstack sudo[93200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:11:32 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-e100ffac-0158-4a24-a1ae-c89c3a098bb6 tempest-AttachVolumeTestJSON-109518034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:11:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e100ffac-0158-4a24-a1ae-c89c3a098bb6 tempest-AttachVolumeTestJSON-109518034 None] Flow 'volume_create_manager' (5700c7e4-49cf-4eff-a10e-00867bb37d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:11:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e100ffac-0158-4a24-a1ae-c89c3a098bb6 tempest-AttachVolumeTestJSON-109518034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17719668-0bfa-4da1-9de1-d0a587e4c63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:11:32 devstack sudo[93200]: pam_unix(sudo:session): session closed for user root
Nov 05 19:11:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f9b430af-087c-4eab-a7ff-25d6af7dfe67 tempest-AttachVolumeNegativeTest-1202125091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f6ee83b9-d5a3-4b43-889d-9ca2e7f5b769" returned: 0 in 0.535s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:11:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f9b430af-087c-4eab-a7ff-25d6af7dfe67 tempest-AttachVolumeNegativeTest-1202125091 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:11:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f9b430af-087c-4eab-a7ff-25d6af7dfe67 tempest-AttachVolumeNegativeTest-1202125091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:11:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e100ffac-0158-4a24-a1ae-c89c3a098bb6 tempest-AttachVolumeTestJSON-109518034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17719668-0bfa-4da1-9de1-d0a587e4c63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-275098977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82f9f6f2-7c75-490f-b9d4-50998cb8b518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434a766411ee4ae2aee44844b8ec847a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:11:32Z,use_quota=True,user_id='0dde3533ca474d829a228c17aa692e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:11:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e100ffac-0158-4a24-a1ae-c89c3a098bb6 tempest-AttachVolumeTestJSON-109518034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (898f4a7d-3611-486b-a4ae-8ca131aca320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:11:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e100ffac-0158-4a24-a1ae-c89c3a098bb6 tempest-AttachVolumeTestJSON-109518034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (898f4a7d-3611-486b-a4ae-8ca131aca320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:11:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e100ffac-0158-4a24-a1ae-c89c3a098bb6 tempest-AttachVolumeTestJSON-109518034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab7fbe9-4712-4f30-b4e3-ae2d275831d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:11:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e100ffac-0158-4a24-a1ae-c89c3a098bb6 tempest-AttachVolumeTestJSON-109518034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab7fbe9-4712-4f30-b4e3-ae2d275831d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82f9f6f2-7c75-490f-b9d4-50998cb8b518', 'volume_name': 'volume-82f9f6f2-7c75-490f-b9d4-50998cb8b518', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:11:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e100ffac-0158-4a24-a1ae-c89c3a098bb6 tempest-AttachVolumeTestJSON-109518034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57e36c2a-53d1-4108-ab0e-ee1e6e33a931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:11:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e100ffac-0158-4a24-a1ae-c89c3a098bb6 tempest-AttachVolumeTestJSON-109518034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57e36c2a-53d1-4108-ab0e-ee1e6e33a931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:11:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e100ffac-0158-4a24-a1ae-c89c3a098bb6 tempest-AttachVolumeTestJSON-109518034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f120aa4-ec5c-49ab-9815-9a51f3846727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:11:32 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-e100ffac-0158-4a24-a1ae-c89c3a098bb6 tempest-AttachVolumeTestJSON-109518034 None] Volume 82f9f6f2-7c75-490f-b9d4-50998cb8b518: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82f9f6f2-7c75-490f-b9d4-50998cb8b518', 'volume_size': 1}
Nov 05 19:11:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e100ffac-0158-4a24-a1ae-c89c3a098bb6 tempest-AttachVolumeTestJSON-109518034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:11:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e100ffac-0158-4a24-a1ae-c89c3a098bb6 tempest-AttachVolumeTestJSON-109518034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:11:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e100ffac-0158-4a24-a1ae-c89c3a098bb6 tempest-AttachVolumeTestJSON-109518034 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-275098977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82f9f6f2-7c75-490f-b9d4-50998cb8b518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434a766411ee4ae2aee44844b8ec847a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:11:32Z,use_quota=True,user_id='0dde3533ca474d829a228c17aa692e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:11:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-e100ffac-0158-4a24-a1ae-c89c3a098bb6 tempest-AttachVolumeTestJSON-109518034 None] Creating volume 82f9f6f2-7c75-490f-b9d4-50998cb8b518 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:11:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e100ffac-0158-4a24-a1ae-c89c3a098bb6 tempest-AttachVolumeTestJSON-109518034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:11:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e100ffac-0158-4a24-a1ae-c89c3a098bb6 tempest-AttachVolumeTestJSON-109518034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:11:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e100ffac-0158-4a24-a1ae-c89c3a098bb6 tempest-AttachVolumeTestJSON-109518034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:11:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e100ffac-0158-4a24-a1ae-c89c3a098bb6 tempest-AttachVolumeTestJSON-109518034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:11:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e100ffac-0158-4a24-a1ae-c89c3a098bb6 tempest-AttachVolumeTestJSON-109518034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:11:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e100ffac-0158-4a24-a1ae-c89c3a098bb6 tempest-AttachVolumeTestJSON-109518034 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:11:32 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-e100ffac-0158-4a24-a1ae-c89c3a098bb6 tempest-AttachVolumeTestJSON-109518034 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:11:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e100ffac-0158-4a24-a1ae-c89c3a098bb6 tempest-AttachVolumeTestJSON-109518034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-82f9f6f2-7c75-490f-b9d4-50998cb8b518 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:11:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f9b430af-087c-4eab-a7ff-25d6af7dfe67 tempest-AttachVolumeNegativeTest-1202125091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bb89a7d-6dc0-4ac8-9629-6a510a19fb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6ee83b9-d5a3-4b43-889d-9ca2e7f5b769', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:11:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f9b430af-087c-4eab-a7ff-25d6af7dfe67 tempest-AttachVolumeNegativeTest-1202125091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8da66073-9d02-4d7c-ad4a-eec260df5d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:11:32 devstack sudo[93179]: pam_unix(sudo:session): session closed for user root
Nov 05 19:11:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0dfb662f-642c-46c3-9072-4dc4f15d719c tempest-SnapshotMetadataTestJSON-1197784354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a" returned: 0 in 1.099s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:11:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0dfb662f-642c-46c3-9072-4dc4f15d719c tempest-SnapshotMetadataTestJSON-1197784354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a.8e5c9a09-5bf7-4f7c-bd00-30a1c343851e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:11:32 devstack sudo[93210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-82f9f6f2-7c75-490f-b9d4-50998cb8b518 1073741824
Nov 05 19:11:32 devstack sudo[93210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:11:32 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-f9b430af-087c-4eab-a7ff-25d6af7dfe67 tempest-AttachVolumeNegativeTest-1202125091 None] Volume volume-f6ee83b9-d5a3-4b43-889d-9ca2e7f5b769 (f6ee83b9-d5a3-4b43-889d-9ca2e7f5b769): created successfully
Nov 05 19:11:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f9b430af-087c-4eab-a7ff-25d6af7dfe67 tempest-AttachVolumeNegativeTest-1202125091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8da66073-9d02-4d7c-ad4a-eec260df5d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:11:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f9b430af-087c-4eab-a7ff-25d6af7dfe67 tempest-AttachVolumeNegativeTest-1202125091 None] Flow 'volume_create_manager' (505a0247-a208-4b43-b120-229b33a8c4a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:11:32 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f9b430af-087c-4eab-a7ff-25d6af7dfe67 tempest-AttachVolumeNegativeTest-1202125091 None] Created volume successfully.
Nov 05 19:11:32 devstack sudo[93211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a.8e5c9a09-5bf7-4f7c-bd00-30a1c343851e
Nov 05 19:11:32 devstack sudo[93211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:11:33 devstack sudo[93211]: pam_unix(sudo:session): session closed for user root
Nov 05 19:11:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0dfb662f-642c-46c3-9072-4dc4f15d719c tempest-SnapshotMetadataTestJSON-1197784354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a.8e5c9a09-5bf7-4f7c-bd00-30a1c343851e" returned: 0 in 0.589s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:11:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0dfb662f-642c-46c3-9072-4dc4f15d719c tempest-SnapshotMetadataTestJSON-1197784354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a.8e5c9a09-5bf7-4f7c-bd00-30a1c343851e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:11:33 devstack sudo[93233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a.8e5c9a09-5bf7-4f7c-bd00-30a1c343851e
Nov 05 19:11:33 devstack sudo[93233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:11:33 devstack sudo[93210]: pam_unix(sudo:session): session closed for user root
Nov 05 19:11:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e100ffac-0158-4a24-a1ae-c89c3a098bb6 tempest-AttachVolumeTestJSON-109518034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-82f9f6f2-7c75-490f-b9d4-50998cb8b518 1073741824" returned: 0 in 0.752s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:11:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e100ffac-0158-4a24-a1ae-c89c3a098bb6 tempest-AttachVolumeTestJSON-109518034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-82f9f6f2-7c75-490f-b9d4-50998cb8b518 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:11:33 devstack sudo[93238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-82f9f6f2-7c75-490f-b9d4-50998cb8b518
Nov 05 19:11:33 devstack sudo[93238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:11:33 devstack sudo[93233]: pam_unix(sudo:session): session closed for user root
Nov 05 19:11:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0dfb662f-642c-46c3-9072-4dc4f15d719c tempest-SnapshotMetadataTestJSON-1197784354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a.8e5c9a09-5bf7-4f7c-bd00-30a1c343851e" returned: 0 in 0.487s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:11:33 devstack sudo[93238]: pam_unix(sudo:session): session closed for user root
Nov 05 19:11:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e100ffac-0158-4a24-a1ae-c89c3a098bb6 tempest-AttachVolumeTestJSON-109518034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-82f9f6f2-7c75-490f-b9d4-50998cb8b518" returned: 0 in 0.428s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:11:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e100ffac-0158-4a24-a1ae-c89c3a098bb6 tempest-AttachVolumeTestJSON-109518034 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:11:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e100ffac-0158-4a24-a1ae-c89c3a098bb6 tempest-AttachVolumeTestJSON-109518034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:11:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0dfb662f-642c-46c3-9072-4dc4f15d719c tempest-SnapshotMetadataTestJSON-1197784354 None] Lock "cinder-quobyte-8e5c9a09-5bf7-4f7c-bd00-30a1c343851e" released by "_delete_snapshot" :: held 3.386s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:11:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0dfb662f-642c-46c3-9072-4dc4f15d719c tempest-SnapshotMetadataTestJSON-1197784354 None] Lock "cinder-quobyte-ac16fbaa-cc24-49e4-b74c-7a0be873816a" released by "delete_snapshot" :: held 3.443s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:11:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e100ffac-0158-4a24-a1ae-c89c3a098bb6 tempest-AttachVolumeTestJSON-109518034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f120aa4-ec5c-49ab-9815-9a51f3846727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82f9f6f2-7c75-490f-b9d4-50998cb8b518', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:11:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e100ffac-0158-4a24-a1ae-c89c3a098bb6 tempest-AttachVolumeTestJSON-109518034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18187407-74b6-4e82-94db-0a55b693841b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:11:34 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-e100ffac-0158-4a24-a1ae-c89c3a098bb6 tempest-AttachVolumeTestJSON-109518034 None] Volume volume-82f9f6f2-7c75-490f-b9d4-50998cb8b518 (82f9f6f2-7c75-490f-b9d4-50998cb8b518): created successfully
Nov 05 19:11:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e100ffac-0158-4a24-a1ae-c89c3a098bb6 tempest-AttachVolumeTestJSON-109518034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18187407-74b6-4e82-94db-0a55b693841b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:11:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e100ffac-0158-4a24-a1ae-c89c3a098bb6 tempest-AttachVolumeTestJSON-109518034 None] Flow 'volume_create_manager' (5700c7e4-49cf-4eff-a10e-00867bb37d79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:11:34 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-e100ffac-0158-4a24-a1ae-c89c3a098bb6 tempest-AttachVolumeTestJSON-109518034 None] Created volume successfully.
Nov 05 19:11:34 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-0dfb662f-642c-46c3-9072-4dc4f15d719c tempest-SnapshotMetadataTestJSON-1197784354 None] Created reservations ['72e71812-d423-4f32-b2d7-41711a7c0a85', '686b5193-1f7e-4ebf-9cb5-1246e31272d7', 'd0d30231-5410-4bd3-9f95-45f296e82d15', 'e5c0c74e-3a1b-495a-a07d-ad028f83d407'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:11:34 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-0dfb662f-642c-46c3-9072-4dc4f15d719c tempest-SnapshotMetadataTestJSON-1197784354 None] Delete snapshot completed successfully.
Nov 05 19:11:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0dfb662f-642c-46c3-9072-4dc4f15d719c tempest-SnapshotMetadataTestJSON-1197784354 None] Lock "cinder-8e5c9a09-5bf7-4f7c-bd00-30a1c343851e-delete_snapshot" released by "delete_snapshot" :: held 3.797s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:11:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-1a0289c1-4c59-4c32-8c97-4b08f2847112 req-0e450277-1aaf-41ce-ba35-5aa258455fb5 tempest-AttachVolumeNegativeTest-1202125091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:11:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-1a0289c1-4c59-4c32-8c97-4b08f2847112 req-0e450277-1aaf-41ce-ba35-5aa258455fb5 tempest-AttachVolumeNegativeTest-1202125091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:11:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-1a0289c1-4c59-4c32-8c97-4b08f2847112 req-0e450277-1aaf-41ce-ba35-5aa258455fb5 tempest-AttachVolumeNegativeTest-1202125091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:11:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-1a0289c1-4c59-4c32-8c97-4b08f2847112 req-0e450277-1aaf-41ce-ba35-5aa258455fb5 tempest-AttachVolumeNegativeTest-1202125091 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec', 'name': 'volume-f6ee83b9-d5a3-4b43-889d-9ca2e7f5b769', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fa9349a3-5e73-4bc1-8240-871435d189e8', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 19:11:34 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-1a0289c1-4c59-4c32-8c97-4b08f2847112 req-0e450277-1aaf-41ce-ba35-5aa258455fb5 tempest-AttachVolumeNegativeTest-1202125091 None] attachment_update completed successfully.
Nov 05 19:11:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-95ca707b-0de8-4f57-953b-59535de171f0 tempest-SnapshotMetadataTestJSON-1197784354 None] Acquiring lock "cinder-ac16fbaa-cc24-49e4-b74c-7a0be873816a-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:11:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-95ca707b-0de8-4f57-953b-59535de171f0 tempest-SnapshotMetadataTestJSON-1197784354 None] Lock "cinder-ac16fbaa-cc24-49e4-b74c-7a0be873816a-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:11:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-95ca707b-0de8-4f57-953b-59535de171f0 tempest-SnapshotMetadataTestJSON-1197784354 None] Acquiring lock "cinder-quobyte-ac16fbaa-cc24-49e4-b74c-7a0be873816a" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:11:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-95ca707b-0de8-4f57-953b-59535de171f0 tempest-SnapshotMetadataTestJSON-1197784354 None] Lock "cinder-quobyte-ac16fbaa-cc24-49e4-b74c-7a0be873816a" acquired by "delete_volume" :: waited 0.041s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:11:35 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[921ead24-727b-4d00-81dc-4728993e72f9]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:11:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-95ca707b-0de8-4f57-953b-59535de171f0 tempest-SnapshotMetadataTestJSON-1197784354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:11:35 devstack sudo[93344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a
Nov 05 19:11:35 devstack sudo[93344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:11:36 devstack sudo[93344]: pam_unix(sudo:session): session closed for user root
Nov 05 19:11:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-95ca707b-0de8-4f57-953b-59535de171f0 tempest-SnapshotMetadataTestJSON-1197784354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a" returned: 0 in 0.847s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:11:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-95ca707b-0de8-4f57-953b-59535de171f0 tempest-SnapshotMetadataTestJSON-1197784354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:11:36 devstack sudo[93720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a
Nov 05 19:11:36 devstack sudo[93720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:11:36 devstack sudo[93720]: pam_unix(sudo:session): session closed for user root
Nov 05 19:11:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-95ca707b-0de8-4f57-953b-59535de171f0 tempest-SnapshotMetadataTestJSON-1197784354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ac16fbaa-cc24-49e4-b74c-7a0be873816a" returned: 0 in 0.765s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:11:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-95ca707b-0de8-4f57-953b-59535de171f0 tempest-SnapshotMetadataTestJSON-1197784354 None] Lock "cinder-quobyte-ac16fbaa-cc24-49e4-b74c-7a0be873816a" released by "delete_volume" :: held 1.795s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:11:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-205fa071-63e6-4c9a-a1cb-122255e4748e req-24a04088-dd76-4469-b070-c07f3f2de9bf tempest-AttachVolumeTestJSON-109518034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:11:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-205fa071-63e6-4c9a-a1cb-122255e4748e req-24a04088-dd76-4469-b070-c07f3f2de9bf tempest-AttachVolumeTestJSON-109518034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:11:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-205fa071-63e6-4c9a-a1cb-122255e4748e req-24a04088-dd76-4469-b070-c07f3f2de9bf tempest-AttachVolumeTestJSON-109518034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:11:37 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-95ca707b-0de8-4f57-953b-59535de171f0 tempest-SnapshotMetadataTestJSON-1197784354 None] Created reservations ['476f33dc-881a-4afe-899a-43f2462f5baa', 'e6a45381-5c11-4a90-9047-ab3a8913e12e', '4a2de7d3-8faa-4d65-9773-f20edb43d330', '259ac99e-fa26-41a0-b086-caa50af3c9f9'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:11:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-205fa071-63e6-4c9a-a1cb-122255e4748e req-24a04088-dd76-4469-b070-c07f3f2de9bf tempest-AttachVolumeTestJSON-109518034 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec', 'name': 'volume-82f9f6f2-7c75-490f-b9d4-50998cb8b518', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '06ce0e8e-522e-4f8a-a6f4-d3bf345225fc', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 19:11:37 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-205fa071-63e6-4c9a-a1cb-122255e4748e req-24a04088-dd76-4469-b070-c07f3f2de9bf tempest-AttachVolumeTestJSON-109518034 None] attachment_update completed successfully.
Nov 05 19:11:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-95ca707b-0de8-4f57-953b-59535de171f0 tempest-SnapshotMetadataTestJSON-1197784354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:11:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-95ca707b-0de8-4f57-953b-59535de171f0 tempest-SnapshotMetadataTestJSON-1197784354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:11:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-95ca707b-0de8-4f57-953b-59535de171f0 tempest-SnapshotMetadataTestJSON-1197784354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:11:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-95ca707b-0de8-4f57-953b-59535de171f0 tempest-SnapshotMetadataTestJSON-1197784354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:11:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-95ca707b-0de8-4f57-953b-59535de171f0 tempest-SnapshotMetadataTestJSON-1197784354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:11:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-95ca707b-0de8-4f57-953b-59535de171f0 tempest-SnapshotMetadataTestJSON-1197784354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:11:37 devstack sudo[93749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:11:37 devstack sudo[93749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:11:38 devstack sudo[93749]: pam_unix(sudo:session): session closed for user root
Nov 05 19:11:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-95ca707b-0de8-4f57-953b-59535de171f0 tempest-SnapshotMetadataTestJSON-1197784354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.672s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:11:38 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-95ca707b-0de8-4f57-953b-59535de171f0 tempest-SnapshotMetadataTestJSON-1197784354 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:11:38 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-95ca707b-0de8-4f57-953b-59535de171f0 tempest-SnapshotMetadataTestJSON-1197784354 None] Deleted volume successfully.
Nov 05 19:11:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-95ca707b-0de8-4f57-953b-59535de171f0 tempest-SnapshotMetadataTestJSON-1197784354 None] Lock "cinder-ac16fbaa-cc24-49e4-b74c-7a0be873816a-delete_volume" released by "delete_volume" :: held 3.082s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:11:41 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-deaec6e3-ed46-4549-a49f-c3d2dc191a61 tempest-AttachVolumeTestJSON-109518034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:11:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-deaec6e3-ed46-4549-a49f-c3d2dc191a61 tempest-AttachVolumeTestJSON-109518034 None] Flow 'volume_create_manager' (ec13be31-7d9b-40aa-9c6e-e46ec93b2085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:11:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-deaec6e3-ed46-4549-a49f-c3d2dc191a61 tempest-AttachVolumeTestJSON-109518034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a144686-2511-49e0-a7ed-2994e4675a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:11:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-deaec6e3-ed46-4549-a49f-c3d2dc191a61 tempest-AttachVolumeTestJSON-109518034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a144686-2511-49e0-a7ed-2994e4675a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-218804449',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87e86a6c-2258-4706-a321-ac517d2e6ae8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434a766411ee4ae2aee44844b8ec847a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:11:41Z,use_quota=True,user_id='0dde3533ca474d829a228c17aa692e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:11:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-deaec6e3-ed46-4549-a49f-c3d2dc191a61 tempest-AttachVolumeTestJSON-109518034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d97a473a-2317-4d41-9348-ebfb9c7bd9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:11:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-deaec6e3-ed46-4549-a49f-c3d2dc191a61 tempest-AttachVolumeTestJSON-109518034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d97a473a-2317-4d41-9348-ebfb9c7bd9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:11:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-deaec6e3-ed46-4549-a49f-c3d2dc191a61 tempest-AttachVolumeTestJSON-109518034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a57ee64-c1f6-4dcb-b5ca-9750f83a95ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:11:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-deaec6e3-ed46-4549-a49f-c3d2dc191a61 tempest-AttachVolumeTestJSON-109518034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a57ee64-c1f6-4dcb-b5ca-9750f83a95ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87e86a6c-2258-4706-a321-ac517d2e6ae8', 'volume_name': 'volume-87e86a6c-2258-4706-a321-ac517d2e6ae8', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:11:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-deaec6e3-ed46-4549-a49f-c3d2dc191a61 tempest-AttachVolumeTestJSON-109518034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbf29190-5f4e-46d5-a894-479addd267b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:11:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-deaec6e3-ed46-4549-a49f-c3d2dc191a61 tempest-AttachVolumeTestJSON-109518034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbf29190-5f4e-46d5-a894-479addd267b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:11:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-deaec6e3-ed46-4549-a49f-c3d2dc191a61 tempest-AttachVolumeTestJSON-109518034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (337bab1b-3183-4b84-b6c5-2f057a66caa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:11:41 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-deaec6e3-ed46-4549-a49f-c3d2dc191a61 tempest-AttachVolumeTestJSON-109518034 None] Volume 87e86a6c-2258-4706-a321-ac517d2e6ae8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87e86a6c-2258-4706-a321-ac517d2e6ae8', 'volume_size': 1}
Nov 05 19:11:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-deaec6e3-ed46-4549-a49f-c3d2dc191a61 tempest-AttachVolumeTestJSON-109518034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:11:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-deaec6e3-ed46-4549-a49f-c3d2dc191a61 tempest-AttachVolumeTestJSON-109518034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:11:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-deaec6e3-ed46-4549-a49f-c3d2dc191a61 tempest-AttachVolumeTestJSON-109518034 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-218804449',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87e86a6c-2258-4706-a321-ac517d2e6ae8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434a766411ee4ae2aee44844b8ec847a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:11:41Z,use_quota=True,user_id='0dde3533ca474d829a228c17aa692e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:11:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-deaec6e3-ed46-4549-a49f-c3d2dc191a61 tempest-AttachVolumeTestJSON-109518034 None] Creating volume 87e86a6c-2258-4706-a321-ac517d2e6ae8 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:11:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-deaec6e3-ed46-4549-a49f-c3d2dc191a61 tempest-AttachVolumeTestJSON-109518034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:11:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-deaec6e3-ed46-4549-a49f-c3d2dc191a61 tempest-AttachVolumeTestJSON-109518034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:11:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-deaec6e3-ed46-4549-a49f-c3d2dc191a61 tempest-AttachVolumeTestJSON-109518034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:11:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-deaec6e3-ed46-4549-a49f-c3d2dc191a61 tempest-AttachVolumeTestJSON-109518034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:11:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-deaec6e3-ed46-4549-a49f-c3d2dc191a61 tempest-AttachVolumeTestJSON-109518034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:11:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-deaec6e3-ed46-4549-a49f-c3d2dc191a61 tempest-AttachVolumeTestJSON-109518034 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:11:41 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-deaec6e3-ed46-4549-a49f-c3d2dc191a61 tempest-AttachVolumeTestJSON-109518034 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:11:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-deaec6e3-ed46-4549-a49f-c3d2dc191a61 tempest-AttachVolumeTestJSON-109518034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-87e86a6c-2258-4706-a321-ac517d2e6ae8 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:11:41 devstack sudo[93841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-87e86a6c-2258-4706-a321-ac517d2e6ae8 1073741824
Nov 05 19:11:41 devstack sudo[93841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:11:42 devstack sudo[93841]: pam_unix(sudo:session): session closed for user root
Nov 05 19:11:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-deaec6e3-ed46-4549-a49f-c3d2dc191a61 tempest-AttachVolumeTestJSON-109518034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-87e86a6c-2258-4706-a321-ac517d2e6ae8 1073741824" returned: 0 in 0.622s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:11:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-deaec6e3-ed46-4549-a49f-c3d2dc191a61 tempest-AttachVolumeTestJSON-109518034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-87e86a6c-2258-4706-a321-ac517d2e6ae8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:11:42 devstack sudo[93849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-87e86a6c-2258-4706-a321-ac517d2e6ae8
Nov 05 19:11:42 devstack sudo[93849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:11:42 devstack sudo[93849]: pam_unix(sudo:session): session closed for user root
Nov 05 19:11:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-deaec6e3-ed46-4549-a49f-c3d2dc191a61 tempest-AttachVolumeTestJSON-109518034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-87e86a6c-2258-4706-a321-ac517d2e6ae8" returned: 0 in 0.481s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:11:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-deaec6e3-ed46-4549-a49f-c3d2dc191a61 tempest-AttachVolumeTestJSON-109518034 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:11:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-deaec6e3-ed46-4549-a49f-c3d2dc191a61 tempest-AttachVolumeTestJSON-109518034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:11:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-deaec6e3-ed46-4549-a49f-c3d2dc191a61 tempest-AttachVolumeTestJSON-109518034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (337bab1b-3183-4b84-b6c5-2f057a66caa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87e86a6c-2258-4706-a321-ac517d2e6ae8', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:11:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-deaec6e3-ed46-4549-a49f-c3d2dc191a61 tempest-AttachVolumeTestJSON-109518034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31098e28-0ea5-41f6-9af4-1984b8670249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:11:42 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-deaec6e3-ed46-4549-a49f-c3d2dc191a61 tempest-AttachVolumeTestJSON-109518034 None] Volume volume-87e86a6c-2258-4706-a321-ac517d2e6ae8 (87e86a6c-2258-4706-a321-ac517d2e6ae8): created successfully
Nov 05 19:11:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-deaec6e3-ed46-4549-a49f-c3d2dc191a61 tempest-AttachVolumeTestJSON-109518034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31098e28-0ea5-41f6-9af4-1984b8670249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:11:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-deaec6e3-ed46-4549-a49f-c3d2dc191a61 tempest-AttachVolumeTestJSON-109518034 None] Flow 'volume_create_manager' (ec13be31-7d9b-40aa-9c6e-e46ec93b2085) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:11:42 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-deaec6e3-ed46-4549-a49f-c3d2dc191a61 tempest-AttachVolumeTestJSON-109518034 None] Created volume successfully.
Nov 05 19:11:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-316e237f-207b-47e8-b69c-2967f6b06453 req-17562877-26b7-4c20-bb3a-9a7955f4545b tempest-AttachVolumeTestJSON-109518034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:11:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-316e237f-207b-47e8-b69c-2967f6b06453 req-17562877-26b7-4c20-bb3a-9a7955f4545b tempest-AttachVolumeTestJSON-109518034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:11:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-316e237f-207b-47e8-b69c-2967f6b06453 req-17562877-26b7-4c20-bb3a-9a7955f4545b tempest-AttachVolumeTestJSON-109518034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:11:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-316e237f-207b-47e8-b69c-2967f6b06453 req-17562877-26b7-4c20-bb3a-9a7955f4545b tempest-AttachVolumeTestJSON-109518034 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec', 'name': 'volume-87e86a6c-2258-4706-a321-ac517d2e6ae8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9f0db49c-cbe0-44cd-a91e-2dcbbb780f11', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 19:11:44 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-316e237f-207b-47e8-b69c-2967f6b06453 req-17562877-26b7-4c20-bb3a-9a7955f4545b tempest-AttachVolumeTestJSON-109518034 None] attachment_update completed successfully.
Nov 05 19:11:46 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b09983ec-fad3-4b36-b24f-de7244d02e30 tempest-ServerRescueNegativeTestJSON-1819476679 None] Acquiring lock "cinder-164b8b7d-0210-47c4-a621-264864903088-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:11:46 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b09983ec-fad3-4b36-b24f-de7244d02e30 tempest-ServerRescueNegativeTestJSON-1819476679 None] Lock "cinder-164b8b7d-0210-47c4-a621-264864903088-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:11:46 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b09983ec-fad3-4b36-b24f-de7244d02e30 tempest-ServerRescueNegativeTestJSON-1819476679 None] Acquiring lock "cinder-quobyte-164b8b7d-0210-47c4-a621-264864903088" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:11:46 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b09983ec-fad3-4b36-b24f-de7244d02e30 tempest-ServerRescueNegativeTestJSON-1819476679 None] Lock "cinder-quobyte-164b8b7d-0210-47c4-a621-264864903088" acquired by "delete_volume" :: waited 0.034s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:11:46 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[157a8895-240c-4b78-9608-2346c6b0b930]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:11:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b09983ec-fad3-4b36-b24f-de7244d02e30 tempest-ServerRescueNegativeTestJSON-1819476679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-164b8b7d-0210-47c4-a621-264864903088 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:11:46 devstack sudo[93901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-164b8b7d-0210-47c4-a621-264864903088
Nov 05 19:11:46 devstack sudo[93901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:11:47 devstack sudo[93901]: pam_unix(sudo:session): session closed for user root
Nov 05 19:11:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b09983ec-fad3-4b36-b24f-de7244d02e30 tempest-ServerRescueNegativeTestJSON-1819476679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-164b8b7d-0210-47c4-a621-264864903088" returned: 0 in 0.635s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:11:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b09983ec-fad3-4b36-b24f-de7244d02e30 tempest-ServerRescueNegativeTestJSON-1819476679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-164b8b7d-0210-47c4-a621-264864903088 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:11:47 devstack sudo[93908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-164b8b7d-0210-47c4-a621-264864903088
Nov 05 19:11:47 devstack sudo[93908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:11:47 devstack sudo[93908]: pam_unix(sudo:session): session closed for user root
Nov 05 19:11:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b09983ec-fad3-4b36-b24f-de7244d02e30 tempest-ServerRescueNegativeTestJSON-1819476679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-164b8b7d-0210-47c4-a621-264864903088" returned: 0 in 0.553s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:11:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b09983ec-fad3-4b36-b24f-de7244d02e30 tempest-ServerRescueNegativeTestJSON-1819476679 None] Lock "cinder-quobyte-164b8b7d-0210-47c4-a621-264864903088" released by "delete_volume" :: held 1.293s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:11:48 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-b09983ec-fad3-4b36-b24f-de7244d02e30 tempest-ServerRescueNegativeTestJSON-1819476679 None] Created reservations ['dd385390-d1fc-4f32-a5c6-583eedda57ce', '47a60952-0565-4af5-a0df-8fb706fbd90f', '1a3264b4-5d58-452d-9b3b-f04a6f9bab51', '33f02c4a-6880-4ed4-815e-19f4411ccca5'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:11:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b09983ec-fad3-4b36-b24f-de7244d02e30 tempest-ServerRescueNegativeTestJSON-1819476679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:11:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b09983ec-fad3-4b36-b24f-de7244d02e30 tempest-ServerRescueNegativeTestJSON-1819476679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:11:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b09983ec-fad3-4b36-b24f-de7244d02e30 tempest-ServerRescueNegativeTestJSON-1819476679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:11:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b09983ec-fad3-4b36-b24f-de7244d02e30 tempest-ServerRescueNegativeTestJSON-1819476679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:11:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b09983ec-fad3-4b36-b24f-de7244d02e30 tempest-ServerRescueNegativeTestJSON-1819476679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:11:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b09983ec-fad3-4b36-b24f-de7244d02e30 tempest-ServerRescueNegativeTestJSON-1819476679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:11:48 devstack sudo[93924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:11:48 devstack sudo[93924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:11:49 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-4f7a3c6a-b33e-4b2b-83c5-7b8f22285066 req-85299efb-bb77-40a3-a507-bac62457bc86 tempest-AttachVolumeTestJSON-109518034 None] Terminate volume connection completed successfully.
Nov 05 19:11:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-4f7a3c6a-b33e-4b2b-83c5-7b8f22285066 req-85299efb-bb77-40a3-a507-bac62457bc86 tempest-AttachVolumeTestJSON-109518034 None] Deleting attachment 06ce0e8e-522e-4f8a-a6f4-d3bf345225fc. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 19:11:49 devstack sudo[93924]: pam_unix(sudo:session): session closed for user root
Nov 05 19:11:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b09983ec-fad3-4b36-b24f-de7244d02e30 tempest-ServerRescueNegativeTestJSON-1819476679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.918s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:11:49 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-b09983ec-fad3-4b36-b24f-de7244d02e30 tempest-ServerRescueNegativeTestJSON-1819476679 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:11:49 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b09983ec-fad3-4b36-b24f-de7244d02e30 tempest-ServerRescueNegativeTestJSON-1819476679 None] Deleted volume successfully.
Nov 05 19:11:49 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b09983ec-fad3-4b36-b24f-de7244d02e30 tempest-ServerRescueNegativeTestJSON-1819476679 None] Lock "cinder-164b8b7d-0210-47c4-a621-264864903088-delete_volume" released by "delete_volume" :: held 2.810s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:11:51 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-01225de3-7607-48a4-8f1f-17b0dc4c5375 req-392c2882-1f4f-4554-8d50-a74574ef09a7 tempest-AttachVolumeTestJSON-109518034 None] Terminate volume connection completed successfully.
Nov 05 19:11:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-01225de3-7607-48a4-8f1f-17b0dc4c5375 req-392c2882-1f4f-4554-8d50-a74574ef09a7 tempest-AttachVolumeTestJSON-109518034 None] Deleting attachment 9f0db49c-cbe0-44cd-a91e-2dcbbb780f11. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 19:11:56 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-44a4b808-bce4-44c6-9113-bc022ab2776c tempest-AbsoluteLimitsTests-2038597614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:11:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-44a4b808-bce4-44c6-9113-bc022ab2776c tempest-AbsoluteLimitsTests-2038597614 None] Flow 'volume_create_manager' (412586d6-781e-41ca-b874-d71c86ae9023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:11:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-44a4b808-bce4-44c6-9113-bc022ab2776c tempest-AbsoluteLimitsTests-2038597614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39505d76-591b-40ad-9ce1-1b504aedf5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:11:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-44a4b808-bce4-44c6-9113-bc022ab2776c tempest-AbsoluteLimitsTests-2038597614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39505d76-591b-40ad-9ce1-1b504aedf5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-495934865',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=651efc96-4674-451b-b27b-c6342977d23e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d106c5e95b1a4d74990c749d2129c604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:11:57Z,use_quota=True,user_id='9974a437615c4033888969a24864b519',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:11:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-44a4b808-bce4-44c6-9113-bc022ab2776c tempest-AbsoluteLimitsTests-2038597614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07438767-d90c-4383-9948-b4faf03b4fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:11:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-44a4b808-bce4-44c6-9113-bc022ab2776c tempest-AbsoluteLimitsTests-2038597614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07438767-d90c-4383-9948-b4faf03b4fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:11:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-44a4b808-bce4-44c6-9113-bc022ab2776c tempest-AbsoluteLimitsTests-2038597614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (459d243b-91c9-4597-aaca-8c1bf065cb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:11:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-44a4b808-bce4-44c6-9113-bc022ab2776c tempest-AbsoluteLimitsTests-2038597614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (459d243b-91c9-4597-aaca-8c1bf065cb36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '651efc96-4674-451b-b27b-c6342977d23e', 'volume_name': 'volume-651efc96-4674-451b-b27b-c6342977d23e', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:11:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-44a4b808-bce4-44c6-9113-bc022ab2776c tempest-AbsoluteLimitsTests-2038597614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de165cbd-9304-48bf-9ed2-1e015cf7cc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:11:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-44a4b808-bce4-44c6-9113-bc022ab2776c tempest-AbsoluteLimitsTests-2038597614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de165cbd-9304-48bf-9ed2-1e015cf7cc73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:11:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-44a4b808-bce4-44c6-9113-bc022ab2776c tempest-AbsoluteLimitsTests-2038597614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce5ebef0-7603-4791-ae0e-36ec4142719b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:11:56 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-44a4b808-bce4-44c6-9113-bc022ab2776c tempest-AbsoluteLimitsTests-2038597614 None] Volume 651efc96-4674-451b-b27b-c6342977d23e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-651efc96-4674-451b-b27b-c6342977d23e', 'volume_size': 1}
Nov 05 19:11:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-44a4b808-bce4-44c6-9113-bc022ab2776c tempest-AbsoluteLimitsTests-2038597614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:11:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-44a4b808-bce4-44c6-9113-bc022ab2776c tempest-AbsoluteLimitsTests-2038597614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:11:56 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-44a4b808-bce4-44c6-9113-bc022ab2776c tempest-AbsoluteLimitsTests-2038597614 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-495934865',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=651efc96-4674-451b-b27b-c6342977d23e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d106c5e95b1a4d74990c749d2129c604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:11:57Z,use_quota=True,user_id='9974a437615c4033888969a24864b519',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:11:56 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-44a4b808-bce4-44c6-9113-bc022ab2776c tempest-AbsoluteLimitsTests-2038597614 None] Creating volume 651efc96-4674-451b-b27b-c6342977d23e {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:11:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-44a4b808-bce4-44c6-9113-bc022ab2776c tempest-AbsoluteLimitsTests-2038597614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:11:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-44a4b808-bce4-44c6-9113-bc022ab2776c tempest-AbsoluteLimitsTests-2038597614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:11:56 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-44a4b808-bce4-44c6-9113-bc022ab2776c tempest-AbsoluteLimitsTests-2038597614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:11:56 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-44a4b808-bce4-44c6-9113-bc022ab2776c tempest-AbsoluteLimitsTests-2038597614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:11:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-44a4b808-bce4-44c6-9113-bc022ab2776c tempest-AbsoluteLimitsTests-2038597614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:11:56 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-44a4b808-bce4-44c6-9113-bc022ab2776c tempest-AbsoluteLimitsTests-2038597614 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:11:56 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-44a4b808-bce4-44c6-9113-bc022ab2776c tempest-AbsoluteLimitsTests-2038597614 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:11:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-44a4b808-bce4-44c6-9113-bc022ab2776c tempest-AbsoluteLimitsTests-2038597614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-651efc96-4674-451b-b27b-c6342977d23e 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:11:56 devstack sudo[94078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-651efc96-4674-451b-b27b-c6342977d23e 1073741824
Nov 05 19:11:56 devstack sudo[94078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:11:57 devstack sudo[94078]: pam_unix(sudo:session): session closed for user root
Nov 05 19:11:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-44a4b808-bce4-44c6-9113-bc022ab2776c tempest-AbsoluteLimitsTests-2038597614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-651efc96-4674-451b-b27b-c6342977d23e 1073741824" returned: 0 in 0.828s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:11:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-44a4b808-bce4-44c6-9113-bc022ab2776c tempest-AbsoluteLimitsTests-2038597614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-651efc96-4674-451b-b27b-c6342977d23e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:11:57 devstack sudo[94085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-651efc96-4674-451b-b27b-c6342977d23e
Nov 05 19:11:57 devstack sudo[94085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:11:58 devstack sudo[94085]: pam_unix(sudo:session): session closed for user root
Nov 05 19:11:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-44a4b808-bce4-44c6-9113-bc022ab2776c tempest-AbsoluteLimitsTests-2038597614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-651efc96-4674-451b-b27b-c6342977d23e" returned: 0 in 0.425s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:11:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-44a4b808-bce4-44c6-9113-bc022ab2776c tempest-AbsoluteLimitsTests-2038597614 None] <== create_volume: return (1311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:11:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-44a4b808-bce4-44c6-9113-bc022ab2776c tempest-AbsoluteLimitsTests-2038597614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:11:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-44a4b808-bce4-44c6-9113-bc022ab2776c tempest-AbsoluteLimitsTests-2038597614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce5ebef0-7603-4791-ae0e-36ec4142719b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-651efc96-4674-451b-b27b-c6342977d23e', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:11:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-44a4b808-bce4-44c6-9113-bc022ab2776c tempest-AbsoluteLimitsTests-2038597614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d2a4fc0-719d-4833-9723-99e7dce93c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:11:58 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-44a4b808-bce4-44c6-9113-bc022ab2776c tempest-AbsoluteLimitsTests-2038597614 None] Volume volume-651efc96-4674-451b-b27b-c6342977d23e (651efc96-4674-451b-b27b-c6342977d23e): created successfully
Nov 05 19:11:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-44a4b808-bce4-44c6-9113-bc022ab2776c tempest-AbsoluteLimitsTests-2038597614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d2a4fc0-719d-4833-9723-99e7dce93c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:11:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-44a4b808-bce4-44c6-9113-bc022ab2776c tempest-AbsoluteLimitsTests-2038597614 None] Flow 'volume_create_manager' (412586d6-781e-41ca-b874-d71c86ae9023) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:11:58 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-44a4b808-bce4-44c6-9113-bc022ab2776c tempest-AbsoluteLimitsTests-2038597614 None] Created volume successfully.
Nov 05 19:11:59 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d49935d3-2e2e-4a51-b394-55f64373dcc0 tempest-AbsoluteLimitsTests-2038597614 None] Acquiring lock "cinder-651efc96-4674-451b-b27b-c6342977d23e-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:11:59 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d49935d3-2e2e-4a51-b394-55f64373dcc0 tempest-AbsoluteLimitsTests-2038597614 None] Lock "cinder-651efc96-4674-451b-b27b-c6342977d23e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:11:59 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d49935d3-2e2e-4a51-b394-55f64373dcc0 tempest-AbsoluteLimitsTests-2038597614 None] Acquiring lock "cinder-quobyte-651efc96-4674-451b-b27b-c6342977d23e" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:11:59 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d49935d3-2e2e-4a51-b394-55f64373dcc0 tempest-AbsoluteLimitsTests-2038597614 None] Lock "cinder-quobyte-651efc96-4674-451b-b27b-c6342977d23e" acquired by "delete_volume" :: waited 0.031s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:11:59 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59a880b-6a67-4553-8b1e-93be531104dd]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:11:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d49935d3-2e2e-4a51-b394-55f64373dcc0 tempest-AbsoluteLimitsTests-2038597614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-651efc96-4674-451b-b27b-c6342977d23e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:11:59 devstack sudo[94093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-651efc96-4674-451b-b27b-c6342977d23e
Nov 05 19:11:59 devstack sudo[94093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b77f9dc7-9054-4751-bc9b-2439a645af85 tempest-AttachVolumeTestJSON-109518034 None] Acquiring lock "cinder-87e86a6c-2258-4706-a321-ac517d2e6ae8-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:12:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b77f9dc7-9054-4751-bc9b-2439a645af85 tempest-AttachVolumeTestJSON-109518034 None] Lock "cinder-87e86a6c-2258-4706-a321-ac517d2e6ae8-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:12:00 devstack sudo[94093]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d49935d3-2e2e-4a51-b394-55f64373dcc0 tempest-AbsoluteLimitsTests-2038597614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-651efc96-4674-451b-b27b-c6342977d23e" returned: 0 in 0.727s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d49935d3-2e2e-4a51-b394-55f64373dcc0 tempest-AbsoluteLimitsTests-2038597614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-651efc96-4674-451b-b27b-c6342977d23e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b77f9dc7-9054-4751-bc9b-2439a645af85 tempest-AttachVolumeTestJSON-109518034 None] Acquiring lock "cinder-quobyte-87e86a6c-2258-4706-a321-ac517d2e6ae8" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:12:00 devstack sudo[94098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-651efc96-4674-451b-b27b-c6342977d23e
Nov 05 19:12:00 devstack sudo[94098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b77f9dc7-9054-4751-bc9b-2439a645af85 tempest-AttachVolumeTestJSON-109518034 None] Lock "cinder-quobyte-87e86a6c-2258-4706-a321-ac517d2e6ae8" acquired by "delete_volume" :: waited 0.052s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:12:00 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[924217a4-aff8-4cc7-b36a-93759845d746]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:12:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b77f9dc7-9054-4751-bc9b-2439a645af85 tempest-AttachVolumeTestJSON-109518034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-87e86a6c-2258-4706-a321-ac517d2e6ae8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:00 devstack sudo[94100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-87e86a6c-2258-4706-a321-ac517d2e6ae8
Nov 05 19:12:00 devstack sudo[94100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:00 devstack sudo[94098]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d49935d3-2e2e-4a51-b394-55f64373dcc0 tempest-AbsoluteLimitsTests-2038597614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-651efc96-4674-451b-b27b-c6342977d23e" returned: 0 in 0.555s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d49935d3-2e2e-4a51-b394-55f64373dcc0 tempest-AbsoluteLimitsTests-2038597614 None] Lock "cinder-quobyte-651efc96-4674-451b-b27b-c6342977d23e" released by "delete_volume" :: held 1.398s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:12:00 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-d49935d3-2e2e-4a51-b394-55f64373dcc0 tempest-AbsoluteLimitsTests-2038597614 None] Created reservations ['db3144fa-a275-4c11-b8ff-45d5706417df', '08b7470e-2651-490c-a776-6fab2cc960dd', '9da1ee94-54af-4452-afe8-8ad310a7a32e', 'e63c8f4d-4256-4408-93c9-0a9f1f129cde'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:12:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d49935d3-2e2e-4a51-b394-55f64373dcc0 tempest-AbsoluteLimitsTests-2038597614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:12:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d49935d3-2e2e-4a51-b394-55f64373dcc0 tempest-AbsoluteLimitsTests-2038597614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:12:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d49935d3-2e2e-4a51-b394-55f64373dcc0 tempest-AbsoluteLimitsTests-2038597614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:12:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d49935d3-2e2e-4a51-b394-55f64373dcc0 tempest-AbsoluteLimitsTests-2038597614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:12:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d49935d3-2e2e-4a51-b394-55f64373dcc0 tempest-AbsoluteLimitsTests-2038597614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:12:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d49935d3-2e2e-4a51-b394-55f64373dcc0 tempest-AbsoluteLimitsTests-2038597614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:01 devstack sudo[94100]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b77f9dc7-9054-4751-bc9b-2439a645af85 tempest-AttachVolumeTestJSON-109518034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-87e86a6c-2258-4706-a321-ac517d2e6ae8" returned: 0 in 0.749s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b77f9dc7-9054-4751-bc9b-2439a645af85 tempest-AttachVolumeTestJSON-109518034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-87e86a6c-2258-4706-a321-ac517d2e6ae8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:01 devstack sudo[94107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:12:01 devstack sudo[94107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:01 devstack sudo[94109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-87e86a6c-2258-4706-a321-ac517d2e6ae8
Nov 05 19:12:01 devstack sudo[94109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:01 devstack sudo[94107]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d49935d3-2e2e-4a51-b394-55f64373dcc0 tempest-AbsoluteLimitsTests-2038597614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.337s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:01 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-d49935d3-2e2e-4a51-b394-55f64373dcc0 tempest-AbsoluteLimitsTests-2038597614 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:12:01 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-d49935d3-2e2e-4a51-b394-55f64373dcc0 tempest-AbsoluteLimitsTests-2038597614 None] Deleted volume successfully.
Nov 05 19:12:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d49935d3-2e2e-4a51-b394-55f64373dcc0 tempest-AbsoluteLimitsTests-2038597614 None] Lock "cinder-651efc96-4674-451b-b27b-c6342977d23e-delete_volume" released by "delete_volume" :: held 2.175s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:12:01 devstack sudo[94109]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b77f9dc7-9054-4751-bc9b-2439a645af85 tempest-AttachVolumeTestJSON-109518034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-87e86a6c-2258-4706-a321-ac517d2e6ae8" returned: 0 in 0.569s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b77f9dc7-9054-4751-bc9b-2439a645af85 tempest-AttachVolumeTestJSON-109518034 None] Lock "cinder-quobyte-87e86a6c-2258-4706-a321-ac517d2e6ae8" released by "delete_volume" :: held 1.392s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:12:01 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-b77f9dc7-9054-4751-bc9b-2439a645af85 tempest-AttachVolumeTestJSON-109518034 None] Created reservations ['26244acb-2341-4a8d-a4f0-a418fe2af131', '117ca7fa-9fae-4ae0-a330-faf321239e89', '3df21fd7-94de-4a86-9940-3a31ba34ca7c', '89ca6f78-69da-4e46-9d81-4a5352a65e9b'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:12:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b77f9dc7-9054-4751-bc9b-2439a645af85 tempest-AttachVolumeTestJSON-109518034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:12:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b77f9dc7-9054-4751-bc9b-2439a645af85 tempest-AttachVolumeTestJSON-109518034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:12:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b77f9dc7-9054-4751-bc9b-2439a645af85 tempest-AttachVolumeTestJSON-109518034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:12:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b77f9dc7-9054-4751-bc9b-2439a645af85 tempest-AttachVolumeTestJSON-109518034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:12:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b77f9dc7-9054-4751-bc9b-2439a645af85 tempest-AttachVolumeTestJSON-109518034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:12:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b77f9dc7-9054-4751-bc9b-2439a645af85 tempest-AttachVolumeTestJSON-109518034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:01 devstack sudo[94114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:12:01 devstack sudo[94114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:02 devstack sudo[94114]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b77f9dc7-9054-4751-bc9b-2439a645af85 tempest-AttachVolumeTestJSON-109518034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.291s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:02 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-b77f9dc7-9054-4751-bc9b-2439a645af85 tempest-AttachVolumeTestJSON-109518034 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:12:02 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b77f9dc7-9054-4751-bc9b-2439a645af85 tempest-AttachVolumeTestJSON-109518034 None] Deleted volume successfully.
Nov 05 19:12:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b77f9dc7-9054-4751-bc9b-2439a645af85 tempest-AttachVolumeTestJSON-109518034 None] Lock "cinder-87e86a6c-2258-4706-a321-ac517d2e6ae8-delete_volume" released by "delete_volume" :: held 2.031s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:12:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b1a28dd0-9fdc-4afb-8086-49cfa06c271d tempest-AttachVolumeTestJSON-109518034 None] Acquiring lock "cinder-82f9f6f2-7c75-490f-b9d4-50998cb8b518-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:12:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b1a28dd0-9fdc-4afb-8086-49cfa06c271d tempest-AttachVolumeTestJSON-109518034 None] Lock "cinder-82f9f6f2-7c75-490f-b9d4-50998cb8b518-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:12:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b1a28dd0-9fdc-4afb-8086-49cfa06c271d tempest-AttachVolumeTestJSON-109518034 None] Acquiring lock "cinder-quobyte-82f9f6f2-7c75-490f-b9d4-50998cb8b518" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:12:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b1a28dd0-9fdc-4afb-8086-49cfa06c271d tempest-AttachVolumeTestJSON-109518034 None] Lock "cinder-quobyte-82f9f6f2-7c75-490f-b9d4-50998cb8b518" acquired by "delete_volume" :: waited 0.032s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:12:02 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fa2bfc-e71e-440f-b87c-751563ef1dbe]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:12:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b1a28dd0-9fdc-4afb-8086-49cfa06c271d tempest-AttachVolumeTestJSON-109518034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-82f9f6f2-7c75-490f-b9d4-50998cb8b518 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:02 devstack sudo[94118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-82f9f6f2-7c75-490f-b9d4-50998cb8b518
Nov 05 19:12:02 devstack sudo[94118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:03 devstack sudo[94118]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b1a28dd0-9fdc-4afb-8086-49cfa06c271d tempest-AttachVolumeTestJSON-109518034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-82f9f6f2-7c75-490f-b9d4-50998cb8b518" returned: 0 in 0.509s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b1a28dd0-9fdc-4afb-8086-49cfa06c271d tempest-AttachVolumeTestJSON-109518034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-82f9f6f2-7c75-490f-b9d4-50998cb8b518 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:03 devstack sudo[94124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-82f9f6f2-7c75-490f-b9d4-50998cb8b518
Nov 05 19:12:03 devstack sudo[94124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:03 devstack sudo[94124]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b1a28dd0-9fdc-4afb-8086-49cfa06c271d tempest-AttachVolumeTestJSON-109518034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-82f9f6f2-7c75-490f-b9d4-50998cb8b518" returned: 0 in 0.315s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b1a28dd0-9fdc-4afb-8086-49cfa06c271d tempest-AttachVolumeTestJSON-109518034 None] Lock "cinder-quobyte-82f9f6f2-7c75-490f-b9d4-50998cb8b518" released by "delete_volume" :: held 0.892s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:12:03 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-b1a28dd0-9fdc-4afb-8086-49cfa06c271d tempest-AttachVolumeTestJSON-109518034 None] Created reservations ['42bb2db9-32d2-41d9-beed-9672f6ccb50b', 'd4bd48ab-7c09-4781-8417-0e5e5b615b51', 'dc2b3c82-82b0-43a7-a453-9cbe9bd76473', '2c283e89-d270-48e1-887f-25ecce2cbd24'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:12:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b1a28dd0-9fdc-4afb-8086-49cfa06c271d tempest-AttachVolumeTestJSON-109518034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:12:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b1a28dd0-9fdc-4afb-8086-49cfa06c271d tempest-AttachVolumeTestJSON-109518034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:12:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b1a28dd0-9fdc-4afb-8086-49cfa06c271d tempest-AttachVolumeTestJSON-109518034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:12:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b1a28dd0-9fdc-4afb-8086-49cfa06c271d tempest-AttachVolumeTestJSON-109518034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:12:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b1a28dd0-9fdc-4afb-8086-49cfa06c271d tempest-AttachVolumeTestJSON-109518034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:12:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b1a28dd0-9fdc-4afb-8086-49cfa06c271d tempest-AttachVolumeTestJSON-109518034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:03 devstack sudo[94127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:12:03 devstack sudo[94127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0dd0da12-8b74-4017-85a5-eecfe42e0839 tempest-AttachVolumeTestJSON-109518034 None] Acquiring lock "cinder-988c0e11-3915-4a98-833f-6982adb369b8-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:12:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0dd0da12-8b74-4017-85a5-eecfe42e0839 tempest-AttachVolumeTestJSON-109518034 None] Lock "cinder-988c0e11-3915-4a98-833f-6982adb369b8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:12:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0dd0da12-8b74-4017-85a5-eecfe42e0839 tempest-AttachVolumeTestJSON-109518034 None] Acquiring lock "cinder-quobyte-988c0e11-3915-4a98-833f-6982adb369b8" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:12:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0dd0da12-8b74-4017-85a5-eecfe42e0839 tempest-AttachVolumeTestJSON-109518034 None] Lock "cinder-quobyte-988c0e11-3915-4a98-833f-6982adb369b8" acquired by "delete_volume" :: waited 0.034s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:12:04 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c704b3df-321c-412e-ae0e-99afae381393]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:12:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0dd0da12-8b74-4017-85a5-eecfe42e0839 tempest-AttachVolumeTestJSON-109518034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-988c0e11-3915-4a98-833f-6982adb369b8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:04 devstack sudo[94127]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b1a28dd0-9fdc-4afb-8086-49cfa06c271d tempest-AttachVolumeTestJSON-109518034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.594s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:04 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-b1a28dd0-9fdc-4afb-8086-49cfa06c271d tempest-AttachVolumeTestJSON-109518034 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:12:04 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b1a28dd0-9fdc-4afb-8086-49cfa06c271d tempest-AttachVolumeTestJSON-109518034 None] Deleted volume successfully.
Nov 05 19:12:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b1a28dd0-9fdc-4afb-8086-49cfa06c271d tempest-AttachVolumeTestJSON-109518034 None] Lock "cinder-82f9f6f2-7c75-490f-b9d4-50998cb8b518-delete_volume" released by "delete_volume" :: held 1.856s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:12:04 devstack sudo[94130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-988c0e11-3915-4a98-833f-6982adb369b8
Nov 05 19:12:04 devstack sudo[94130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:04 devstack sudo[94130]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0dd0da12-8b74-4017-85a5-eecfe42e0839 tempest-AttachVolumeTestJSON-109518034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-988c0e11-3915-4a98-833f-6982adb369b8" returned: 0 in 0.541s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0dd0da12-8b74-4017-85a5-eecfe42e0839 tempest-AttachVolumeTestJSON-109518034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-988c0e11-3915-4a98-833f-6982adb369b8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:04 devstack sudo[94135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-988c0e11-3915-4a98-833f-6982adb369b8
Nov 05 19:12:04 devstack sudo[94135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:12:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:12:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:12:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:12:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:12:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:12:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:05 devstack sudo[94135]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0dd0da12-8b74-4017-85a5-eecfe42e0839 tempest-AttachVolumeTestJSON-109518034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-988c0e11-3915-4a98-833f-6982adb369b8" returned: 0 in 0.419s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:05 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0dd0da12-8b74-4017-85a5-eecfe42e0839 tempest-AttachVolumeTestJSON-109518034 None] Lock "cinder-quobyte-988c0e11-3915-4a98-833f-6982adb369b8" released by "delete_volume" :: held 1.073s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:12:05 devstack sudo[94138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:12:05 devstack sudo[94138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:05 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-0dd0da12-8b74-4017-85a5-eecfe42e0839 tempest-AttachVolumeTestJSON-109518034 None] Created reservations ['858c105d-853c-4a2a-bf91-2a0837b6a8f8', '9294dc9f-4272-4ebc-9aeb-2ce6c51bdb8b', '6d70d838-b7e0-48fd-8874-37f576bc049b', 'bfb2b04a-c97b-4e6e-bd2b-fbdfac414384'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:12:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0dd0da12-8b74-4017-85a5-eecfe42e0839 tempest-AttachVolumeTestJSON-109518034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:12:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0dd0da12-8b74-4017-85a5-eecfe42e0839 tempest-AttachVolumeTestJSON-109518034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:12:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0dd0da12-8b74-4017-85a5-eecfe42e0839 tempest-AttachVolumeTestJSON-109518034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:12:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0dd0da12-8b74-4017-85a5-eecfe42e0839 tempest-AttachVolumeTestJSON-109518034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:12:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0dd0da12-8b74-4017-85a5-eecfe42e0839 tempest-AttachVolumeTestJSON-109518034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:12:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0dd0da12-8b74-4017-85a5-eecfe42e0839 tempest-AttachVolumeTestJSON-109518034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:05 devstack sudo[94140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:12:05 devstack sudo[94140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:05 devstack sudo[94138]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.367s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:05 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:12:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:12:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread count: 28 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 19:12:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread info: [<_MainThread(MainThread, started 126882883072128)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126882770872512)>, <Thread(Thread-3 (stat_writer), started daemon 126882769837376)>, <Thread(Rabbit-heartbeat, started daemon 126882768896256)>, <Thread(Thread-5 (_runner), started daemon 126882768980928)>, <Thread(Thread-7 (_runner), started daemon 126882767016448)>, <Thread(fd_logger, started daemon 126882764561216)>, <Thread(privsep_reader, started daemon 126882764568576)>, <Thread(tpool_thread_0, started daemon 126882759292608)>, <Thread(tpool_thread_1, started daemon 126882750899904)>, <Thread(tpool_thread_2, started daemon 126882742507200)>, <Thread(tpool_thread_3, started daemon 126882734114496)>, <Thread(tpool_thread_4, started daemon 126882725721792)>, <Thread(tpool_thread_5, started daemon 126882717329088)>, <Thread(tpool_thread_6, started daemon 126882708920000)>, <Thread(tpool_thread_7, started daemon 126882700510912)>, <Thread(tpool_thread_8, started daemon 126882692101824)>, <Thread(tpool_thread_9, started daemon 126882683692736)>, <Thread(tpool_thread_10, started daemon 126882675283648)>, <Thread(tpool_thread_11, started daemon 126882666874560)>, <Thread(tpool_thread_12, started daemon 126882658465472)>, <Thread(tpool_thread_13, started daemon 126882650056384)>, <Thread(tpool_thread_14, started daemon 126882641647296)>, <Thread(tpool_thread_15, started daemon 126882633238208)>, <Thread(tpool_thread_16, started daemon 126882624829120)>, <Thread(tpool_thread_17, started daemon 126882616420032)>, <Thread(tpool_thread_18, started daemon 126882608010944)>, <Thread(tpool_thread_19, started daemon 126882599601856)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 19:12:05 devstack sudo[94140]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0dd0da12-8b74-4017-85a5-eecfe42e0839 tempest-AttachVolumeTestJSON-109518034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.345s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:05 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-0dd0da12-8b74-4017-85a5-eecfe42e0839 tempest-AttachVolumeTestJSON-109518034 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:12:05 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-0dd0da12-8b74-4017-85a5-eecfe42e0839 tempest-AttachVolumeTestJSON-109518034 None] Deleted volume successfully.
Nov 05 19:12:05 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0dd0da12-8b74-4017-85a5-eecfe42e0839 tempest-AttachVolumeTestJSON-109518034 None] Lock "cinder-988c0e11-3915-4a98-833f-6982adb369b8-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:12:11 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-a61a6664-86a8-4938-8df2-a751079b0c29 tempest-VolumesTransfersV357Test-1901152430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:12:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a61a6664-86a8-4938-8df2-a751079b0c29 tempest-VolumesTransfersV357Test-1901152430 None] Flow 'volume_create_manager' (fe7a3b80-1e4b-4679-a166-3b8613c8c4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:12:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a61a6664-86a8-4938-8df2-a751079b0c29 tempest-VolumesTransfersV357Test-1901152430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66bfe4d9-30a4-464c-aee7-b561415f20df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a61a6664-86a8-4938-8df2-a751079b0c29 tempest-VolumesTransfersV357Test-1901152430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66bfe4d9-30a4-464c-aee7-b561415f20df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-380416077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25d0f44a-0728-4d6a-af5e-b8e3f17fbc1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcbbd5b9289142e59a161acd42c7c43e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:12:12Z,use_quota=True,user_id='b5b8a9ef708f4fafaa8a3a39f43e3bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a61a6664-86a8-4938-8df2-a751079b0c29 tempest-VolumesTransfersV357Test-1901152430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5becbbb-fffb-4a22-a069-13aa6fc539eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a61a6664-86a8-4938-8df2-a751079b0c29 tempest-VolumesTransfersV357Test-1901152430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5becbbb-fffb-4a22-a069-13aa6fc539eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a61a6664-86a8-4938-8df2-a751079b0c29 tempest-VolumesTransfersV357Test-1901152430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58747c14-2f8f-4cfb-a0d6-00f62b266012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a61a6664-86a8-4938-8df2-a751079b0c29 tempest-VolumesTransfersV357Test-1901152430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58747c14-2f8f-4cfb-a0d6-00f62b266012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25d0f44a-0728-4d6a-af5e-b8e3f17fbc1b', 'volume_name': 'volume-25d0f44a-0728-4d6a-af5e-b8e3f17fbc1b', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a61a6664-86a8-4938-8df2-a751079b0c29 tempest-VolumesTransfersV357Test-1901152430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3120df9-73ee-419b-9416-562639a17cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a61a6664-86a8-4938-8df2-a751079b0c29 tempest-VolumesTransfersV357Test-1901152430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3120df9-73ee-419b-9416-562639a17cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a61a6664-86a8-4938-8df2-a751079b0c29 tempest-VolumesTransfersV357Test-1901152430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4608aa55-e26d-4510-90e4-5d7b46f0f7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:11 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-a61a6664-86a8-4938-8df2-a751079b0c29 tempest-VolumesTransfersV357Test-1901152430 None] Volume 25d0f44a-0728-4d6a-af5e-b8e3f17fbc1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25d0f44a-0728-4d6a-af5e-b8e3f17fbc1b', 'volume_size': 1}
Nov 05 19:12:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a61a6664-86a8-4938-8df2-a751079b0c29 tempest-VolumesTransfersV357Test-1901152430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:12:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a61a6664-86a8-4938-8df2-a751079b0c29 tempest-VolumesTransfersV357Test-1901152430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:12:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a61a6664-86a8-4938-8df2-a751079b0c29 tempest-VolumesTransfersV357Test-1901152430 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-380416077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25d0f44a-0728-4d6a-af5e-b8e3f17fbc1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcbbd5b9289142e59a161acd42c7c43e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:12:12Z,use_quota=True,user_id='b5b8a9ef708f4fafaa8a3a39f43e3bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:12:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-a61a6664-86a8-4938-8df2-a751079b0c29 tempest-VolumesTransfersV357Test-1901152430 None] Creating volume 25d0f44a-0728-4d6a-af5e-b8e3f17fbc1b {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:12:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a61a6664-86a8-4938-8df2-a751079b0c29 tempest-VolumesTransfersV357Test-1901152430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:12:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a61a6664-86a8-4938-8df2-a751079b0c29 tempest-VolumesTransfersV357Test-1901152430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:12:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a61a6664-86a8-4938-8df2-a751079b0c29 tempest-VolumesTransfersV357Test-1901152430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:12:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a61a6664-86a8-4938-8df2-a751079b0c29 tempest-VolumesTransfersV357Test-1901152430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:12:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a61a6664-86a8-4938-8df2-a751079b0c29 tempest-VolumesTransfersV357Test-1901152430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:12:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a61a6664-86a8-4938-8df2-a751079b0c29 tempest-VolumesTransfersV357Test-1901152430 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:12:11 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-a61a6664-86a8-4938-8df2-a751079b0c29 tempest-VolumesTransfersV357Test-1901152430 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:12:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a61a6664-86a8-4938-8df2-a751079b0c29 tempest-VolumesTransfersV357Test-1901152430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-25d0f44a-0728-4d6a-af5e-b8e3f17fbc1b 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:11 devstack sudo[94169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-25d0f44a-0728-4d6a-af5e-b8e3f17fbc1b 1073741824
Nov 05 19:12:11 devstack sudo[94169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:12 devstack sudo[94169]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a61a6664-86a8-4938-8df2-a751079b0c29 tempest-VolumesTransfersV357Test-1901152430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-25d0f44a-0728-4d6a-af5e-b8e3f17fbc1b 1073741824" returned: 0 in 0.520s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a61a6664-86a8-4938-8df2-a751079b0c29 tempest-VolumesTransfersV357Test-1901152430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-25d0f44a-0728-4d6a-af5e-b8e3f17fbc1b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:12 devstack sudo[94177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-25d0f44a-0728-4d6a-af5e-b8e3f17fbc1b
Nov 05 19:12:12 devstack sudo[94177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:12 devstack sudo[94177]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a61a6664-86a8-4938-8df2-a751079b0c29 tempest-VolumesTransfersV357Test-1901152430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-25d0f44a-0728-4d6a-af5e-b8e3f17fbc1b" returned: 0 in 0.300s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a61a6664-86a8-4938-8df2-a751079b0c29 tempest-VolumesTransfersV357Test-1901152430 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:12:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a61a6664-86a8-4938-8df2-a751079b0c29 tempest-VolumesTransfersV357Test-1901152430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:12:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a61a6664-86a8-4938-8df2-a751079b0c29 tempest-VolumesTransfersV357Test-1901152430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4608aa55-e26d-4510-90e4-5d7b46f0f7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25d0f44a-0728-4d6a-af5e-b8e3f17fbc1b', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a61a6664-86a8-4938-8df2-a751079b0c29 tempest-VolumesTransfersV357Test-1901152430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee61c8c5-bfd4-4c8e-a4d0-7c8da1f4138d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:12 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-a61a6664-86a8-4938-8df2-a751079b0c29 tempest-VolumesTransfersV357Test-1901152430 None] Volume volume-25d0f44a-0728-4d6a-af5e-b8e3f17fbc1b (25d0f44a-0728-4d6a-af5e-b8e3f17fbc1b): created successfully
Nov 05 19:12:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a61a6664-86a8-4938-8df2-a751079b0c29 tempest-VolumesTransfersV357Test-1901152430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee61c8c5-bfd4-4c8e-a4d0-7c8da1f4138d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a61a6664-86a8-4938-8df2-a751079b0c29 tempest-VolumesTransfersV357Test-1901152430 None] Flow 'volume_create_manager' (fe7a3b80-1e4b-4679-a166-3b8613c8c4ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:12:12 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-a61a6664-86a8-4938-8df2-a751079b0c29 tempest-VolumesTransfersV357Test-1901152430 None] Created volume successfully.
Nov 05 19:12:14 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-86b64c71-84b3-4119-bb25-a44c9e785ce2 tempest-VolumesTransfersV357Test-115893385 None] Transfer volume completed successfully.
Nov 05 19:12:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-93f87cdb-3938-43a0-9212-9c46cc737b06 tempest-VolumesTransfersV357Test-471297762 None] Acquiring lock "cinder-25d0f44a-0728-4d6a-af5e-b8e3f17fbc1b-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:12:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-93f87cdb-3938-43a0-9212-9c46cc737b06 tempest-VolumesTransfersV357Test-471297762 None] Lock "cinder-25d0f44a-0728-4d6a-af5e-b8e3f17fbc1b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:12:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-93f87cdb-3938-43a0-9212-9c46cc737b06 tempest-VolumesTransfersV357Test-471297762 None] Acquiring lock "cinder-quobyte-25d0f44a-0728-4d6a-af5e-b8e3f17fbc1b" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:12:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-93f87cdb-3938-43a0-9212-9c46cc737b06 tempest-VolumesTransfersV357Test-471297762 None] Lock "cinder-quobyte-25d0f44a-0728-4d6a-af5e-b8e3f17fbc1b" acquired by "delete_volume" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:12:15 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b04579-3eab-4082-954d-8772df8f6189]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:12:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-93f87cdb-3938-43a0-9212-9c46cc737b06 tempest-VolumesTransfersV357Test-471297762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-25d0f44a-0728-4d6a-af5e-b8e3f17fbc1b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:15 devstack sudo[94180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-25d0f44a-0728-4d6a-af5e-b8e3f17fbc1b
Nov 05 19:12:15 devstack sudo[94180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:16 devstack sudo[94180]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-93f87cdb-3938-43a0-9212-9c46cc737b06 tempest-VolumesTransfersV357Test-471297762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-25d0f44a-0728-4d6a-af5e-b8e3f17fbc1b" returned: 0 in 0.395s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-93f87cdb-3938-43a0-9212-9c46cc737b06 tempest-VolumesTransfersV357Test-471297762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-25d0f44a-0728-4d6a-af5e-b8e3f17fbc1b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:16 devstack sudo[94185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-25d0f44a-0728-4d6a-af5e-b8e3f17fbc1b
Nov 05 19:12:16 devstack sudo[94185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:16 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [req-38f3fab4-1cd5-445c-938b-35c4f2786f17 req-f2d44afe-d227-47ef-8c4f-a9efd340b49c tempest-VolumesSnapshotsTestJSON-1883092329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:12:16 devstack sudo[94185]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-38f3fab4-1cd5-445c-938b-35c4f2786f17 req-f2d44afe-d227-47ef-8c4f-a9efd340b49c tempest-VolumesSnapshotsTestJSON-1883092329 None] Flow 'volume_create_manager' (41e2f03c-25c4-4ed8-a187-99198b9aaf8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:12:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-38f3fab4-1cd5-445c-938b-35c4f2786f17 req-f2d44afe-d227-47ef-8c4f-a9efd340b49c tempest-VolumesSnapshotsTestJSON-1883092329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aa503d2-49ea-49b9-8f85-bf1e9af45267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-93f87cdb-3938-43a0-9212-9c46cc737b06 tempest-VolumesTransfersV357Test-471297762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-25d0f44a-0728-4d6a-af5e-b8e3f17fbc1b" returned: 0 in 0.348s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-38f3fab4-1cd5-445c-938b-35c4f2786f17 req-f2d44afe-d227-47ef-8c4f-a9efd340b49c tempest-VolumesSnapshotsTestJSON-1883092329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aa503d2-49ea-49b9-8f85-bf1e9af45267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1534674063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dc029f6-a87d-41ab-9b9f-0ebd50970bff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b6254fdbde74666bcfd790eb7c64a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:12:16Z,use_quota=True,user_id='a7bfbf18ce654a5fb1e48b7d3cbc3bb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-38f3fab4-1cd5-445c-938b-35c4f2786f17 req-f2d44afe-d227-47ef-8c4f-a9efd340b49c tempest-VolumesSnapshotsTestJSON-1883092329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7833964f-b9b1-458a-b3c1-95e1782ba0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-38f3fab4-1cd5-445c-938b-35c4f2786f17 req-f2d44afe-d227-47ef-8c4f-a9efd340b49c tempest-VolumesSnapshotsTestJSON-1883092329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7833964f-b9b1-458a-b3c1-95e1782ba0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-38f3fab4-1cd5-445c-938b-35c4f2786f17 req-f2d44afe-d227-47ef-8c4f-a9efd340b49c tempest-VolumesSnapshotsTestJSON-1883092329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c0a412-2c48-4a38-8bf8-92d6874d9d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-38f3fab4-1cd5-445c-938b-35c4f2786f17 req-f2d44afe-d227-47ef-8c4f-a9efd340b49c tempest-VolumesSnapshotsTestJSON-1883092329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c0a412-2c48-4a38-8bf8-92d6874d9d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dc029f6-a87d-41ab-9b9f-0ebd50970bff', 'volume_name': 'volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-38f3fab4-1cd5-445c-938b-35c4f2786f17 req-f2d44afe-d227-47ef-8c4f-a9efd340b49c tempest-VolumesSnapshotsTestJSON-1883092329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6217228b-0cd6-4b25-8187-c82a473a8694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-38f3fab4-1cd5-445c-938b-35c4f2786f17 req-f2d44afe-d227-47ef-8c4f-a9efd340b49c tempest-VolumesSnapshotsTestJSON-1883092329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6217228b-0cd6-4b25-8187-c82a473a8694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-38f3fab4-1cd5-445c-938b-35c4f2786f17 req-f2d44afe-d227-47ef-8c4f-a9efd340b49c tempest-VolumesSnapshotsTestJSON-1883092329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45e01256-b761-4b76-b3fb-b72f6d647a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:16 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [req-38f3fab4-1cd5-445c-938b-35c4f2786f17 req-f2d44afe-d227-47ef-8c4f-a9efd340b49c tempest-VolumesSnapshotsTestJSON-1883092329 None] Volume 8dc029f6-a87d-41ab-9b9f-0ebd50970bff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff', 'volume_size': 1}
Nov 05 19:12:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-38f3fab4-1cd5-445c-938b-35c4f2786f17 req-f2d44afe-d227-47ef-8c4f-a9efd340b49c tempest-VolumesSnapshotsTestJSON-1883092329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:12:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-38f3fab4-1cd5-445c-938b-35c4f2786f17 req-f2d44afe-d227-47ef-8c4f-a9efd340b49c tempest-VolumesSnapshotsTestJSON-1883092329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:12:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [req-38f3fab4-1cd5-445c-938b-35c4f2786f17 req-f2d44afe-d227-47ef-8c4f-a9efd340b49c tempest-VolumesSnapshotsTestJSON-1883092329 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1534674063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dc029f6-a87d-41ab-9b9f-0ebd50970bff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b6254fdbde74666bcfd790eb7c64a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:12:16Z,use_quota=True,user_id='a7bfbf18ce654a5fb1e48b7d3cbc3bb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:12:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [req-38f3fab4-1cd5-445c-938b-35c4f2786f17 req-f2d44afe-d227-47ef-8c4f-a9efd340b49c tempest-VolumesSnapshotsTestJSON-1883092329 None] Creating volume 8dc029f6-a87d-41ab-9b9f-0ebd50970bff {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:12:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-38f3fab4-1cd5-445c-938b-35c4f2786f17 req-f2d44afe-d227-47ef-8c4f-a9efd340b49c tempest-VolumesSnapshotsTestJSON-1883092329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:12:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-38f3fab4-1cd5-445c-938b-35c4f2786f17 req-f2d44afe-d227-47ef-8c4f-a9efd340b49c tempest-VolumesSnapshotsTestJSON-1883092329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:12:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [req-38f3fab4-1cd5-445c-938b-35c4f2786f17 req-f2d44afe-d227-47ef-8c4f-a9efd340b49c tempest-VolumesSnapshotsTestJSON-1883092329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:12:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [req-38f3fab4-1cd5-445c-938b-35c4f2786f17 req-f2d44afe-d227-47ef-8c4f-a9efd340b49c tempest-VolumesSnapshotsTestJSON-1883092329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:12:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-38f3fab4-1cd5-445c-938b-35c4f2786f17 req-f2d44afe-d227-47ef-8c4f-a9efd340b49c tempest-VolumesSnapshotsTestJSON-1883092329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:12:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [req-38f3fab4-1cd5-445c-938b-35c4f2786f17 req-f2d44afe-d227-47ef-8c4f-a9efd340b49c tempest-VolumesSnapshotsTestJSON-1883092329 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:12:16 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [req-38f3fab4-1cd5-445c-938b-35c4f2786f17 req-f2d44afe-d227-47ef-8c4f-a9efd340b49c tempest-VolumesSnapshotsTestJSON-1883092329 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:12:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-38f3fab4-1cd5-445c-938b-35c4f2786f17 req-f2d44afe-d227-47ef-8c4f-a9efd340b49c tempest-VolumesSnapshotsTestJSON-1883092329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-93f87cdb-3938-43a0-9212-9c46cc737b06 tempest-VolumesTransfersV357Test-471297762 None] Lock "cinder-quobyte-25d0f44a-0728-4d6a-af5e-b8e3f17fbc1b" released by "delete_volume" :: held 0.861s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:12:16 devstack sudo[94188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff 1073741824
Nov 05 19:12:16 devstack sudo[94188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:16 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-93f87cdb-3938-43a0-9212-9c46cc737b06 tempest-VolumesTransfersV357Test-471297762 None] Created reservations ['f9ddcd57-8e19-46f0-bb00-0b6d4801c26e', 'dc773da2-48d6-4101-9280-bc810ae071c8', 'cb52d871-dfca-4045-82c0-34744269148e', '9009f4e7-11e3-4225-9a8b-61ca8a4a6e8a'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:12:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-93f87cdb-3938-43a0-9212-9c46cc737b06 tempest-VolumesTransfersV357Test-471297762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:12:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-93f87cdb-3938-43a0-9212-9c46cc737b06 tempest-VolumesTransfersV357Test-471297762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:12:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-93f87cdb-3938-43a0-9212-9c46cc737b06 tempest-VolumesTransfersV357Test-471297762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:12:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-93f87cdb-3938-43a0-9212-9c46cc737b06 tempest-VolumesTransfersV357Test-471297762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:12:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-93f87cdb-3938-43a0-9212-9c46cc737b06 tempest-VolumesTransfersV357Test-471297762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:12:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-93f87cdb-3938-43a0-9212-9c46cc737b06 tempest-VolumesTransfersV357Test-471297762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:16 devstack sudo[94191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:12:16 devstack sudo[94191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:16 devstack sudo[94191]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-93f87cdb-3938-43a0-9212-9c46cc737b06 tempest-VolumesTransfersV357Test-471297762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.280s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:16 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-93f87cdb-3938-43a0-9212-9c46cc737b06 tempest-VolumesTransfersV357Test-471297762 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:12:16 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-93f87cdb-3938-43a0-9212-9c46cc737b06 tempest-VolumesTransfersV357Test-471297762 None] Deleted volume successfully.
Nov 05 19:12:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-93f87cdb-3938-43a0-9212-9c46cc737b06 tempest-VolumesTransfersV357Test-471297762 None] Lock "cinder-25d0f44a-0728-4d6a-af5e-b8e3f17fbc1b-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:12:17 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-c18d559c-a4de-4983-8e9c-18c288a72d6b tempest-GroupSnapshotsTest-1971566374 None] Group tempest-GroupSnapshotsTest-Group-1825671914: creating
Nov 05 19:12:17 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-c18d559c-a4de-4983-8e9c-18c288a72d6b tempest-GroupSnapshotsTest-1971566374 None] Group tempest-GroupSnapshotsTest-Group-1825671914: created successfully
Nov 05 19:12:17 devstack sudo[94188]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-38f3fab4-1cd5-445c-938b-35c4f2786f17 req-f2d44afe-d227-47ef-8c4f-a9efd340b49c tempest-VolumesSnapshotsTestJSON-1883092329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff 1073741824" returned: 0 in 0.556s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:17 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-c18d559c-a4de-4983-8e9c-18c288a72d6b tempest-GroupSnapshotsTest-1971566374 None] Create group completed successfully.
Nov 05 19:12:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-38f3fab4-1cd5-445c-938b-35c4f2786f17 req-f2d44afe-d227-47ef-8c4f-a9efd340b49c tempest-VolumesSnapshotsTestJSON-1883092329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:17 devstack sudo[94198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff
Nov 05 19:12:17 devstack sudo[94198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:17 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c119b4d-901f-4f64-aac9-8b5abb1b6b85 tempest-VolumesTransfersV357Test-1901152430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:12:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0c119b4d-901f-4f64-aac9-8b5abb1b6b85 tempest-VolumesTransfersV357Test-1901152430 None] Flow 'volume_create_manager' (246cf0ad-f80c-4062-a33e-7a09cdf99b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:12:17 devstack sudo[94198]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0c119b4d-901f-4f64-aac9-8b5abb1b6b85 tempest-VolumesTransfersV357Test-1901152430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44373f00-e197-4739-a97e-7fbd34c52ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-38f3fab4-1cd5-445c-938b-35c4f2786f17 req-f2d44afe-d227-47ef-8c4f-a9efd340b49c tempest-VolumesSnapshotsTestJSON-1883092329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff" returned: 0 in 0.302s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [req-38f3fab4-1cd5-445c-938b-35c4f2786f17 req-f2d44afe-d227-47ef-8c4f-a9efd340b49c tempest-VolumesSnapshotsTestJSON-1883092329 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:12:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-38f3fab4-1cd5-445c-938b-35c4f2786f17 req-f2d44afe-d227-47ef-8c4f-a9efd340b49c tempest-VolumesSnapshotsTestJSON-1883092329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:12:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0c119b4d-901f-4f64-aac9-8b5abb1b6b85 tempest-VolumesTransfersV357Test-1901152430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44373f00-e197-4739-a97e-7fbd34c52ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-39047672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed31e06d-6102-4bac-a6fd-6c925184d624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcbbd5b9289142e59a161acd42c7c43e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:12:17Z,use_quota=True,user_id='b5b8a9ef708f4fafaa8a3a39f43e3bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0c119b4d-901f-4f64-aac9-8b5abb1b6b85 tempest-VolumesTransfersV357Test-1901152430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e37932c7-2dba-4347-a9ef-047f469c973e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0c119b4d-901f-4f64-aac9-8b5abb1b6b85 tempest-VolumesTransfersV357Test-1901152430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e37932c7-2dba-4347-a9ef-047f469c973e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0c119b4d-901f-4f64-aac9-8b5abb1b6b85 tempest-VolumesTransfersV357Test-1901152430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90992693-6125-48d0-b027-2531aaef87fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0c119b4d-901f-4f64-aac9-8b5abb1b6b85 tempest-VolumesTransfersV357Test-1901152430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90992693-6125-48d0-b027-2531aaef87fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed31e06d-6102-4bac-a6fd-6c925184d624', 'volume_name': 'volume-ed31e06d-6102-4bac-a6fd-6c925184d624', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0c119b4d-901f-4f64-aac9-8b5abb1b6b85 tempest-VolumesTransfersV357Test-1901152430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee0d2e4-53d3-4c15-83d5-61abc6dbdf1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0c119b4d-901f-4f64-aac9-8b5abb1b6b85 tempest-VolumesTransfersV357Test-1901152430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee0d2e4-53d3-4c15-83d5-61abc6dbdf1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0c119b4d-901f-4f64-aac9-8b5abb1b6b85 tempest-VolumesTransfersV357Test-1901152430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe10a4d2-d915-4c32-bcc0-df1cc1850870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:17 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-0c119b4d-901f-4f64-aac9-8b5abb1b6b85 tempest-VolumesTransfersV357Test-1901152430 None] Volume ed31e06d-6102-4bac-a6fd-6c925184d624: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed31e06d-6102-4bac-a6fd-6c925184d624', 'volume_size': 1}
Nov 05 19:12:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0c119b4d-901f-4f64-aac9-8b5abb1b6b85 tempest-VolumesTransfersV357Test-1901152430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:12:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0c119b4d-901f-4f64-aac9-8b5abb1b6b85 tempest-VolumesTransfersV357Test-1901152430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:12:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0c119b4d-901f-4f64-aac9-8b5abb1b6b85 tempest-VolumesTransfersV357Test-1901152430 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-39047672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed31e06d-6102-4bac-a6fd-6c925184d624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcbbd5b9289142e59a161acd42c7c43e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:12:17Z,use_quota=True,user_id='b5b8a9ef708f4fafaa8a3a39f43e3bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:12:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-0c119b4d-901f-4f64-aac9-8b5abb1b6b85 tempest-VolumesTransfersV357Test-1901152430 None] Creating volume ed31e06d-6102-4bac-a6fd-6c925184d624 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:12:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0c119b4d-901f-4f64-aac9-8b5abb1b6b85 tempest-VolumesTransfersV357Test-1901152430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:12:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0c119b4d-901f-4f64-aac9-8b5abb1b6b85 tempest-VolumesTransfersV357Test-1901152430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:12:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0c119b4d-901f-4f64-aac9-8b5abb1b6b85 tempest-VolumesTransfersV357Test-1901152430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:12:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0c119b4d-901f-4f64-aac9-8b5abb1b6b85 tempest-VolumesTransfersV357Test-1901152430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:12:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0c119b4d-901f-4f64-aac9-8b5abb1b6b85 tempest-VolumesTransfersV357Test-1901152430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:12:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0c119b4d-901f-4f64-aac9-8b5abb1b6b85 tempest-VolumesTransfersV357Test-1901152430 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:12:17 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-0c119b4d-901f-4f64-aac9-8b5abb1b6b85 tempest-VolumesTransfersV357Test-1901152430 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:12:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0c119b4d-901f-4f64-aac9-8b5abb1b6b85 tempest-VolumesTransfersV357Test-1901152430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ed31e06d-6102-4bac-a6fd-6c925184d624 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-38f3fab4-1cd5-445c-938b-35c4f2786f17 req-f2d44afe-d227-47ef-8c4f-a9efd340b49c tempest-VolumesSnapshotsTestJSON-1883092329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45e01256-b761-4b76-b3fb-b72f6d647a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-38f3fab4-1cd5-445c-938b-35c4f2786f17 req-f2d44afe-d227-47ef-8c4f-a9efd340b49c tempest-VolumesSnapshotsTestJSON-1883092329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d9ff536-560b-4316-8991-2baa6844294f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:17 devstack sudo[94201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ed31e06d-6102-4bac-a6fd-6c925184d624 1073741824
Nov 05 19:12:17 devstack sudo[94201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:17 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [req-38f3fab4-1cd5-445c-938b-35c4f2786f17 req-f2d44afe-d227-47ef-8c4f-a9efd340b49c tempest-VolumesSnapshotsTestJSON-1883092329 None] Volume volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff (8dc029f6-a87d-41ab-9b9f-0ebd50970bff): created successfully
Nov 05 19:12:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-38f3fab4-1cd5-445c-938b-35c4f2786f17 req-f2d44afe-d227-47ef-8c4f-a9efd340b49c tempest-VolumesSnapshotsTestJSON-1883092329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d9ff536-560b-4316-8991-2baa6844294f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-38f3fab4-1cd5-445c-938b-35c4f2786f17 req-f2d44afe-d227-47ef-8c4f-a9efd340b49c tempest-VolumesSnapshotsTestJSON-1883092329 None] Flow 'volume_create_manager' (41e2f03c-25c4-4ed8-a187-99198b9aaf8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:12:17 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-38f3fab4-1cd5-445c-938b-35c4f2786f17 req-f2d44afe-d227-47ef-8c4f-a9efd340b49c tempest-VolumesSnapshotsTestJSON-1883092329 None] Created volume successfully.
Nov 05 19:12:17 devstack sudo[94201]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0c119b4d-901f-4f64-aac9-8b5abb1b6b85 tempest-VolumesTransfersV357Test-1901152430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ed31e06d-6102-4bac-a6fd-6c925184d624 1073741824" returned: 0 in 0.482s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0c119b4d-901f-4f64-aac9-8b5abb1b6b85 tempest-VolumesTransfersV357Test-1901152430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ed31e06d-6102-4bac-a6fd-6c925184d624 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:18 devstack sudo[94207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ed31e06d-6102-4bac-a6fd-6c925184d624
Nov 05 19:12:18 devstack sudo[94207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:18 devstack sudo[94207]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0c119b4d-901f-4f64-aac9-8b5abb1b6b85 tempest-VolumesTransfersV357Test-1901152430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ed31e06d-6102-4bac-a6fd-6c925184d624" returned: 0 in 0.277s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0c119b4d-901f-4f64-aac9-8b5abb1b6b85 tempest-VolumesTransfersV357Test-1901152430 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:12:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0c119b4d-901f-4f64-aac9-8b5abb1b6b85 tempest-VolumesTransfersV357Test-1901152430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:12:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0c119b4d-901f-4f64-aac9-8b5abb1b6b85 tempest-VolumesTransfersV357Test-1901152430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe10a4d2-d915-4c32-bcc0-df1cc1850870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed31e06d-6102-4bac-a6fd-6c925184d624', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0c119b4d-901f-4f64-aac9-8b5abb1b6b85 tempest-VolumesTransfersV357Test-1901152430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18902c20-4a34-4a01-bc5b-cfb60b69ffa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:18 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-0c119b4d-901f-4f64-aac9-8b5abb1b6b85 tempest-VolumesTransfersV357Test-1901152430 None] Volume volume-ed31e06d-6102-4bac-a6fd-6c925184d624 (ed31e06d-6102-4bac-a6fd-6c925184d624): created successfully
Nov 05 19:12:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0c119b4d-901f-4f64-aac9-8b5abb1b6b85 tempest-VolumesTransfersV357Test-1901152430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18902c20-4a34-4a01-bc5b-cfb60b69ffa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0c119b4d-901f-4f64-aac9-8b5abb1b6b85 tempest-VolumesTransfersV357Test-1901152430 None] Flow 'volume_create_manager' (246cf0ad-f80c-4062-a33e-7a09cdf99b88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:12:18 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-0c119b4d-901f-4f64-aac9-8b5abb1b6b85 tempest-VolumesTransfersV357Test-1901152430 None] Created volume successfully.
Nov 05 19:12:18 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-1caf1735-ba10-41db-beb8-3170a851c14c tempest-GroupSnapshotsTest-1971566374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:12:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1caf1735-ba10-41db-beb8-3170a851c14c tempest-GroupSnapshotsTest-1971566374 None] Flow 'volume_create_manager' (88daa019-02d2-4cfa-a693-8b33721b8b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:12:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1caf1735-ba10-41db-beb8-3170a851c14c tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94642045-17ba-4689-a958-4744ecc53c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1caf1735-ba10-41db-beb8-3170a851c14c tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94642045-17ba-4689-a958-4744ecc53c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1953652921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4a192a83-8fff-437f-8457-87b7769b1c5e,host='devstack@QuobyteHD#QuobyteHD',id=c21a3b6e-1b07-4e14-bc91-cd81a0370b1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75ade83722d84a799eff399843986cb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:12:19Z,use_quota=True,user_id='e3f9060bf2674e44a7ef4fc02ea1d058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dfa84b19-e307-4949-8602-3baa61552b1e),volume_type_id=dfa84b19-e307-4949-8602-3baa61552b1e)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1caf1735-ba10-41db-beb8-3170a851c14c tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1b12969-52f2-4216-82ab-d43dba0a073b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1caf1735-ba10-41db-beb8-3170a851c14c tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1b12969-52f2-4216-82ab-d43dba0a073b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1caf1735-ba10-41db-beb8-3170a851c14c tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4831ca1-45a7-4e99-a43f-6e6e795cc9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1caf1735-ba10-41db-beb8-3170a851c14c tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4831ca1-45a7-4e99-a43f-6e6e795cc9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c21a3b6e-1b07-4e14-bc91-cd81a0370b1f', 'volume_name': 'volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1caf1735-ba10-41db-beb8-3170a851c14c tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1406aa1-f98c-4615-85d3-f7b983ae6ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1caf1735-ba10-41db-beb8-3170a851c14c tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1406aa1-f98c-4615-85d3-f7b983ae6ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1caf1735-ba10-41db-beb8-3170a851c14c tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5c0778c-85d5-4776-b6ca-c345747b4cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:18 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-1caf1735-ba10-41db-beb8-3170a851c14c tempest-GroupSnapshotsTest-1971566374 None] Volume c21a3b6e-1b07-4e14-bc91-cd81a0370b1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f', 'volume_size': 1}
Nov 05 19:12:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1caf1735-ba10-41db-beb8-3170a851c14c tempest-GroupSnapshotsTest-1971566374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:12:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1caf1735-ba10-41db-beb8-3170a851c14c tempest-GroupSnapshotsTest-1971566374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:12:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1caf1735-ba10-41db-beb8-3170a851c14c tempest-GroupSnapshotsTest-1971566374 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=4a192a83-8fff-437f-8457-87b7769b1c5e,created_at=2026-11-05T18:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1953652921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4a192a83-8fff-437f-8457-87b7769b1c5e,host='devstack@QuobyteHD#QuobyteHD',id=c21a3b6e-1b07-4e14-bc91-cd81a0370b1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75ade83722d84a799eff399843986cb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:12:19Z,use_quota=True,user_id='e3f9060bf2674e44a7ef4fc02ea1d058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dfa84b19-e307-4949-8602-3baa61552b1e),volume_type_id=dfa84b19-e307-4949-8602-3baa61552b1e)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:12:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-1caf1735-ba10-41db-beb8-3170a851c14c tempest-GroupSnapshotsTest-1971566374 None] Creating volume c21a3b6e-1b07-4e14-bc91-cd81a0370b1f {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:12:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1caf1735-ba10-41db-beb8-3170a851c14c tempest-GroupSnapshotsTest-1971566374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:12:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1caf1735-ba10-41db-beb8-3170a851c14c tempest-GroupSnapshotsTest-1971566374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:12:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1caf1735-ba10-41db-beb8-3170a851c14c tempest-GroupSnapshotsTest-1971566374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:12:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1caf1735-ba10-41db-beb8-3170a851c14c tempest-GroupSnapshotsTest-1971566374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:12:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1caf1735-ba10-41db-beb8-3170a851c14c tempest-GroupSnapshotsTest-1971566374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:12:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1caf1735-ba10-41db-beb8-3170a851c14c tempest-GroupSnapshotsTest-1971566374 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:12:18 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-1caf1735-ba10-41db-beb8-3170a851c14c tempest-GroupSnapshotsTest-1971566374 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:12:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1caf1735-ba10-41db-beb8-3170a851c14c tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:18 devstack sudo[94210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f 1073741824
Nov 05 19:12:18 devstack sudo[94210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-0cb7c493-f574-4e6f-8cd8-62f89dbdaa05 req-275beccf-a47f-483e-9188-038d39f5b386 tempest-VolumesSnapshotsTestJSON-1883092329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:12:19 devstack sudo[94210]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1caf1735-ba10-41db-beb8-3170a851c14c tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f 1073741824" returned: 0 in 0.518s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1caf1735-ba10-41db-beb8-3170a851c14c tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:19 devstack sudo[94216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f
Nov 05 19:12:19 devstack sudo[94216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:19 devstack sudo[94216]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1caf1735-ba10-41db-beb8-3170a851c14c tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f" returned: 0 in 0.275s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1caf1735-ba10-41db-beb8-3170a851c14c tempest-GroupSnapshotsTest-1971566374 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:12:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1caf1735-ba10-41db-beb8-3170a851c14c tempest-GroupSnapshotsTest-1971566374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:12:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-0cb7c493-f574-4e6f-8cd8-62f89dbdaa05 req-275beccf-a47f-483e-9188-038d39f5b386 tempest-VolumesSnapshotsTestJSON-1883092329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.706s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:12:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1caf1735-ba10-41db-beb8-3170a851c14c tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5c0778c-85d5-4776-b6ca-c345747b4cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1caf1735-ba10-41db-beb8-3170a851c14c tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7347c79e-71a1-4b3f-84cb-cd1a39faa7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [req-0cb7c493-f574-4e6f-8cd8-62f89dbdaa05 req-275beccf-a47f-483e-9188-038d39f5b386 tempest-VolumesSnapshotsTestJSON-1883092329 None] Creating offline snapshot 389ad66e-9410-4b02-9baa-73bacfd6957b of volume 8dc029f6-a87d-41ab-9b9f-0ebd50970bff {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:12:19 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-1caf1735-ba10-41db-beb8-3170a851c14c tempest-GroupSnapshotsTest-1971566374 None] Volume volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f (c21a3b6e-1b07-4e14-bc91-cd81a0370b1f): created successfully
Nov 05 19:12:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1caf1735-ba10-41db-beb8-3170a851c14c tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7347c79e-71a1-4b3f-84cb-cd1a39faa7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1caf1735-ba10-41db-beb8-3170a851c14c tempest-GroupSnapshotsTest-1971566374 None] Flow 'volume_create_manager' (88daa019-02d2-4cfa-a693-8b33721b8b92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:12:19 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd190413-654a-4d51-afe4-1931ae893c1c]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:12:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-0cb7c493-f574-4e6f-8cd8-62f89dbdaa05 req-275beccf-a47f-483e-9188-038d39f5b386 tempest-VolumesSnapshotsTestJSON-1883092329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:19 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-1caf1735-ba10-41db-beb8-3170a851c14c tempest-GroupSnapshotsTest-1971566374 None] Created volume successfully.
Nov 05 19:12:19 devstack sudo[94219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff
Nov 05 19:12:19 devstack sudo[94219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a942f118-b222-41c1-8244-664aca3ed8d9 tempest-VolumesTransfersV357Test-471297762 None] Acquiring lock "cinder-ed31e06d-6102-4bac-a6fd-6c925184d624-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:12:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a942f118-b222-41c1-8244-664aca3ed8d9 tempest-VolumesTransfersV357Test-471297762 None] Lock "cinder-ed31e06d-6102-4bac-a6fd-6c925184d624-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:12:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a942f118-b222-41c1-8244-664aca3ed8d9 tempest-VolumesTransfersV357Test-471297762 None] Acquiring lock "cinder-quobyte-ed31e06d-6102-4bac-a6fd-6c925184d624" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:12:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a942f118-b222-41c1-8244-664aca3ed8d9 tempest-VolumesTransfersV357Test-471297762 None] Lock "cinder-quobyte-ed31e06d-6102-4bac-a6fd-6c925184d624" acquired by "delete_volume" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:12:19 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7e4103-5893-4aea-a696-a2ab18ac34e3]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:12:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a942f118-b222-41c1-8244-664aca3ed8d9 tempest-VolumesTransfersV357Test-471297762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ed31e06d-6102-4bac-a6fd-6c925184d624 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:20 devstack sudo[94221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ed31e06d-6102-4bac-a6fd-6c925184d624
Nov 05 19:12:20 devstack sudo[94221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:20 devstack sudo[94219]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-0cb7c493-f574-4e6f-8cd8-62f89dbdaa05 req-275beccf-a47f-483e-9188-038d39f5b386 tempest-VolumesSnapshotsTestJSON-1883092329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff" returned: 0 in 0.448s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-0cb7c493-f574-4e6f-8cd8-62f89dbdaa05 req-275beccf-a47f-483e-9188-038d39f5b386 tempest-VolumesSnapshotsTestJSON-1883092329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff.389ad66e-9410-4b02-9baa-73bacfd6957b 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:20 devstack sudo[94226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff.389ad66e-9410-4b02-9baa-73bacfd6957b 1G
Nov 05 19:12:20 devstack sudo[94226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:20 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-95129371-b28c-4d17-96cd-24f6fe874379 tempest-GroupSnapshotsTest-1971566374 None] GroupSnapshot c3de37f3-642a-4e77-874e-648e8ab9787d: creating.
Nov 05 19:12:20 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=83,cinder:UPDATE=95,cinder:DELETE=11,cinder:INSERT=21 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:12:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-95129371-b28c-4d17-96cd-24f6fe874379 tempest-GroupSnapshotsTest-1971566374 None] Group snapshot c3de37f3-642a-4e77-874e-648e8ab9787d: creating. {{(pid=87184) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 05 19:12:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-95129371-b28c-4d17-96cd-24f6fe874379 tempest-GroupSnapshotsTest-1971566374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:12:20 devstack sudo[94221]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a942f118-b222-41c1-8244-664aca3ed8d9 tempest-VolumesTransfersV357Test-471297762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ed31e06d-6102-4bac-a6fd-6c925184d624" returned: 0 in 0.460s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a942f118-b222-41c1-8244-664aca3ed8d9 tempest-VolumesTransfersV357Test-471297762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ed31e06d-6102-4bac-a6fd-6c925184d624 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:20 devstack sudo[94231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ed31e06d-6102-4bac-a6fd-6c925184d624
Nov 05 19:12:20 devstack sudo[94231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:20 devstack sudo[94226]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-0cb7c493-f574-4e6f-8cd8-62f89dbdaa05 req-275beccf-a47f-483e-9188-038d39f5b386 tempest-VolumesSnapshotsTestJSON-1883092329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff.389ad66e-9410-4b02-9baa-73bacfd6957b 1G" returned: 0 in 0.521s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-0cb7c493-f574-4e6f-8cd8-62f89dbdaa05 req-275beccf-a47f-483e-9188-038d39f5b386 tempest-VolumesSnapshotsTestJSON-1883092329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff.389ad66e-9410-4b02-9baa-73bacfd6957b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:20 devstack sudo[94237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff.389ad66e-9410-4b02-9baa-73bacfd6957b
Nov 05 19:12:20 devstack sudo[94237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:20 devstack sudo[94231]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a942f118-b222-41c1-8244-664aca3ed8d9 tempest-VolumesTransfersV357Test-471297762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ed31e06d-6102-4bac-a6fd-6c925184d624" returned: 0 in 0.268s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:20 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a942f118-b222-41c1-8244-664aca3ed8d9 tempest-VolumesTransfersV357Test-471297762 None] Lock "cinder-quobyte-ed31e06d-6102-4bac-a6fd-6c925184d624" released by "delete_volume" :: held 0.790s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:12:20 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-a942f118-b222-41c1-8244-664aca3ed8d9 tempest-VolumesTransfersV357Test-471297762 None] Created reservations ['9c14c251-4f2e-486a-946b-5e516c8183a1', '7ad35298-3832-463a-b138-81816bc3080c', 'cf232bde-a7cc-41cd-aedd-c4cbfb65efc3', 'e4d44db8-d507-4be9-b630-235754d4bd4d'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:12:20 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:UPDATE=106,cinder:SELECT=101,cinder:INSERT=25,cinder:DELETE=7 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:12:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a942f118-b222-41c1-8244-664aca3ed8d9 tempest-VolumesTransfersV357Test-471297762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:12:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a942f118-b222-41c1-8244-664aca3ed8d9 tempest-VolumesTransfersV357Test-471297762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:12:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a942f118-b222-41c1-8244-664aca3ed8d9 tempest-VolumesTransfersV357Test-471297762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:12:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a942f118-b222-41c1-8244-664aca3ed8d9 tempest-VolumesTransfersV357Test-471297762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:12:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a942f118-b222-41c1-8244-664aca3ed8d9 tempest-VolumesTransfersV357Test-471297762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:12:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a942f118-b222-41c1-8244-664aca3ed8d9 tempest-VolumesTransfersV357Test-471297762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:20 devstack sudo[94239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:12:20 devstack sudo[94239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:20 devstack sudo[94237]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-0cb7c493-f574-4e6f-8cd8-62f89dbdaa05 req-275beccf-a47f-483e-9188-038d39f5b386 tempest-VolumesSnapshotsTestJSON-1883092329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff.389ad66e-9410-4b02-9baa-73bacfd6957b" returned: 0 in 0.333s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:20 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [req-0cb7c493-f574-4e6f-8cd8-62f89dbdaa05 req-275beccf-a47f-483e-9188-038d39f5b386 tempest-VolumesSnapshotsTestJSON-1883092329 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff.389ad66e-9410-4b02-9baa-73bacfd6957b is being set with open permissions: ugo+rw
Nov 05 19:12:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-0cb7c493-f574-4e6f-8cd8-62f89dbdaa05 req-275beccf-a47f-483e-9188-038d39f5b386 tempest-VolumesSnapshotsTestJSON-1883092329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff.389ad66e-9410-4b02-9baa-73bacfd6957b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:20 devstack sudo[94244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff.389ad66e-9410-4b02-9baa-73bacfd6957b
Nov 05 19:12:20 devstack sudo[94244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:21 devstack sudo[94239]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a942f118-b222-41c1-8244-664aca3ed8d9 tempest-VolumesTransfersV357Test-471297762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.283s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:21 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-a942f118-b222-41c1-8244-664aca3ed8d9 tempest-VolumesTransfersV357Test-471297762 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:12:21 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-a942f118-b222-41c1-8244-664aca3ed8d9 tempest-VolumesTransfersV357Test-471297762 None] Deleted volume successfully.
Nov 05 19:12:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a942f118-b222-41c1-8244-664aca3ed8d9 tempest-VolumesTransfersV357Test-471297762 None] Lock "cinder-ed31e06d-6102-4bac-a6fd-6c925184d624-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:12:21 devstack sudo[94244]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-0cb7c493-f574-4e6f-8cd8-62f89dbdaa05 req-275beccf-a47f-483e-9188-038d39f5b386 tempest-VolumesSnapshotsTestJSON-1883092329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff.389ad66e-9410-4b02-9baa-73bacfd6957b" returned: 0 in 0.255s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-0cb7c493-f574-4e6f-8cd8-62f89dbdaa05 req-275beccf-a47f-483e-9188-038d39f5b386 tempest-VolumesSnapshotsTestJSON-1883092329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:21 devstack sudo[94248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff.info
Nov 05 19:12:21 devstack sudo[94248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:21 devstack sudo[94248]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-0cb7c493-f574-4e6f-8cd8-62f89dbdaa05 req-275beccf-a47f-483e-9188-038d39f5b386 tempest-VolumesSnapshotsTestJSON-1883092329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff.info" returned: 0 in 0.285s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:21 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [req-0cb7c493-f574-4e6f-8cd8-62f89dbdaa05 req-275beccf-a47f-483e-9188-038d39f5b386 tempest-VolumesSnapshotsTestJSON-1883092329 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff.info is being set with open permissions: ugo+rw
Nov 05 19:12:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-0cb7c493-f574-4e6f-8cd8-62f89dbdaa05 req-275beccf-a47f-483e-9188-038d39f5b386 tempest-VolumesSnapshotsTestJSON-1883092329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:21 devstack sudo[94253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff.info
Nov 05 19:12:21 devstack sudo[94253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:21 devstack sudo[94253]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-0cb7c493-f574-4e6f-8cd8-62f89dbdaa05 req-275beccf-a47f-483e-9188-038d39f5b386 tempest-VolumesSnapshotsTestJSON-1883092329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff.info" returned: 0 in 0.283s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-0cb7c493-f574-4e6f-8cd8-62f89dbdaa05 req-275beccf-a47f-483e-9188-038d39f5b386 tempest-VolumesSnapshotsTestJSON-1883092329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.267s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:12:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-95129371-b28c-4d17-96cd-24f6fe874379 tempest-GroupSnapshotsTest-1971566374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.511s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:12:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-95129371-b28c-4d17-96cd-24f6fe874379 tempest-GroupSnapshotsTest-1971566374 None] Creating offline snapshot 2f0d0dd5-7d24-41d1-8684-81ec62784942 of volume c21a3b6e-1b07-4e14-bc91-cd81a0370b1f {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:12:21 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-0cb7c493-f574-4e6f-8cd8-62f89dbdaa05 req-275beccf-a47f-483e-9188-038d39f5b386 tempest-VolumesSnapshotsTestJSON-1883092329 None] Create snapshot completed successfully
Nov 05 19:12:21 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e70df73-b39b-49ca-b2b2-758c25bc5d80]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:12:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-95129371-b28c-4d17-96cd-24f6fe874379 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:22 devstack sudo[94257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f
Nov 05 19:12:22 devstack sudo[94257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:22 devstack sudo[94257]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-95129371-b28c-4d17-96cd-24f6fe874379 tempest-GroupSnapshotsTest-1971566374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f" returned: 0 in 0.560s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-95129371-b28c-4d17-96cd-24f6fe874379 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f.2f0d0dd5-7d24-41d1-8684-81ec62784942 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:22 devstack sudo[94281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f.2f0d0dd5-7d24-41d1-8684-81ec62784942 1G
Nov 05 19:12:22 devstack sudo[94281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:22 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-08c4afa5-259b-409c-8c57-8a9f3036c10e req-3dec043c-aaae-466e-aa7a-f85997170824 tempest-VolumesSnapshotsTestJSON-1883092329 None] Acquiring lock "cinder-389ad66e-9410-4b02-9baa-73bacfd6957b-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:12:22 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-08c4afa5-259b-409c-8c57-8a9f3036c10e req-3dec043c-aaae-466e-aa7a-f85997170824 tempest-VolumesSnapshotsTestJSON-1883092329 None] Lock "cinder-389ad66e-9410-4b02-9baa-73bacfd6957b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:12:22 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-08c4afa5-259b-409c-8c57-8a9f3036c10e req-3dec043c-aaae-466e-aa7a-f85997170824 tempest-VolumesSnapshotsTestJSON-1883092329 None] Acquiring lock "cinder-quobyte-8dc029f6-a87d-41ab-9b9f-0ebd50970bff" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:12:22 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-08c4afa5-259b-409c-8c57-8a9f3036c10e req-3dec043c-aaae-466e-aa7a-f85997170824 tempest-VolumesSnapshotsTestJSON-1883092329 None] Lock "cinder-quobyte-8dc029f6-a87d-41ab-9b9f-0ebd50970bff" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:12:22 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-08c4afa5-259b-409c-8c57-8a9f3036c10e req-3dec043c-aaae-466e-aa7a-f85997170824 tempest-VolumesSnapshotsTestJSON-1883092329 None] Acquiring lock "cinder-quobyte-389ad66e-9410-4b02-9baa-73bacfd6957b" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:12:22 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-08c4afa5-259b-409c-8c57-8a9f3036c10e req-3dec043c-aaae-466e-aa7a-f85997170824 tempest-VolumesSnapshotsTestJSON-1883092329 None] Lock "cinder-quobyte-389ad66e-9410-4b02-9baa-73bacfd6957b" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:12:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [req-08c4afa5-259b-409c-8c57-8a9f3036c10e req-3dec043c-aaae-466e-aa7a-f85997170824 tempest-VolumesSnapshotsTestJSON-1883092329 None] Deleting offline snapshot 389ad66e-9410-4b02-9baa-73bacfd6957b of volume 8dc029f6-a87d-41ab-9b9f-0ebd50970bff {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:12:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [req-08c4afa5-259b-409c-8c57-8a9f3036c10e req-3dec043c-aaae-466e-aa7a-f85997170824 tempest-VolumesSnapshotsTestJSON-1883092329 None] snapshot_file for this snap is: volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff.389ad66e-9410-4b02-9baa-73bacfd6957b {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:12:22 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2a3f67-2e70-4bfe-be07-8a92873e0acb]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:12:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-08c4afa5-259b-409c-8c57-8a9f3036c10e req-3dec043c-aaae-466e-aa7a-f85997170824 tempest-VolumesSnapshotsTestJSON-1883092329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff.389ad66e-9410-4b02-9baa-73bacfd6957b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:23 devstack sudo[94290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff.389ad66e-9410-4b02-9baa-73bacfd6957b
Nov 05 19:12:23 devstack sudo[94290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:23 devstack sudo[94281]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-95129371-b28c-4d17-96cd-24f6fe874379 tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f.2f0d0dd5-7d24-41d1-8684-81ec62784942 1G" returned: 0 in 0.672s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-95129371-b28c-4d17-96cd-24f6fe874379 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f.2f0d0dd5-7d24-41d1-8684-81ec62784942 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:23 devstack sudo[94294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f.2f0d0dd5-7d24-41d1-8684-81ec62784942
Nov 05 19:12:23 devstack sudo[94294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:23 devstack sudo[94290]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-08c4afa5-259b-409c-8c57-8a9f3036c10e req-3dec043c-aaae-466e-aa7a-f85997170824 tempest-VolumesSnapshotsTestJSON-1883092329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff.389ad66e-9410-4b02-9baa-73bacfd6957b" returned: 0 in 0.618s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [req-08c4afa5-259b-409c-8c57-8a9f3036c10e req-3dec043c-aaae-466e-aa7a-f85997170824 tempest-VolumesSnapshotsTestJSON-1883092329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:12:23 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02b4d34-85c1-4e04-acd8-def23bafb08b]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:12:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-08c4afa5-259b-409c-8c57-8a9f3036c10e req-3dec043c-aaae-466e-aa7a-f85997170824 tempest-VolumesSnapshotsTestJSON-1883092329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:23 devstack sudo[94294]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-95129371-b28c-4d17-96cd-24f6fe874379 tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f.2f0d0dd5-7d24-41d1-8684-81ec62784942" returned: 0 in 0.449s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:23 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-95129371-b28c-4d17-96cd-24f6fe874379 tempest-GroupSnapshotsTest-1971566374 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f.2f0d0dd5-7d24-41d1-8684-81ec62784942 is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 19:12:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-95129371-b28c-4d17-96cd-24f6fe874379 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f.2f0d0dd5-7d24-41d1-8684-81ec62784942 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:23 devstack sudo[94304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f.2f0d0dd5-7d24-41d1-8684-81ec62784942
Nov 05 19:12:23 devstack sudo[94304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:23 devstack sudo[94303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff
Nov 05 19:12:23 devstack sudo[94303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:24 devstack sudo[94304]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-95129371-b28c-4d17-96cd-24f6fe874379 tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f.2f0d0dd5-7d24-41d1-8684-81ec62784942" returned: 0 in 0.353s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-95129371-b28c-4d17-96cd-24f6fe874379 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:24 devstack sudo[94312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f.info
Nov 05 19:12:24 devstack sudo[94303]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-08c4afa5-259b-409c-8c57-8a9f3036c10e req-3dec043c-aaae-466e-aa7a-f85997170824 tempest-VolumesSnapshotsTestJSON-1883092329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff" returned: 0 in 0.552s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:24 devstack sudo[94312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-08c4afa5-259b-409c-8c57-8a9f3036c10e req-3dec043c-aaae-466e-aa7a-f85997170824 tempest-VolumesSnapshotsTestJSON-1883092329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff.389ad66e-9410-4b02-9baa-73bacfd6957b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:24 devstack sudo[94315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff.389ad66e-9410-4b02-9baa-73bacfd6957b
Nov 05 19:12:24 devstack sudo[94315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:24 devstack sudo[94312]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-95129371-b28c-4d17-96cd-24f6fe874379 tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f.info" returned: 0 in 0.337s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:24 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-95129371-b28c-4d17-96cd-24f6fe874379 tempest-GroupSnapshotsTest-1971566374 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 19:12:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-95129371-b28c-4d17-96cd-24f6fe874379 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:24 devstack sudo[94319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f.info
Nov 05 19:12:24 devstack sudo[94319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:24 devstack sudo[94315]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-08c4afa5-259b-409c-8c57-8a9f3036c10e req-3dec043c-aaae-466e-aa7a-f85997170824 tempest-VolumesSnapshotsTestJSON-1883092329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff.389ad66e-9410-4b02-9baa-73bacfd6957b" returned: 0 in 0.509s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-08c4afa5-259b-409c-8c57-8a9f3036c10e req-3dec043c-aaae-466e-aa7a-f85997170824 tempest-VolumesSnapshotsTestJSON-1883092329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff.389ad66e-9410-4b02-9baa-73bacfd6957b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:24 devstack sudo[94324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff.389ad66e-9410-4b02-9baa-73bacfd6957b
Nov 05 19:12:24 devstack sudo[94324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:24 devstack sudo[94319]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-95129371-b28c-4d17-96cd-24f6fe874379 tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f.info" returned: 0 in 0.359s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-95129371-b28c-4d17-96cd-24f6fe874379 tempest-GroupSnapshotsTest-1971566374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.947s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:12:24 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-95129371-b28c-4d17-96cd-24f6fe874379 tempest-GroupSnapshotsTest-1971566374 None] group_snapshot c3de37f3-642a-4e77-874e-648e8ab9787d: created successfully
Nov 05 19:12:24 devstack sudo[94324]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-08c4afa5-259b-409c-8c57-8a9f3036c10e req-3dec043c-aaae-466e-aa7a-f85997170824 tempest-VolumesSnapshotsTestJSON-1883092329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff.389ad66e-9410-4b02-9baa-73bacfd6957b" returned: 0 in 0.298s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:25 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-08c4afa5-259b-409c-8c57-8a9f3036c10e req-3dec043c-aaae-466e-aa7a-f85997170824 tempest-VolumesSnapshotsTestJSON-1883092329 None] Lock "cinder-quobyte-389ad66e-9410-4b02-9baa-73bacfd6957b" released by "_delete_snapshot" :: held 2.200s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:12:25 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-08c4afa5-259b-409c-8c57-8a9f3036c10e req-3dec043c-aaae-466e-aa7a-f85997170824 tempest-VolumesSnapshotsTestJSON-1883092329 None] Lock "cinder-quobyte-8dc029f6-a87d-41ab-9b9f-0ebd50970bff" released by "delete_snapshot" :: held 2.243s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:12:25 devstack cinder-volume[87184]: DEBUG cinder.quota [req-08c4afa5-259b-409c-8c57-8a9f3036c10e req-3dec043c-aaae-466e-aa7a-f85997170824 tempest-VolumesSnapshotsTestJSON-1883092329 None] Created reservations ['7ccedf1a-00d3-46ce-b29d-a4efe26dbd3f', 'c0efd42b-0b9e-4b8c-b35e-352fc6254e13', 'b67cb2cd-80d9-4211-999d-ffc0a66e52d6', 'b918a271-bacc-4a48-af9d-90757c58c034'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:12:25 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-08c4afa5-259b-409c-8c57-8a9f3036c10e req-3dec043c-aaae-466e-aa7a-f85997170824 tempest-VolumesSnapshotsTestJSON-1883092329 None] Delete snapshot completed successfully.
Nov 05 19:12:25 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-08c4afa5-259b-409c-8c57-8a9f3036c10e req-3dec043c-aaae-466e-aa7a-f85997170824 tempest-VolumesSnapshotsTestJSON-1883092329 None] Lock "cinder-389ad66e-9410-4b02-9baa-73bacfd6957b-delete_snapshot" released by "delete_snapshot" :: held 2.460s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:12:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-8a9306e0-0514-4a0b-834d-66862c5a6a27 req-e096cfc8-e5a0-4907-994e-48fc0b30f379 tempest-VolumesSnapshotsTestJSON-1883092329 None] Acquiring lock "cinder-8dc029f6-a87d-41ab-9b9f-0ebd50970bff-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:12:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-8a9306e0-0514-4a0b-834d-66862c5a6a27 req-e096cfc8-e5a0-4907-994e-48fc0b30f379 tempest-VolumesSnapshotsTestJSON-1883092329 None] Lock "cinder-8dc029f6-a87d-41ab-9b9f-0ebd50970bff-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:12:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-8a9306e0-0514-4a0b-834d-66862c5a6a27 req-e096cfc8-e5a0-4907-994e-48fc0b30f379 tempest-VolumesSnapshotsTestJSON-1883092329 None] Acquiring lock "cinder-quobyte-8dc029f6-a87d-41ab-9b9f-0ebd50970bff" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:12:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-8a9306e0-0514-4a0b-834d-66862c5a6a27 req-e096cfc8-e5a0-4907-994e-48fc0b30f379 tempest-VolumesSnapshotsTestJSON-1883092329 None] Lock "cinder-quobyte-8dc029f6-a87d-41ab-9b9f-0ebd50970bff" acquired by "delete_volume" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:12:26 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[68305afe-8448-4f86-aa3c-12298b50997d]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:12:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-8a9306e0-0514-4a0b-834d-66862c5a6a27 req-e096cfc8-e5a0-4907-994e-48fc0b30f379 tempest-VolumesSnapshotsTestJSON-1883092329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:26 devstack sudo[94328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff
Nov 05 19:12:26 devstack sudo[94328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-849d69ab-e77b-40d0-ba91-1cb6f0deffaf tempest-GroupSnapshotsTest-1971566374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:12:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-849d69ab-e77b-40d0-ba91-1cb6f0deffaf tempest-GroupSnapshotsTest-1971566374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:12:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-849d69ab-e77b-40d0-ba91-1cb6f0deffaf tempest-GroupSnapshotsTest-1971566374 None] Acquiring lock "cinder-quobyte-2f0d0dd5-7d24-41d1-8684-81ec62784942-b91e46bc-ac3a-4345-a27f-fe812abf1093" by "_create_volume_from_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:12:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-849d69ab-e77b-40d0-ba91-1cb6f0deffaf tempest-GroupSnapshotsTest-1971566374 None] Lock "cinder-quobyte-2f0d0dd5-7d24-41d1-8684-81ec62784942-b91e46bc-ac3a-4345-a27f-fe812abf1093" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:12:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-849d69ab-e77b-40d0-ba91-1cb6f0deffaf tempest-GroupSnapshotsTest-1971566374 None] Creating volume b91e46bc-ac3a-4345-a27f-fe812abf1093 from snapshot 2f0d0dd5-7d24-41d1-8684-81ec62784942 {{(pid=87184) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 19:12:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-849d69ab-e77b-40d0-ba91-1cb6f0deffaf tempest-GroupSnapshotsTest-1971566374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:12:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-849d69ab-e77b-40d0-ba91-1cb6f0deffaf tempest-GroupSnapshotsTest-1971566374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:12:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-849d69ab-e77b-40d0-ba91-1cb6f0deffaf tempest-GroupSnapshotsTest-1971566374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:12:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-849d69ab-e77b-40d0-ba91-1cb6f0deffaf tempest-GroupSnapshotsTest-1971566374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:12:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-849d69ab-e77b-40d0-ba91-1cb6f0deffaf tempest-GroupSnapshotsTest-1971566374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:12:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-849d69ab-e77b-40d0-ba91-1cb6f0deffaf tempest-GroupSnapshotsTest-1971566374 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:12:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-849d69ab-e77b-40d0-ba91-1cb6f0deffaf tempest-GroupSnapshotsTest-1971566374 None] Acquiring lock "cinder-quobyte-b91e46bc-ac3a-4345-a27f-fe812abf1093" by "_copy_volume_from_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:12:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-849d69ab-e77b-40d0-ba91-1cb6f0deffaf tempest-GroupSnapshotsTest-1971566374 None] Lock "cinder-quobyte-b91e46bc-ac3a-4345-a27f-fe812abf1093" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:12:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-849d69ab-e77b-40d0-ba91-1cb6f0deffaf tempest-GroupSnapshotsTest-1971566374 None] snapshot: 2f0d0dd5-7d24-41d1-8684-81ec62784942, volume: b91e46bc-ac3a-4345-a27f-fe812abf1093,  {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 19:12:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-849d69ab-e77b-40d0-ba91-1cb6f0deffaf tempest-GroupSnapshotsTest-1971566374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:12:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-849d69ab-e77b-40d0-ba91-1cb6f0deffaf tempest-GroupSnapshotsTest-1971566374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:12:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-849d69ab-e77b-40d0-ba91-1cb6f0deffaf tempest-GroupSnapshotsTest-1971566374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:12:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-849d69ab-e77b-40d0-ba91-1cb6f0deffaf tempest-GroupSnapshotsTest-1971566374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:12:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-849d69ab-e77b-40d0-ba91-1cb6f0deffaf tempest-GroupSnapshotsTest-1971566374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:12:26 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f4688d-ef9c-41e9-8ca4-d4d2b066a3cd]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:12:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-849d69ab-e77b-40d0-ba91-1cb6f0deffaf tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f.2f0d0dd5-7d24-41d1-8684-81ec62784942 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:27 devstack sudo[94332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f.2f0d0dd5-7d24-41d1-8684-81ec62784942
Nov 05 19:12:27 devstack sudo[94332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:27 devstack sudo[94328]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-8a9306e0-0514-4a0b-834d-66862c5a6a27 req-e096cfc8-e5a0-4907-994e-48fc0b30f379 tempest-VolumesSnapshotsTestJSON-1883092329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff" returned: 0 in 0.657s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-8a9306e0-0514-4a0b-834d-66862c5a6a27 req-e096cfc8-e5a0-4907-994e-48fc0b30f379 tempest-VolumesSnapshotsTestJSON-1883092329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:27 devstack sudo[94336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff
Nov 05 19:12:27 devstack sudo[94336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:27 devstack sudo[94332]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-849d69ab-e77b-40d0-ba91-1cb6f0deffaf tempest-GroupSnapshotsTest-1971566374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f.2f0d0dd5-7d24-41d1-8684-81ec62784942" returned: 0 in 0.423s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-849d69ab-e77b-40d0-ba91-1cb6f0deffaf tempest-GroupSnapshotsTest-1971566374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:12:27 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0d8002-5a1f-4877-879e-4a57d1a6030e]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:12:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-849d69ab-e77b-40d0-ba91-1cb6f0deffaf tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:27 devstack sudo[94336]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-8a9306e0-0514-4a0b-834d-66862c5a6a27 req-e096cfc8-e5a0-4907-994e-48fc0b30f379 tempest-VolumesSnapshotsTestJSON-1883092329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dc029f6-a87d-41ab-9b9f-0ebd50970bff" returned: 0 in 0.375s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-8a9306e0-0514-4a0b-834d-66862c5a6a27 req-e096cfc8-e5a0-4907-994e-48fc0b30f379 tempest-VolumesSnapshotsTestJSON-1883092329 None] Lock "cinder-quobyte-8dc029f6-a87d-41ab-9b9f-0ebd50970bff" released by "delete_volume" :: held 1.141s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:12:27 devstack sudo[94343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f
Nov 05 19:12:27 devstack sudo[94343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:27 devstack cinder-volume[87184]: DEBUG cinder.quota [req-8a9306e0-0514-4a0b-834d-66862c5a6a27 req-e096cfc8-e5a0-4907-994e-48fc0b30f379 tempest-VolumesSnapshotsTestJSON-1883092329 None] Created reservations ['9e479350-ee72-453b-8199-46e4d6e2bad0', 'f886690e-8433-440f-9224-165522c1f4c9', 'f79aba3c-490b-4582-865f-85527165c7ea', '9c4ac0fc-e31c-4075-96f5-5312dd7d7f74'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:12:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-8a9306e0-0514-4a0b-834d-66862c5a6a27 req-e096cfc8-e5a0-4907-994e-48fc0b30f379 tempest-VolumesSnapshotsTestJSON-1883092329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:12:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-8a9306e0-0514-4a0b-834d-66862c5a6a27 req-e096cfc8-e5a0-4907-994e-48fc0b30f379 tempest-VolumesSnapshotsTestJSON-1883092329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:12:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [req-8a9306e0-0514-4a0b-834d-66862c5a6a27 req-e096cfc8-e5a0-4907-994e-48fc0b30f379 tempest-VolumesSnapshotsTestJSON-1883092329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:12:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [req-8a9306e0-0514-4a0b-834d-66862c5a6a27 req-e096cfc8-e5a0-4907-994e-48fc0b30f379 tempest-VolumesSnapshotsTestJSON-1883092329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:12:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-8a9306e0-0514-4a0b-834d-66862c5a6a27 req-e096cfc8-e5a0-4907-994e-48fc0b30f379 tempest-VolumesSnapshotsTestJSON-1883092329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:12:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-8a9306e0-0514-4a0b-834d-66862c5a6a27 req-e096cfc8-e5a0-4907-994e-48fc0b30f379 tempest-VolumesSnapshotsTestJSON-1883092329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:27 devstack sudo[94345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:12:27 devstack sudo[94345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:27 devstack sudo[94343]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-849d69ab-e77b-40d0-ba91-1cb6f0deffaf tempest-GroupSnapshotsTest-1971566374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f" returned: 0 in 0.504s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-849d69ab-e77b-40d0-ba91-1cb6f0deffaf tempest-GroupSnapshotsTest-1971566374 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 19:12:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-849d69ab-e77b-40d0-ba91-1cb6f0deffaf tempest-GroupSnapshotsTest-1971566374 None] Creating direct copy from snapshot {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 19:12:27 devstack cinder-volume[87184]: DEBUG cinder.utils [None req-849d69ab-e77b-40d0-ba91-1cb6f0deffaf tempest-GroupSnapshotsTest-1971566374 None] Path /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b91e46bc-ac3a-4345-a27f-fe812abf1093 not found in is_blk_device check {{(pid=87184) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 19:12:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-849d69ab-e77b-40d0-ba91-1cb6f0deffaf tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b91e46bc-ac3a-4345-a27f-fe812abf1093 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:27 devstack sudo[94350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b91e46bc-ac3a-4345-a27f-fe812abf1093
Nov 05 19:12:27 devstack sudo[94350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:28 devstack sudo[94345]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-8a9306e0-0514-4a0b-834d-66862c5a6a27 req-e096cfc8-e5a0-4907-994e-48fc0b30f379 tempest-VolumesSnapshotsTestJSON-1883092329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.325s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:28 devstack cinder-volume[87184]: DEBUG cinder.manager [req-8a9306e0-0514-4a0b-834d-66862c5a6a27 req-e096cfc8-e5a0-4907-994e-48fc0b30f379 tempest-VolumesSnapshotsTestJSON-1883092329 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:12:28 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-8a9306e0-0514-4a0b-834d-66862c5a6a27 req-e096cfc8-e5a0-4907-994e-48fc0b30f379 tempest-VolumesSnapshotsTestJSON-1883092329 None] Deleted volume successfully.
Nov 05 19:12:28 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-8a9306e0-0514-4a0b-834d-66862c5a6a27 req-e096cfc8-e5a0-4907-994e-48fc0b30f379 tempest-VolumesSnapshotsTestJSON-1883092329 None] Lock "cinder-8dc029f6-a87d-41ab-9b9f-0ebd50970bff-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:12:28 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-8863dcd3-6086-4810-8598-29ed1d9cf481 req-6eabd55a-783a-4b01-bde8-240b33e55a02 tempest-AttachVolumeNegativeTest-1202125091 None] Terminate volume connection completed successfully.
Nov 05 19:12:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-8863dcd3-6086-4810-8598-29ed1d9cf481 req-6eabd55a-783a-4b01-bde8-240b33e55a02 tempest-AttachVolumeNegativeTest-1202125091 None] Deleting attachment fa9349a3-5e73-4bc1-8240-871435d189e8. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 19:12:30 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cb53af0-0f78-4472-bbb3-edc93c71d567 tempest-VolumesCloneNegativeTest-712859721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:12:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0cb53af0-0f78-4472-bbb3-edc93c71d567 tempest-VolumesCloneNegativeTest-712859721 None] Flow 'volume_create_manager' (494ddbd5-6444-4445-a209-98a8c90e9a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:12:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0cb53af0-0f78-4472-bbb3-edc93c71d567 tempest-VolumesCloneNegativeTest-712859721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2478e825-d77d-4dd4-b569-48ba02947407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0cb53af0-0f78-4472-bbb3-edc93c71d567 tempest-VolumesCloneNegativeTest-712859721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2478e825-d77d-4dd4-b569-48ba02947407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1329612200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47dac992-f8cb-4772-a7f4-b5a347f26787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a999293818c41009f2a11825ffb24f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:12:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:12:30Z,use_quota=True,user_id='e8f182e421d64f5c9e1e4dec57bc8d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0cb53af0-0f78-4472-bbb3-edc93c71d567 tempest-VolumesCloneNegativeTest-712859721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e213048e-a88e-42af-8fa4-938f39ad1b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0cb53af0-0f78-4472-bbb3-edc93c71d567 tempest-VolumesCloneNegativeTest-712859721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e213048e-a88e-42af-8fa4-938f39ad1b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0cb53af0-0f78-4472-bbb3-edc93c71d567 tempest-VolumesCloneNegativeTest-712859721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5036105c-9538-4833-9776-d0f6382e6658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0cb53af0-0f78-4472-bbb3-edc93c71d567 tempest-VolumesCloneNegativeTest-712859721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5036105c-9538-4833-9776-d0f6382e6658) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47dac992-f8cb-4772-a7f4-b5a347f26787', 'volume_name': 'volume-47dac992-f8cb-4772-a7f4-b5a347f26787', 'volume_size': 2}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0cb53af0-0f78-4472-bbb3-edc93c71d567 tempest-VolumesCloneNegativeTest-712859721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd299f87-aef3-4924-b169-d5d76a087ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0cb53af0-0f78-4472-bbb3-edc93c71d567 tempest-VolumesCloneNegativeTest-712859721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd299f87-aef3-4924-b169-d5d76a087ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0cb53af0-0f78-4472-bbb3-edc93c71d567 tempest-VolumesCloneNegativeTest-712859721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b07eae63-d85b-481e-9e13-aa78b4972dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:30 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-0cb53af0-0f78-4472-bbb3-edc93c71d567 tempest-VolumesCloneNegativeTest-712859721 None] Volume 47dac992-f8cb-4772-a7f4-b5a347f26787: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47dac992-f8cb-4772-a7f4-b5a347f26787', 'volume_size': 2}
Nov 05 19:12:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0cb53af0-0f78-4472-bbb3-edc93c71d567 tempest-VolumesCloneNegativeTest-712859721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:12:37 devstack sudo[94350]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-849d69ab-e77b-40d0-ba91-1cb6f0deffaf tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b91e46bc-ac3a-4345-a27f-fe812abf1093" returned: 0 in 9.159s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:37 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-849d69ab-e77b-40d0-ba91-1cb6f0deffaf tempest-GroupSnapshotsTest-1971566374 None] Image conversion details: src /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f, size 1024.00 MB, duration 9.16 sec, destination /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b91e46bc-ac3a-4345-a27f-fe812abf1093 {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 19:12:37 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-849d69ab-e77b-40d0-ba91-1cb6f0deffaf tempest-GroupSnapshotsTest-1971566374 None] Converted 1024.00 MB image at 111.79 MB/s
Nov 05 19:12:37 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-849d69ab-e77b-40d0-ba91-1cb6f0deffaf tempest-GroupSnapshotsTest-1971566374 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b91e46bc-ac3a-4345-a27f-fe812abf1093 is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 19:12:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-849d69ab-e77b-40d0-ba91-1cb6f0deffaf tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b91e46bc-ac3a-4345-a27f-fe812abf1093 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:37 devstack sudo[94410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b91e46bc-ac3a-4345-a27f-fe812abf1093
Nov 05 19:12:37 devstack sudo[94410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:37 devstack sudo[94410]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-849d69ab-e77b-40d0-ba91-1cb6f0deffaf tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b91e46bc-ac3a-4345-a27f-fe812abf1093" returned: 0 in 0.274s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-849d69ab-e77b-40d0-ba91-1cb6f0deffaf tempest-GroupSnapshotsTest-1971566374 None] Lock "cinder-quobyte-b91e46bc-ac3a-4345-a27f-fe812abf1093" released by "_copy_volume_from_snapshot" :: held 10.490s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:12:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-849d69ab-e77b-40d0-ba91-1cb6f0deffaf tempest-GroupSnapshotsTest-1971566374 None] Lock "cinder-quobyte-2f0d0dd5-7d24-41d1-8684-81ec62784942-b91e46bc-ac3a-4345-a27f-fe812abf1093" released by "_create_volume_from_snapshot" :: held 10.598s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:12:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-849d69ab-e77b-40d0-ba91-1cb6f0deffaf tempest-GroupSnapshotsTest-1971566374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.636s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:12:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0cb53af0-0f78-4472-bbb3-edc93c71d567 tempest-VolumesCloneNegativeTest-712859721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.868s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:12:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0cb53af0-0f78-4472-bbb3-edc93c71d567 tempest-VolumesCloneNegativeTest-712859721 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1329612200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47dac992-f8cb-4772-a7f4-b5a347f26787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a999293818c41009f2a11825ffb24f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:12:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:12:30Z,use_quota=True,user_id='e8f182e421d64f5c9e1e4dec57bc8d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:12:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-0cb53af0-0f78-4472-bbb3-edc93c71d567 tempest-VolumesCloneNegativeTest-712859721 None] Creating volume 47dac992-f8cb-4772-a7f4-b5a347f26787 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:12:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0cb53af0-0f78-4472-bbb3-edc93c71d567 tempest-VolumesCloneNegativeTest-712859721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:12:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0cb53af0-0f78-4472-bbb3-edc93c71d567 tempest-VolumesCloneNegativeTest-712859721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:12:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0cb53af0-0f78-4472-bbb3-edc93c71d567 tempest-VolumesCloneNegativeTest-712859721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:12:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0cb53af0-0f78-4472-bbb3-edc93c71d567 tempest-VolumesCloneNegativeTest-712859721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:12:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0cb53af0-0f78-4472-bbb3-edc93c71d567 tempest-VolumesCloneNegativeTest-712859721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:12:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0cb53af0-0f78-4472-bbb3-edc93c71d567 tempest-VolumesCloneNegativeTest-712859721 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:12:37 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-0cb53af0-0f78-4472-bbb3-edc93c71d567 tempest-VolumesCloneNegativeTest-712859721 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:12:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0cb53af0-0f78-4472-bbb3-edc93c71d567 tempest-VolumesCloneNegativeTest-712859721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-47dac992-f8cb-4772-a7f4-b5a347f26787 2147483648 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:37 devstack sudo[94413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-47dac992-f8cb-4772-a7f4-b5a347f26787 2147483648
Nov 05 19:12:37 devstack sudo[94413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:37 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-849d69ab-e77b-40d0-ba91-1cb6f0deffaf tempest-GroupSnapshotsTest-1971566374 None] Create group from source-snapshot-c3de37f3-642a-4e77-874e-648e8ab9787d completed successfully.
Nov 05 19:12:37 devstack sudo[94413]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0cb53af0-0f78-4472-bbb3-edc93c71d567 tempest-VolumesCloneNegativeTest-712859721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-47dac992-f8cb-4772-a7f4-b5a347f26787 2147483648" returned: 0 in 0.607s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0cb53af0-0f78-4472-bbb3-edc93c71d567 tempest-VolumesCloneNegativeTest-712859721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-47dac992-f8cb-4772-a7f4-b5a347f26787 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:38 devstack sudo[94425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-47dac992-f8cb-4772-a7f4-b5a347f26787
Nov 05 19:12:38 devstack sudo[94425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:38 devstack sudo[94425]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0cb53af0-0f78-4472-bbb3-edc93c71d567 tempest-VolumesCloneNegativeTest-712859721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-47dac992-f8cb-4772-a7f4-b5a347f26787" returned: 0 in 0.326s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0cb53af0-0f78-4472-bbb3-edc93c71d567 tempest-VolumesCloneNegativeTest-712859721 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:12:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0cb53af0-0f78-4472-bbb3-edc93c71d567 tempest-VolumesCloneNegativeTest-712859721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:12:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0cb53af0-0f78-4472-bbb3-edc93c71d567 tempest-VolumesCloneNegativeTest-712859721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b07eae63-d85b-481e-9e13-aa78b4972dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47dac992-f8cb-4772-a7f4-b5a347f26787', 'volume_size': 2}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0cb53af0-0f78-4472-bbb3-edc93c71d567 tempest-VolumesCloneNegativeTest-712859721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42308154-a8b0-4bf6-a465-c172cc0b66ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:38 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-0cb53af0-0f78-4472-bbb3-edc93c71d567 tempest-VolumesCloneNegativeTest-712859721 None] Volume volume-47dac992-f8cb-4772-a7f4-b5a347f26787 (47dac992-f8cb-4772-a7f4-b5a347f26787): created successfully
Nov 05 19:12:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0cb53af0-0f78-4472-bbb3-edc93c71d567 tempest-VolumesCloneNegativeTest-712859721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42308154-a8b0-4bf6-a465-c172cc0b66ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0cb53af0-0f78-4472-bbb3-edc93c71d567 tempest-VolumesCloneNegativeTest-712859721 None] Flow 'volume_create_manager' (494ddbd5-6444-4445-a209-98a8c90e9a50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:12:38 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-0cb53af0-0f78-4472-bbb3-edc93c71d567 tempest-VolumesCloneNegativeTest-712859721 None] Created volume successfully.
Nov 05 19:12:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9a88061a-6074-46fd-b43f-0f172096f392 tempest-GroupSnapshotsTest-1971566374 None] Acquiring lock "cinder-quobyte-b91e46bc-ac3a-4345-a27f-fe812abf1093" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:12:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9a88061a-6074-46fd-b43f-0f172096f392 tempest-GroupSnapshotsTest-1971566374 None] Lock "cinder-quobyte-b91e46bc-ac3a-4345-a27f-fe812abf1093" acquired by "delete_volume" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:12:38 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7424b5c-89ec-4d3c-a889-e76ccc738be8]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:12:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9a88061a-6074-46fd-b43f-0f172096f392 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b91e46bc-ac3a-4345-a27f-fe812abf1093 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:38 devstack sudo[94428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b91e46bc-ac3a-4345-a27f-fe812abf1093
Nov 05 19:12:38 devstack sudo[94428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:39 devstack sudo[94428]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9a88061a-6074-46fd-b43f-0f172096f392 tempest-GroupSnapshotsTest-1971566374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b91e46bc-ac3a-4345-a27f-fe812abf1093" returned: 0 in 0.426s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9a88061a-6074-46fd-b43f-0f172096f392 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b91e46bc-ac3a-4345-a27f-fe812abf1093 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:39 devstack sudo[94433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b91e46bc-ac3a-4345-a27f-fe812abf1093
Nov 05 19:12:39 devstack sudo[94433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:39 devstack sudo[94433]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9a88061a-6074-46fd-b43f-0f172096f392 tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b91e46bc-ac3a-4345-a27f-fe812abf1093" returned: 0 in 0.304s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9a88061a-6074-46fd-b43f-0f172096f392 tempest-GroupSnapshotsTest-1971566374 None] Lock "cinder-quobyte-b91e46bc-ac3a-4345-a27f-fe812abf1093" released by "delete_volume" :: held 0.786s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:12:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1ca9b652-03de-4daf-986b-3bb5cb47e23a tempest-VolumesCloneNegativeTest-712859721 None] Acquiring lock "cinder-47dac992-f8cb-4772-a7f4-b5a347f26787-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:12:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1ca9b652-03de-4daf-986b-3bb5cb47e23a tempest-VolumesCloneNegativeTest-712859721 None] Lock "cinder-47dac992-f8cb-4772-a7f4-b5a347f26787-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:12:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1ca9b652-03de-4daf-986b-3bb5cb47e23a tempest-VolumesCloneNegativeTest-712859721 None] Acquiring lock "cinder-quobyte-47dac992-f8cb-4772-a7f4-b5a347f26787" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:12:39 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-9a88061a-6074-46fd-b43f-0f172096f392 tempest-GroupSnapshotsTest-1971566374 None] Created reservations ['86fc9e9f-a1f1-42d4-948a-fa0cea5f8378'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:12:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1ca9b652-03de-4daf-986b-3bb5cb47e23a tempest-VolumesCloneNegativeTest-712859721 None] Lock "cinder-quobyte-47dac992-f8cb-4772-a7f4-b5a347f26787" acquired by "delete_volume" :: waited 0.029s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:12:39 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b944607a-23e6-4b9e-8ee0-498aedc3d29c]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:12:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1ca9b652-03de-4daf-986b-3bb5cb47e23a tempest-VolumesCloneNegativeTest-712859721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-47dac992-f8cb-4772-a7f4-b5a347f26787 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:39 devstack cinder-volume[87184]: WARNING cinder.quota [None req-9a88061a-6074-46fd-b43f-0f172096f392 tempest-GroupSnapshotsTest-1971566374 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1489700430 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1489700430, it is now deprecated. Please use the default quota class for default quota.
Nov 05 19:12:39 devstack cinder-volume[87184]: WARNING cinder.quota [None req-9a88061a-6074-46fd-b43f-0f172096f392 tempest-GroupSnapshotsTest-1971566374 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1489700430 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1489700430, it is now deprecated. Please use the default quota class for default quota.
Nov 05 19:12:39 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-9a88061a-6074-46fd-b43f-0f172096f392 tempest-GroupSnapshotsTest-1971566374 None] Created reservations ['8aa0c649-b7bf-4863-b806-83b253bc9526', 'fb694019-7a4f-485b-af88-7ddb71fd1e64', '3cc98b01-6a63-4568-9ca5-623be2e3cf29', '652cc5cc-ddd3-4e61-9cfa-426d592b2ea2'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:12:39 devstack sudo[94436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-47dac992-f8cb-4772-a7f4-b5a347f26787
Nov 05 19:12:39 devstack sudo[94436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9a88061a-6074-46fd-b43f-0f172096f392 tempest-GroupSnapshotsTest-1971566374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:12:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9a88061a-6074-46fd-b43f-0f172096f392 tempest-GroupSnapshotsTest-1971566374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:12:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9a88061a-6074-46fd-b43f-0f172096f392 tempest-GroupSnapshotsTest-1971566374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:12:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9a88061a-6074-46fd-b43f-0f172096f392 tempest-GroupSnapshotsTest-1971566374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:12:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9a88061a-6074-46fd-b43f-0f172096f392 tempest-GroupSnapshotsTest-1971566374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:12:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9a88061a-6074-46fd-b43f-0f172096f392 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:39 devstack sudo[94438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:12:39 devstack sudo[94438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:40 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-3d7fa80f-7e68-4448-9d25-8de4c46bc13e tempest-GroupSnapshotsTest-1971566374 None] group_snapshot c3de37f3-642a-4e77-874e-648e8ab9787d: deleting
Nov 05 19:12:40 devstack sudo[94438]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9a88061a-6074-46fd-b43f-0f172096f392 tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.263s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:40 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-9a88061a-6074-46fd-b43f-0f172096f392 tempest-GroupSnapshotsTest-1971566374 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:12:40 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-9a88061a-6074-46fd-b43f-0f172096f392 tempest-GroupSnapshotsTest-1971566374 None] Delete group completed successfully.
Nov 05 19:12:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3d7fa80f-7e68-4448-9d25-8de4c46bc13e tempest-GroupSnapshotsTest-1971566374 None] group_snapshot c3de37f3-642a-4e77-874e-648e8ab9787d: deleting {{(pid=87184) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 05 19:12:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3d7fa80f-7e68-4448-9d25-8de4c46bc13e tempest-GroupSnapshotsTest-1971566374 None] Acquiring lock "cinder-quobyte-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:12:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3d7fa80f-7e68-4448-9d25-8de4c46bc13e tempest-GroupSnapshotsTest-1971566374 None] Lock "cinder-quobyte-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:12:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3d7fa80f-7e68-4448-9d25-8de4c46bc13e tempest-GroupSnapshotsTest-1971566374 None] Acquiring lock "cinder-quobyte-2f0d0dd5-7d24-41d1-8684-81ec62784942" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:12:40 devstack sudo[94436]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3d7fa80f-7e68-4448-9d25-8de4c46bc13e tempest-GroupSnapshotsTest-1971566374 None] Lock "cinder-quobyte-2f0d0dd5-7d24-41d1-8684-81ec62784942" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:12:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-3d7fa80f-7e68-4448-9d25-8de4c46bc13e tempest-GroupSnapshotsTest-1971566374 None] Deleting offline snapshot 2f0d0dd5-7d24-41d1-8684-81ec62784942 of volume c21a3b6e-1b07-4e14-bc91-cd81a0370b1f {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:12:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-3d7fa80f-7e68-4448-9d25-8de4c46bc13e tempest-GroupSnapshotsTest-1971566374 None] snapshot_file for this snap is: volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f.2f0d0dd5-7d24-41d1-8684-81ec62784942 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:12:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1ca9b652-03de-4daf-986b-3bb5cb47e23a tempest-VolumesCloneNegativeTest-712859721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-47dac992-f8cb-4772-a7f4-b5a347f26787" returned: 0 in 0.594s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1ca9b652-03de-4daf-986b-3bb5cb47e23a tempest-VolumesCloneNegativeTest-712859721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-47dac992-f8cb-4772-a7f4-b5a347f26787 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:40 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f328781-bc38-4f36-a6f0-228c45b4c2de]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:12:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3d7fa80f-7e68-4448-9d25-8de4c46bc13e tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f.2f0d0dd5-7d24-41d1-8684-81ec62784942 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:40 devstack sudo[94445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-47dac992-f8cb-4772-a7f4-b5a347f26787
Nov 05 19:12:40 devstack sudo[94445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:40 devstack sudo[94449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f.2f0d0dd5-7d24-41d1-8684-81ec62784942
Nov 05 19:12:40 devstack sudo[94449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:40 devstack sudo[94445]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1ca9b652-03de-4daf-986b-3bb5cb47e23a tempest-VolumesCloneNegativeTest-712859721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-47dac992-f8cb-4772-a7f4-b5a347f26787" returned: 0 in 0.461s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1ca9b652-03de-4daf-986b-3bb5cb47e23a tempest-VolumesCloneNegativeTest-712859721 None] Lock "cinder-quobyte-47dac992-f8cb-4772-a7f4-b5a347f26787" released by "delete_volume" :: held 1.118s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:12:40 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-1ca9b652-03de-4daf-986b-3bb5cb47e23a tempest-VolumesCloneNegativeTest-712859721 None] Created reservations ['c30d87ad-cabc-4663-9d08-2e6ad9447679', '6de416d0-8211-4578-9aa2-5fcbd225f716', '09c0c8a7-277d-4a99-b9fe-17766f2141a2', 'c58a0e50-c00b-4cd2-bc6e-84ea573bedcc'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:12:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1ca9b652-03de-4daf-986b-3bb5cb47e23a tempest-VolumesCloneNegativeTest-712859721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:12:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1ca9b652-03de-4daf-986b-3bb5cb47e23a tempest-VolumesCloneNegativeTest-712859721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:12:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1ca9b652-03de-4daf-986b-3bb5cb47e23a tempest-VolumesCloneNegativeTest-712859721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:12:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1ca9b652-03de-4daf-986b-3bb5cb47e23a tempest-VolumesCloneNegativeTest-712859721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:12:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1ca9b652-03de-4daf-986b-3bb5cb47e23a tempest-VolumesCloneNegativeTest-712859721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:12:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1ca9b652-03de-4daf-986b-3bb5cb47e23a tempest-VolumesCloneNegativeTest-712859721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:40 devstack sudo[94454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:12:40 devstack sudo[94454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:40 devstack sudo[94449]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3d7fa80f-7e68-4448-9d25-8de4c46bc13e tempest-GroupSnapshotsTest-1971566374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f.2f0d0dd5-7d24-41d1-8684-81ec62784942" returned: 0 in 0.709s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-3d7fa80f-7e68-4448-9d25-8de4c46bc13e tempest-GroupSnapshotsTest-1971566374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:12:40 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85167a3-ae96-4d27-8f27-10e7d6aa01d1]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:12:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3d7fa80f-7e68-4448-9d25-8de4c46bc13e tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:41 devstack sudo[94457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f
Nov 05 19:12:41 devstack sudo[94457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:41 devstack sudo[94454]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1ca9b652-03de-4daf-986b-3bb5cb47e23a tempest-VolumesCloneNegativeTest-712859721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.341s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:41 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-1ca9b652-03de-4daf-986b-3bb5cb47e23a tempest-VolumesCloneNegativeTest-712859721 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:12:41 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-1ca9b652-03de-4daf-986b-3bb5cb47e23a tempest-VolumesCloneNegativeTest-712859721 None] Deleted volume successfully.
Nov 05 19:12:41 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1ca9b652-03de-4daf-986b-3bb5cb47e23a tempest-VolumesCloneNegativeTest-712859721 None] Lock "cinder-47dac992-f8cb-4772-a7f4-b5a347f26787-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:12:41 devstack sudo[94457]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3d7fa80f-7e68-4448-9d25-8de4c46bc13e tempest-GroupSnapshotsTest-1971566374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f" returned: 0 in 0.729s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3d7fa80f-7e68-4448-9d25-8de4c46bc13e tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f.2f0d0dd5-7d24-41d1-8684-81ec62784942 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:41 devstack sudo[94463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f.2f0d0dd5-7d24-41d1-8684-81ec62784942
Nov 05 19:12:41 devstack sudo[94463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:42 devstack sudo[94463]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3d7fa80f-7e68-4448-9d25-8de4c46bc13e tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f.2f0d0dd5-7d24-41d1-8684-81ec62784942" returned: 0 in 0.509s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3d7fa80f-7e68-4448-9d25-8de4c46bc13e tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f.2f0d0dd5-7d24-41d1-8684-81ec62784942 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:42 devstack sudo[94473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f.2f0d0dd5-7d24-41d1-8684-81ec62784942
Nov 05 19:12:42 devstack sudo[94473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:42 devstack sudo[94473]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3d7fa80f-7e68-4448-9d25-8de4c46bc13e tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f.2f0d0dd5-7d24-41d1-8684-81ec62784942" returned: 0 in 0.597s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:42 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3d7fa80f-7e68-4448-9d25-8de4c46bc13e tempest-GroupSnapshotsTest-1971566374 None] Lock "cinder-quobyte-2f0d0dd5-7d24-41d1-8684-81ec62784942" released by "_delete_snapshot" :: held 2.726s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:12:42 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3d7fa80f-7e68-4448-9d25-8de4c46bc13e tempest-GroupSnapshotsTest-1971566374 None] Lock "cinder-quobyte-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f" released by "delete_snapshot" :: held 2.762s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:12:43 devstack cinder-volume[87184]: WARNING cinder.quota [None req-3d7fa80f-7e68-4448-9d25-8de4c46bc13e tempest-GroupSnapshotsTest-1971566374 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1489700430 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1489700430, it is now deprecated. Please use the default quota class for default quota.
Nov 05 19:12:43 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-3d7fa80f-7e68-4448-9d25-8de4c46bc13e tempest-GroupSnapshotsTest-1971566374 None] Created reservations ['528312be-73fb-49ca-99a8-9584ddd08930', '5b082f8c-2c2d-4770-8302-dfb332ef93bf', '4d52f86a-b1b4-4e9a-96b0-ebc7bcac43c0', '606be411-7bb3-404a-93b9-424af165e15e'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:12:43 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-3d7fa80f-7e68-4448-9d25-8de4c46bc13e tempest-GroupSnapshotsTest-1971566374 None] group_snapshot c3de37f3-642a-4e77-874e-648e8ab9787d: deleted successfully
Nov 05 19:12:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-449c1e0e-57a8-4f0e-a654-e85dac3a39d0 tempest-GroupSnapshotsTest-1971566374 None] Acquiring lock "cinder-quobyte-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:12:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-449c1e0e-57a8-4f0e-a654-e85dac3a39d0 tempest-GroupSnapshotsTest-1971566374 None] Lock "cinder-quobyte-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f" acquired by "delete_volume" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:12:44 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bd8531-4d96-40dd-86e7-3a3f099e28f0]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:12:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-449c1e0e-57a8-4f0e-a654-e85dac3a39d0 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:44 devstack sudo[94524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f
Nov 05 19:12:44 devstack sudo[94524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:44 devstack sudo[94524]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-449c1e0e-57a8-4f0e-a654-e85dac3a39d0 tempest-GroupSnapshotsTest-1971566374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f" returned: 0 in 0.562s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-449c1e0e-57a8-4f0e-a654-e85dac3a39d0 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:44 devstack sudo[94529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f
Nov 05 19:12:44 devstack sudo[94529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:44 devstack sudo[94529]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-449c1e0e-57a8-4f0e-a654-e85dac3a39d0 tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f" returned: 0 in 0.298s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-449c1e0e-57a8-4f0e-a654-e85dac3a39d0 tempest-GroupSnapshotsTest-1971566374 None] Lock "cinder-quobyte-c21a3b6e-1b07-4e14-bc91-cd81a0370b1f" released by "delete_volume" :: held 0.975s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:12:45 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-449c1e0e-57a8-4f0e-a654-e85dac3a39d0 tempest-GroupSnapshotsTest-1971566374 None] Created reservations ['53648539-5fe1-47c0-a8d2-22b5983b4a65'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:12:45 devstack cinder-volume[87184]: WARNING cinder.db.api [None req-449c1e0e-57a8-4f0e-a654-e85dac3a39d0 tempest-GroupSnapshotsTest-1971566374 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1489700430']
Nov 05 19:12:45 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-449c1e0e-57a8-4f0e-a654-e85dac3a39d0 tempest-GroupSnapshotsTest-1971566374 None] Created reservations ['2b3b603b-5467-4127-b010-965232262584', '58c68474-1f6b-42e8-bd18-97c2f69a8e3e', '887f9f23-2fb5-47e5-bdee-7f67aebd27dc', '79d2a0fe-afe8-44c0-a63b-aa23b847f098'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:12:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-449c1e0e-57a8-4f0e-a654-e85dac3a39d0 tempest-GroupSnapshotsTest-1971566374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:12:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-449c1e0e-57a8-4f0e-a654-e85dac3a39d0 tempest-GroupSnapshotsTest-1971566374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:12:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-449c1e0e-57a8-4f0e-a654-e85dac3a39d0 tempest-GroupSnapshotsTest-1971566374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:12:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-449c1e0e-57a8-4f0e-a654-e85dac3a39d0 tempest-GroupSnapshotsTest-1971566374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:12:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-449c1e0e-57a8-4f0e-a654-e85dac3a39d0 tempest-GroupSnapshotsTest-1971566374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:12:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-449c1e0e-57a8-4f0e-a654-e85dac3a39d0 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:45 devstack sudo[94533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:12:45 devstack sudo[94533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:45 devstack sudo[94533]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-449c1e0e-57a8-4f0e-a654-e85dac3a39d0 tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.422s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:45 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-449c1e0e-57a8-4f0e-a654-e85dac3a39d0 tempest-GroupSnapshotsTest-1971566374 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:12:45 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-449c1e0e-57a8-4f0e-a654-e85dac3a39d0 tempest-GroupSnapshotsTest-1971566374 None] Delete group completed successfully.
Nov 05 19:12:46 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-91b1ebac-baa1-4b39-81b5-ecae70e0e0d0 tempest-GroupSnapshotsTest-1971566374 None] Group tempest-GroupSnapshotsTest-Group-1499363242: creating
Nov 05 19:12:46 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-91b1ebac-baa1-4b39-81b5-ecae70e0e0d0 tempest-GroupSnapshotsTest-1971566374 None] Group tempest-GroupSnapshotsTest-Group-1499363242: created successfully
Nov 05 19:12:46 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-91b1ebac-baa1-4b39-81b5-ecae70e0e0d0 tempest-GroupSnapshotsTest-1971566374 None] Create group completed successfully.
Nov 05 19:12:48 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0b074af-17ac-4e0a-8825-b4c9ac7b9e3e tempest-GroupSnapshotsTest-1971566374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:12:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c0b074af-17ac-4e0a-8825-b4c9ac7b9e3e tempest-GroupSnapshotsTest-1971566374 None] Flow 'volume_create_manager' (ba2117c1-8816-4251-be7a-ab4fe55e856f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:12:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c0b074af-17ac-4e0a-8825-b4c9ac7b9e3e tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3974d6c-6a09-4887-b77e-f6320a2d0e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c0b074af-17ac-4e0a-8825-b4c9ac7b9e3e tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3974d6c-6a09-4887-b77e-f6320a2d0e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1432061512',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=77ea2373-2ccf-49aa-959f-d4bed54590f8,host='devstack@QuobyteHD#QuobyteHD',id=a938c9f6-de91-45f1-99d0-68d0a4bf66f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75ade83722d84a799eff399843986cb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:12:48Z,use_quota=True,user_id='e3f9060bf2674e44a7ef4fc02ea1d058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d4a1735-5c97-4fbb-ad7f-5ad7d65e2fa8),volume_type_id=6d4a1735-5c97-4fbb-ad7f-5ad7d65e2fa8)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c0b074af-17ac-4e0a-8825-b4c9ac7b9e3e tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceac9372-c82c-4593-bd3b-e8989338dfa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c0b074af-17ac-4e0a-8825-b4c9ac7b9e3e tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceac9372-c82c-4593-bd3b-e8989338dfa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c0b074af-17ac-4e0a-8825-b4c9ac7b9e3e tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17f96106-7782-49bc-bdbe-2831e29e8bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c0b074af-17ac-4e0a-8825-b4c9ac7b9e3e tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17f96106-7782-49bc-bdbe-2831e29e8bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a938c9f6-de91-45f1-99d0-68d0a4bf66f8', 'volume_name': 'volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c0b074af-17ac-4e0a-8825-b4c9ac7b9e3e tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfcf1389-43df-457e-8702-3849ac2d6df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c0b074af-17ac-4e0a-8825-b4c9ac7b9e3e tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfcf1389-43df-457e-8702-3849ac2d6df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c0b074af-17ac-4e0a-8825-b4c9ac7b9e3e tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (687514d2-df38-4670-9141-c3ebd5d3c781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:48 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-c0b074af-17ac-4e0a-8825-b4c9ac7b9e3e tempest-GroupSnapshotsTest-1971566374 None] Volume a938c9f6-de91-45f1-99d0-68d0a4bf66f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8', 'volume_size': 1}
Nov 05 19:12:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c0b074af-17ac-4e0a-8825-b4c9ac7b9e3e tempest-GroupSnapshotsTest-1971566374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:12:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c0b074af-17ac-4e0a-8825-b4c9ac7b9e3e tempest-GroupSnapshotsTest-1971566374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:12:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c0b074af-17ac-4e0a-8825-b4c9ac7b9e3e tempest-GroupSnapshotsTest-1971566374 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=77ea2373-2ccf-49aa-959f-d4bed54590f8,created_at=2026-11-05T18:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1432061512',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=77ea2373-2ccf-49aa-959f-d4bed54590f8,host='devstack@QuobyteHD#QuobyteHD',id=a938c9f6-de91-45f1-99d0-68d0a4bf66f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75ade83722d84a799eff399843986cb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:12:48Z,use_quota=True,user_id='e3f9060bf2674e44a7ef4fc02ea1d058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d4a1735-5c97-4fbb-ad7f-5ad7d65e2fa8),volume_type_id=6d4a1735-5c97-4fbb-ad7f-5ad7d65e2fa8)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:12:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-c0b074af-17ac-4e0a-8825-b4c9ac7b9e3e tempest-GroupSnapshotsTest-1971566374 None] Creating volume a938c9f6-de91-45f1-99d0-68d0a4bf66f8 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:12:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c0b074af-17ac-4e0a-8825-b4c9ac7b9e3e tempest-GroupSnapshotsTest-1971566374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:12:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c0b074af-17ac-4e0a-8825-b4c9ac7b9e3e tempest-GroupSnapshotsTest-1971566374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:12:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c0b074af-17ac-4e0a-8825-b4c9ac7b9e3e tempest-GroupSnapshotsTest-1971566374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:12:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c0b074af-17ac-4e0a-8825-b4c9ac7b9e3e tempest-GroupSnapshotsTest-1971566374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:12:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c0b074af-17ac-4e0a-8825-b4c9ac7b9e3e tempest-GroupSnapshotsTest-1971566374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:12:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c0b074af-17ac-4e0a-8825-b4c9ac7b9e3e tempest-GroupSnapshotsTest-1971566374 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:12:48 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-c0b074af-17ac-4e0a-8825-b4c9ac7b9e3e tempest-GroupSnapshotsTest-1971566374 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:12:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c0b074af-17ac-4e0a-8825-b4c9ac7b9e3e tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:48 devstack sudo[94608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8 1073741824
Nov 05 19:12:48 devstack sudo[94608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:49 devstack sudo[94608]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c0b074af-17ac-4e0a-8825-b4c9ac7b9e3e tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8 1073741824" returned: 0 in 0.660s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c0b074af-17ac-4e0a-8825-b4c9ac7b9e3e tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:49 devstack sudo[94614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8
Nov 05 19:12:49 devstack sudo[94614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:49 devstack sudo[94614]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c0b074af-17ac-4e0a-8825-b4c9ac7b9e3e tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8" returned: 0 in 0.505s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c0b074af-17ac-4e0a-8825-b4c9ac7b9e3e tempest-GroupSnapshotsTest-1971566374 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:12:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c0b074af-17ac-4e0a-8825-b4c9ac7b9e3e tempest-GroupSnapshotsTest-1971566374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:12:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c0b074af-17ac-4e0a-8825-b4c9ac7b9e3e tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (687514d2-df38-4670-9141-c3ebd5d3c781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c0b074af-17ac-4e0a-8825-b4c9ac7b9e3e tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1edf2f5-1c50-4a8b-a794-a5635294d147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:49 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-c0b074af-17ac-4e0a-8825-b4c9ac7b9e3e tempest-GroupSnapshotsTest-1971566374 None] Volume volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8 (a938c9f6-de91-45f1-99d0-68d0a4bf66f8): created successfully
Nov 05 19:12:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c0b074af-17ac-4e0a-8825-b4c9ac7b9e3e tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1edf2f5-1c50-4a8b-a794-a5635294d147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c0b074af-17ac-4e0a-8825-b4c9ac7b9e3e tempest-GroupSnapshotsTest-1971566374 None] Flow 'volume_create_manager' (ba2117c1-8816-4251-be7a-ab4fe55e856f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:12:49 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-c0b074af-17ac-4e0a-8825-b4c9ac7b9e3e tempest-GroupSnapshotsTest-1971566374 None] Created volume successfully.
Nov 05 19:12:50 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:12:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Flow 'volume_create_manager' (4e982a6a-d79c-4f39-8ef7-112981ab9bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:12:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d56dceb-2751-4b99-9663-feef46a75543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d56dceb-2751-4b99-9663-feef46a75543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-568682789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51e775a2-0d3d-4eb0-baab-a25e75af5b61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5e709dff314f9b9b5a3bd37f3db746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:12:50Z,use_quota=True,user_id='4888ef249100497a97c6f6315fb1c6c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44f7b3a1-d19b-42bd-af8a-a7e833f224f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44f7b3a1-d19b-42bd-af8a-a7e833f224f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (319fb8ec-ab26-4597-ba82-c8ae77a0fd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:50 devstack cinder-volume[87184]: DEBUG cinder.image.glance [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Creating Keystone auth plugin from conf {{(pid=87184) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 19:12:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (319fb8ec-ab26-4597-ba82-c8ae77a0fd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '51e775a2-0d3d-4eb0-baab-a25e75af5b61', 'volume_name': 'volume-51e775a2-0d3d-4eb0-baab-a25e75af5b61', 'volume_size': 1, 'image_id': '300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3e813114ebb84b35a5c6eb1b802f157f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'created_at': datetime.datetime(2026, 11, 5, 18, 1, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 18, 1, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x736631cf61b0>}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db00ee5-b5d6-45f6-9f1f-4c2f9a21c560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db00ee5-b5d6-45f6-9f1f-4c2f9a21c560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3af4a7cd-fc24-486d-b6a8-72dc8ef6a906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:51 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Volume 51e775a2-0d3d-4eb0-baab-a25e75af5b61: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-51e775a2-0d3d-4eb0-baab-a25e75af5b61', 'volume_size': 1, 'image_id': '300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3e813114ebb84b35a5c6eb1b802f157f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'created_at': datetime.datetime(2026, 11, 5, 18, 1, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 18, 1, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x736631cf61b0>}
Nov 05 19:12:51 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Trying to clone 51e775a2-0d3d-4eb0-baab-a25e75af5b61 from image 300700a0-51ab-4ee2-8ef0-e0eeaa8aee29 at location (None, [{'url': 'file:///opt/stack/data/glance/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'metadata': {}}]). {{(pid=87184) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 19:12:52 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_43wp8qjmdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 19:12:52 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 19:12:52 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8043787e-7167-4a7c-929a-3b59059bea91]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:12:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_43wp8qjmdevstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:52 devstack sudo[94621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_43wp8qjmdevstack@QuobyteHD
Nov 05 19:12:52 devstack sudo[94621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:52 devstack sudo[94621]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:52 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-91623f1c-282e-4a5f-a4ba-94f8d4fd6377 tempest-GroupSnapshotsTest-1971566374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:12:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-91623f1c-282e-4a5f-a4ba-94f8d4fd6377 tempest-GroupSnapshotsTest-1971566374 None] Flow 'volume_create_manager' (d72489ff-f838-43ab-b087-f0b396d88dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:12:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-91623f1c-282e-4a5f-a4ba-94f8d4fd6377 tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eacde827-8d23-46c8-9dc2-1cc3aa920574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_43wp8qjmdevstack@QuobyteHD" returned: 0 in 0.708s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:52 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Temporary image 300700a0-51ab-4ee2-8ef0-e0eeaa8aee29 is fetched for user 4888ef249100497a97c6f6315fb1c6c4. {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 19:12:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-91623f1c-282e-4a5f-a4ba-94f8d4fd6377 tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eacde827-8d23-46c8-9dc2-1cc3aa920574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-118905266',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=77ea2373-2ccf-49aa-959f-d4bed54590f8,host='devstack@QuobyteHD#QuobyteHD',id=91069d7f-4eda-4f96-9ba2-e0094150265d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75ade83722d84a799eff399843986cb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:12:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:12:53Z,use_quota=True,user_id='e3f9060bf2674e44a7ef4fc02ea1d058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d4a1735-5c97-4fbb-ad7f-5ad7d65e2fa8),volume_type_id=6d4a1735-5c97-4fbb-ad7f-5ad7d65e2fa8)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-91623f1c-282e-4a5f-a4ba-94f8d4fd6377 tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8ad6671-22f4-43f0-9306-740abe95b9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-91623f1c-282e-4a5f-a4ba-94f8d4fd6377 tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8ad6671-22f4-43f0-9306-740abe95b9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-91623f1c-282e-4a5f-a4ba-94f8d4fd6377 tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aed98397-e1bc-43ec-8e22-4398691df98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-91623f1c-282e-4a5f-a4ba-94f8d4fd6377 tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aed98397-e1bc-43ec-8e22-4398691df98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91069d7f-4eda-4f96-9ba2-e0094150265d', 'volume_name': 'volume-91069d7f-4eda-4f96-9ba2-e0094150265d', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-91623f1c-282e-4a5f-a4ba-94f8d4fd6377 tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cfc33ab-7d38-4a6b-94ae-6e25e8ff75ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-91623f1c-282e-4a5f-a4ba-94f8d4fd6377 tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cfc33ab-7d38-4a6b-94ae-6e25e8ff75ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-91623f1c-282e-4a5f-a4ba-94f8d4fd6377 tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d1fda3d-0946-4286-a184-ba351d694eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:52 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-91623f1c-282e-4a5f-a4ba-94f8d4fd6377 tempest-GroupSnapshotsTest-1971566374 None] Volume 91069d7f-4eda-4f96-9ba2-e0094150265d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91069d7f-4eda-4f96-9ba2-e0094150265d', 'volume_size': 1}
Nov 05 19:12:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-91623f1c-282e-4a5f-a4ba-94f8d4fd6377 tempest-GroupSnapshotsTest-1971566374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:12:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-91623f1c-282e-4a5f-a4ba-94f8d4fd6377 tempest-GroupSnapshotsTest-1971566374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:12:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-91623f1c-282e-4a5f-a4ba-94f8d4fd6377 tempest-GroupSnapshotsTest-1971566374 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=77ea2373-2ccf-49aa-959f-d4bed54590f8,created_at=2026-11-05T18:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-118905266',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=77ea2373-2ccf-49aa-959f-d4bed54590f8,host='devstack@QuobyteHD#QuobyteHD',id=91069d7f-4eda-4f96-9ba2-e0094150265d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75ade83722d84a799eff399843986cb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:12:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:12:53Z,use_quota=True,user_id='e3f9060bf2674e44a7ef4fc02ea1d058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d4a1735-5c97-4fbb-ad7f-5ad7d65e2fa8),volume_type_id=6d4a1735-5c97-4fbb-ad7f-5ad7d65e2fa8)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:12:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-91623f1c-282e-4a5f-a4ba-94f8d4fd6377 tempest-GroupSnapshotsTest-1971566374 None] Creating volume 91069d7f-4eda-4f96-9ba2-e0094150265d {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:12:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-91623f1c-282e-4a5f-a4ba-94f8d4fd6377 tempest-GroupSnapshotsTest-1971566374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:12:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-91623f1c-282e-4a5f-a4ba-94f8d4fd6377 tempest-GroupSnapshotsTest-1971566374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:12:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-91623f1c-282e-4a5f-a4ba-94f8d4fd6377 tempest-GroupSnapshotsTest-1971566374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:12:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-91623f1c-282e-4a5f-a4ba-94f8d4fd6377 tempest-GroupSnapshotsTest-1971566374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:12:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-91623f1c-282e-4a5f-a4ba-94f8d4fd6377 tempest-GroupSnapshotsTest-1971566374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:12:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-91623f1c-282e-4a5f-a4ba-94f8d4fd6377 tempest-GroupSnapshotsTest-1971566374 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:12:52 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-91623f1c-282e-4a5f-a4ba-94f8d4fd6377 tempest-GroupSnapshotsTest-1971566374 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:12:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-91623f1c-282e-4a5f-a4ba-94f8d4fd6377 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:52 devstack sudo[94626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d 1073741824
Nov 05 19:12:52 devstack sudo[94626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:52 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d6148d-7971-469f-b1f9-544bc6bd9628]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:12:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_43wp8qjmdevstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:53 devstack sudo[94628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_43wp8qjmdevstack@QuobyteHD
Nov 05 19:12:53 devstack sudo[94628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:53 devstack sudo[94628]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_43wp8qjmdevstack@QuobyteHD" returned: 0 in 0.486s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:12:53 devstack sudo[94626]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-91623f1c-282e-4a5f-a4ba-94f8d4fd6377 tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d 1073741824" returned: 0 in 0.590s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-91623f1c-282e-4a5f-a4ba-94f8d4fd6377 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:53 devstack sudo[94638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d
Nov 05 19:12:53 devstack sudo[94638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:53 devstack sudo[94638]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-91623f1c-282e-4a5f-a4ba-94f8d4fd6377 tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d" returned: 0 in 0.296s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-91623f1c-282e-4a5f-a4ba-94f8d4fd6377 tempest-GroupSnapshotsTest-1971566374 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:12:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-91623f1c-282e-4a5f-a4ba-94f8d4fd6377 tempest-GroupSnapshotsTest-1971566374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:12:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.396s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:12:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-568682789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51e775a2-0d3d-4eb0-baab-a25e75af5b61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5e709dff314f9b9b5a3bd37f3db746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:12:50Z,use_quota=True,user_id='4888ef249100497a97c6f6315fb1c6c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:12:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Creating volume 51e775a2-0d3d-4eb0-baab-a25e75af5b61 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:12:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:12:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:12:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:12:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:12:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:12:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:12:53 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:12:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-51e775a2-0d3d-4eb0-baab-a25e75af5b61 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-91623f1c-282e-4a5f-a4ba-94f8d4fd6377 tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d1fda3d-0946-4286-a184-ba351d694eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91069d7f-4eda-4f96-9ba2-e0094150265d', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:53 devstack sudo[94641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-51e775a2-0d3d-4eb0-baab-a25e75af5b61 1073741824
Nov 05 19:12:53 devstack sudo[94641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-91623f1c-282e-4a5f-a4ba-94f8d4fd6377 tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e855aff-1646-46bf-8069-848fa83a0353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:53 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-91623f1c-282e-4a5f-a4ba-94f8d4fd6377 tempest-GroupSnapshotsTest-1971566374 None] Volume volume-91069d7f-4eda-4f96-9ba2-e0094150265d (91069d7f-4eda-4f96-9ba2-e0094150265d): created successfully
Nov 05 19:12:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-91623f1c-282e-4a5f-a4ba-94f8d4fd6377 tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e855aff-1646-46bf-8069-848fa83a0353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-91623f1c-282e-4a5f-a4ba-94f8d4fd6377 tempest-GroupSnapshotsTest-1971566374 None] Flow 'volume_create_manager' (d72489ff-f838-43ab-b087-f0b396d88dce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:12:53 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-91623f1c-282e-4a5f-a4ba-94f8d4fd6377 tempest-GroupSnapshotsTest-1971566374 None] Created volume successfully.
Nov 05 19:12:54 devstack sudo[94641]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-51e775a2-0d3d-4eb0-baab-a25e75af5b61 1073741824" returned: 0 in 0.539s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-51e775a2-0d3d-4eb0-baab-a25e75af5b61 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:54 devstack sudo[94647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-51e775a2-0d3d-4eb0-baab-a25e75af5b61
Nov 05 19:12:54 devstack sudo[94647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:54 devstack sudo[94647]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-51e775a2-0d3d-4eb0-baab-a25e75af5b61" returned: 0 in 0.324s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:12:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:12:54 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Attempting download of 300700a0-51ab-4ee2-8ef0-e0eeaa8aee29 ((None, [{'url': 'file:///opt/stack/data/glance/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'metadata': {}}])) to volume 51e775a2-0d3d-4eb0-baab-a25e75af5b61. {{(pid=87184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 19:12:54 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fc3385-ac1c-4ca4-8911-c166b7f63c6a]: (4, 'raw') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:12:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_m_zya4o5 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:54 devstack sudo[94650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_m_zya4o5
Nov 05 19:12:54 devstack sudo[94650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:55 devstack sudo[94650]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_m_zya4o5" returned: 0 in 0.367s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_m_zya4o5 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:55 devstack sudo[94654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_m_zya4o5
Nov 05 19:12:55 devstack sudo[94654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:55 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-bd1c8469-2090-4ccd-8148-2ef5971fd440 tempest-GroupSnapshotsTest-1971566374 None] Update group completed successfully.
Nov 05 19:12:55 devstack sudo[94654]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_m_zya4o5" returned: 1 in 0.433s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_m_zya4o5' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 19:12:55 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2b215c-3801-4c87-a5fc-ccd685ea3d0d]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:12:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_43wp8qjmdevstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:55 devstack sudo[94658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_43wp8qjmdevstack@QuobyteHD
Nov 05 19:12:55 devstack sudo[94658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:56 devstack sudo[94658]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_43wp8qjmdevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:56 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] 300700a0-51ab-4ee2-8ef0-e0eeaa8aee29 was qcow2, converting to qcow2 {{(pid=87184) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 19:12:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_43wp8qjmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-51e775a2-0d3d-4eb0-baab-a25e75af5b61 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:56 devstack sudo[94663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_43wp8qjmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-51e775a2-0d3d-4eb0-baab-a25e75af5b61
Nov 05 19:12:56 devstack sudo[94663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:56 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-61cacb07-c870-4b4a-9a92-678ce71c15e9 tempest-GroupSnapshotsTest-1971566374 None] Update group completed successfully.
Nov 05 19:12:57 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-8241cadf-4dbf-4174-be26-0a2a27f0db3b tempest-GroupSnapshotsTest-1971566374 None] Update group completed successfully.
Nov 05 19:12:58 devstack sudo[94663]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_43wp8qjmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-51e775a2-0d3d-4eb0-baab-a25e75af5b61" returned: 0 in 2.243s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:58 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_43wp8qjmdevstack@QuobyteHD, size 112.00 MB, duration 2.25 sec, destination /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-51e775a2-0d3d-4eb0-baab-a25e75af5b61 {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 19:12:58 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Converted 112.00 MB image at 49.89 MB/s
Nov 05 19:12:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-51e775a2-0d3d-4eb0-baab-a25e75af5b61 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:58 devstack sudo[94674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-51e775a2-0d3d-4eb0-baab-a25e75af5b61 1G
Nov 05 19:12:58 devstack sudo[94674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:58 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-76d1b34c-b07d-43a8-aca6-0d5a63e3a9f2 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:12:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-76d1b34c-b07d-43a8-aca6-0d5a63e3a9f2 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Flow 'volume_create_manager' (046bdde8-bc87-4d2e-b8ab-74b917ab7423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:12:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-76d1b34c-b07d-43a8-aca6-0d5a63e3a9f2 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea060e15-40a9-4f90-98f0-5250c30c5c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-76d1b34c-b07d-43a8-aca6-0d5a63e3a9f2 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea060e15-40a9-4f90-98f0-5250c30c5c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1877079866',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0328567f-fd6a-4d67-9b72-344380c2d12d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f81ce0b49f30440ebd3b16805b5aaedc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:12:59Z,use_quota=True,user_id='b4f815ed6dc740d0bb5ad84e11511350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-76d1b34c-b07d-43a8-aca6-0d5a63e3a9f2 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdf675e9-c008-4d8d-8d02-4705867c2fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-76d1b34c-b07d-43a8-aca6-0d5a63e3a9f2 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdf675e9-c008-4d8d-8d02-4705867c2fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-76d1b34c-b07d-43a8-aca6-0d5a63e3a9f2 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21ff07a8-df0d-4b42-8aa6-d74ab27300f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-76d1b34c-b07d-43a8-aca6-0d5a63e3a9f2 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21ff07a8-df0d-4b42-8aa6-d74ab27300f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0328567f-fd6a-4d67-9b72-344380c2d12d', 'volume_name': 'volume-0328567f-fd6a-4d67-9b72-344380c2d12d', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-76d1b34c-b07d-43a8-aca6-0d5a63e3a9f2 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f42e969-1e8a-4c66-96c8-471cfa0af11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-76d1b34c-b07d-43a8-aca6-0d5a63e3a9f2 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f42e969-1e8a-4c66-96c8-471cfa0af11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-76d1b34c-b07d-43a8-aca6-0d5a63e3a9f2 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d96a22a6-8f01-4b05-9eef-ea539432359a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:58 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-76d1b34c-b07d-43a8-aca6-0d5a63e3a9f2 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Volume 0328567f-fd6a-4d67-9b72-344380c2d12d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0328567f-fd6a-4d67-9b72-344380c2d12d', 'volume_size': 1}
Nov 05 19:12:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-76d1b34c-b07d-43a8-aca6-0d5a63e3a9f2 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:12:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-76d1b34c-b07d-43a8-aca6-0d5a63e3a9f2 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:12:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-76d1b34c-b07d-43a8-aca6-0d5a63e3a9f2 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1877079866',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0328567f-fd6a-4d67-9b72-344380c2d12d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f81ce0b49f30440ebd3b16805b5aaedc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:12:59Z,use_quota=True,user_id='b4f815ed6dc740d0bb5ad84e11511350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:12:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-76d1b34c-b07d-43a8-aca6-0d5a63e3a9f2 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Creating volume 0328567f-fd6a-4d67-9b72-344380c2d12d {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:12:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-76d1b34c-b07d-43a8-aca6-0d5a63e3a9f2 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:12:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-76d1b34c-b07d-43a8-aca6-0d5a63e3a9f2 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:12:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-76d1b34c-b07d-43a8-aca6-0d5a63e3a9f2 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:12:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-76d1b34c-b07d-43a8-aca6-0d5a63e3a9f2 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:12:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-76d1b34c-b07d-43a8-aca6-0d5a63e3a9f2 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:12:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-76d1b34c-b07d-43a8-aca6-0d5a63e3a9f2 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:12:58 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-76d1b34c-b07d-43a8-aca6-0d5a63e3a9f2 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:12:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-76d1b34c-b07d-43a8-aca6-0d5a63e3a9f2 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0328567f-fd6a-4d67-9b72-344380c2d12d 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:58 devstack sudo[94674]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-51e775a2-0d3d-4eb0-baab-a25e75af5b61 1G" returned: 0 in 0.436s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:58 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Downloaded image 300700a0-51ab-4ee2-8ef0-e0eeaa8aee29 ((None, [{'url': 'file:///opt/stack/data/glance/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'metadata': {}}])) to volume 51e775a2-0d3d-4eb0-baab-a25e75af5b61 successfully. {{(pid=87184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 19:12:58 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Temporary image 300700a0-51ab-4ee2-8ef0-e0eeaa8aee29 for user 4888ef249100497a97c6f6315fb1c6c4 is deleted. {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 19:12:58 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Marking volume 51e775a2-0d3d-4eb0-baab-a25e75af5b61 as bootable. {{(pid=87184) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 19:12:58 devstack sudo[94679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0328567f-fd6a-4d67-9b72-344380c2d12d 1073741824
Nov 05 19:12:58 devstack sudo[94679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:58 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Copying metadata from image 300700a0-51ab-4ee2-8ef0-e0eeaa8aee29 to 51e775a2-0d3d-4eb0-baab-a25e75af5b61. {{(pid=87184) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 19:12:58 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Creating volume glance metadata for volume 51e775a2-0d3d-4eb0-baab-a25e75af5b61 backed by image 300700a0-51ab-4ee2-8ef0-e0eeaa8aee29 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87184) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 19:12:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3af4a7cd-fc24-486d-b6a8-72dc8ef6a906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51e775a2-0d3d-4eb0-baab-a25e75af5b61', 'volume_size': 1, 'image_id': '300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3e813114ebb84b35a5c6eb1b802f157f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'created_at': datetime.datetime(2026, 11, 5, 18, 1, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 18, 1, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x736631cf61b0>}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41bbc571-cab5-4619-99f8-53e4ab714052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:58 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Volume volume-51e775a2-0d3d-4eb0-baab-a25e75af5b61 (51e775a2-0d3d-4eb0-baab-a25e75af5b61): created successfully
Nov 05 19:12:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41bbc571-cab5-4619-99f8-53e4ab714052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Flow 'volume_create_manager' (4e982a6a-d79c-4f39-8ef7-112981ab9bc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:12:58 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-3012ce49-991c-4bd5-9640-a88791c31869 tempest-VolumesExtendTest-1935484449 None] Created volume successfully.
Nov 05 19:12:59 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-05a868d1-0d99-4496-b8a3-9a750931c926 tempest-GroupSnapshotsTest-1971566374 None] Update group completed successfully.
Nov 05 19:12:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-566bae3b-b004-4dbe-a3d6-a331aa83462a tempest-VolumesExtendTest-1935484449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:12:59 devstack sudo[94679]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-76d1b34c-b07d-43a8-aca6-0d5a63e3a9f2 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0328567f-fd6a-4d67-9b72-344380c2d12d 1073741824" returned: 0 in 0.578s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-76d1b34c-b07d-43a8-aca6-0d5a63e3a9f2 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0328567f-fd6a-4d67-9b72-344380c2d12d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:59 devstack sudo[94685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0328567f-fd6a-4d67-9b72-344380c2d12d
Nov 05 19:12:59 devstack sudo[94685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:12:59 devstack sudo[94685]: pam_unix(sudo:session): session closed for user root
Nov 05 19:12:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-76d1b34c-b07d-43a8-aca6-0d5a63e3a9f2 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0328567f-fd6a-4d67-9b72-344380c2d12d" returned: 0 in 0.260s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:12:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-76d1b34c-b07d-43a8-aca6-0d5a63e3a9f2 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:12:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-76d1b34c-b07d-43a8-aca6-0d5a63e3a9f2 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:12:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-566bae3b-b004-4dbe-a3d6-a331aa83462a tempest-VolumesExtendTest-1935484449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.322s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:12:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-76d1b34c-b07d-43a8-aca6-0d5a63e3a9f2 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d96a22a6-8f01-4b05-9eef-ea539432359a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0328567f-fd6a-4d67-9b72-344380c2d12d', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-76d1b34c-b07d-43a8-aca6-0d5a63e3a9f2 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b4d51e5-ac61-416a-ae35-e62ac17c64a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:12:59 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45a266c-c42e-4658-b33f-f4fdc7d39505]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:12:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-566bae3b-b004-4dbe-a3d6-a331aa83462a tempest-VolumesExtendTest-1935484449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-51e775a2-0d3d-4eb0-baab-a25e75af5b61 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:12:59 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-76d1b34c-b07d-43a8-aca6-0d5a63e3a9f2 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Volume volume-0328567f-fd6a-4d67-9b72-344380c2d12d (0328567f-fd6a-4d67-9b72-344380c2d12d): created successfully
Nov 05 19:12:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-76d1b34c-b07d-43a8-aca6-0d5a63e3a9f2 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b4d51e5-ac61-416a-ae35-e62ac17c64a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:12:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-76d1b34c-b07d-43a8-aca6-0d5a63e3a9f2 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Flow 'volume_create_manager' (046bdde8-bc87-4d2e-b8ab-74b917ab7423) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:12:59 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-76d1b34c-b07d-43a8-aca6-0d5a63e3a9f2 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Created volume successfully.
Nov 05 19:12:59 devstack sudo[94688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-51e775a2-0d3d-4eb0-baab-a25e75af5b61
Nov 05 19:12:59 devstack sudo[94688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:00 devstack sudo[94688]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-566bae3b-b004-4dbe-a3d6-a331aa83462a tempest-VolumesExtendTest-1935484449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-51e775a2-0d3d-4eb0-baab-a25e75af5b61" returned: 0 in 0.403s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-566bae3b-b004-4dbe-a3d6-a331aa83462a tempest-VolumesExtendTest-1935484449 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-51e775a2-0d3d-4eb0-baab-a25e75af5b61 2G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-566bae3b-b004-4dbe-a3d6-a331aa83462a tempest-VolumesExtendTest-1935484449 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-51e775a2-0d3d-4eb0-baab-a25e75af5b61 2G" returned: 0 in 0.103s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-566bae3b-b004-4dbe-a3d6-a331aa83462a tempest-VolumesExtendTest-1935484449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.554s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:13:00 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-566bae3b-b004-4dbe-a3d6-a331aa83462a tempest-VolumesExtendTest-1935484449 None] Extend volume completed successfully.
Nov 05 19:13:00 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-d4ac5639-b163-4f4b-9288-b22fd44afaf0 tempest-GroupSnapshotsTest-1971566374 None] GroupSnapshot aaebded7-add8-453b-9a12-2303b8b625bf: creating.
Nov 05 19:13:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d4ac5639-b163-4f4b-9288-b22fd44afaf0 tempest-GroupSnapshotsTest-1971566374 None] Group snapshot aaebded7-add8-453b-9a12-2303b8b625bf: creating. {{(pid=87184) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 05 19:13:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d4ac5639-b163-4f4b-9288-b22fd44afaf0 tempest-GroupSnapshotsTest-1971566374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:13:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d4ac5639-b163-4f4b-9288-b22fd44afaf0 tempest-GroupSnapshotsTest-1971566374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:13:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-d4ac5639-b163-4f4b-9288-b22fd44afaf0 tempest-GroupSnapshotsTest-1971566374 None] Creating offline snapshot 04826e62-a453-4465-8dbc-d874ba4da412 of volume 91069d7f-4eda-4f96-9ba2-e0094150265d {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:13:00 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f1e732-1550-4168-807b-a03b6a1d599e]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:13:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d4ac5639-b163-4f4b-9288-b22fd44afaf0 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bbb52c07-ce3b-4633-947a-0c0e2c8c36a5 tempest-VolumesExtendTest-1935484449 None] Acquiring lock "cinder-51e775a2-0d3d-4eb0-baab-a25e75af5b61-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:13:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bbb52c07-ce3b-4633-947a-0c0e2c8c36a5 tempest-VolumesExtendTest-1935484449 None] Lock "cinder-51e775a2-0d3d-4eb0-baab-a25e75af5b61-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:13:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bbb52c07-ce3b-4633-947a-0c0e2c8c36a5 tempest-VolumesExtendTest-1935484449 None] Acquiring lock "cinder-quobyte-51e775a2-0d3d-4eb0-baab-a25e75af5b61" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:13:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bbb52c07-ce3b-4633-947a-0c0e2c8c36a5 tempest-VolumesExtendTest-1935484449 None] Lock "cinder-quobyte-51e775a2-0d3d-4eb0-baab-a25e75af5b61" acquired by "delete_volume" :: waited 0.015s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:13:00 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[507e3dfc-7eed-4aeb-83c6-40849a016020]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:13:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bbb52c07-ce3b-4633-947a-0c0e2c8c36a5 tempest-VolumesExtendTest-1935484449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-51e775a2-0d3d-4eb0-baab-a25e75af5b61 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:00 devstack sudo[94710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d
Nov 05 19:13:00 devstack sudo[94710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:00 devstack sudo[94711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-51e775a2-0d3d-4eb0-baab-a25e75af5b61
Nov 05 19:13:00 devstack sudo[94711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:01 devstack sudo[94710]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d4ac5639-b163-4f4b-9288-b22fd44afaf0 tempest-GroupSnapshotsTest-1971566374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d" returned: 0 in 0.430s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d4ac5639-b163-4f4b-9288-b22fd44afaf0 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d.04826e62-a453-4465-8dbc-d874ba4da412 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:01 devstack sudo[94718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d.04826e62-a453-4465-8dbc-d874ba4da412 1G
Nov 05 19:13:01 devstack sudo[94718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:01 devstack sudo[94711]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bbb52c07-ce3b-4633-947a-0c0e2c8c36a5 tempest-VolumesExtendTest-1935484449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-51e775a2-0d3d-4eb0-baab-a25e75af5b61" returned: 0 in 0.438s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bbb52c07-ce3b-4633-947a-0c0e2c8c36a5 tempest-VolumesExtendTest-1935484449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-51e775a2-0d3d-4eb0-baab-a25e75af5b61 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:01 devstack sudo[94723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-51e775a2-0d3d-4eb0-baab-a25e75af5b61
Nov 05 19:13:01 devstack sudo[94723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:01 devstack sudo[94723]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bbb52c07-ce3b-4633-947a-0c0e2c8c36a5 tempest-VolumesExtendTest-1935484449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-51e775a2-0d3d-4eb0-baab-a25e75af5b61" returned: 0 in 0.305s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bbb52c07-ce3b-4633-947a-0c0e2c8c36a5 tempest-VolumesExtendTest-1935484449 None] Lock "cinder-quobyte-51e775a2-0d3d-4eb0-baab-a25e75af5b61" released by "delete_volume" :: held 0.805s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:13:01 devstack sudo[94718]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d4ac5639-b163-4f4b-9288-b22fd44afaf0 tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d.04826e62-a453-4465-8dbc-d874ba4da412 1G" returned: 0 in 0.498s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d4ac5639-b163-4f4b-9288-b22fd44afaf0 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91069d7f-4eda-4f96-9ba2-e0094150265d -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d.04826e62-a453-4465-8dbc-d874ba4da412 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:01 devstack sudo[94731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91069d7f-4eda-4f96-9ba2-e0094150265d -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d.04826e62-a453-4465-8dbc-d874ba4da412
Nov 05 19:13:01 devstack sudo[94731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:01 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-bbb52c07-ce3b-4633-947a-0c0e2c8c36a5 tempest-VolumesExtendTest-1935484449 None] Created reservations ['b603d7a6-7668-44cd-8b68-72746595b9cb', 'ddcb8d2b-e13f-45fe-9e2b-d0275400e3bf', 'c5b01a05-f9f6-49cb-b16b-06e1877284d8', '33964ee5-0268-4d9f-8116-4176dca78b5c'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:13:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bbb52c07-ce3b-4633-947a-0c0e2c8c36a5 tempest-VolumesExtendTest-1935484449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:13:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bbb52c07-ce3b-4633-947a-0c0e2c8c36a5 tempest-VolumesExtendTest-1935484449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:13:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bbb52c07-ce3b-4633-947a-0c0e2c8c36a5 tempest-VolumesExtendTest-1935484449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:13:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bbb52c07-ce3b-4633-947a-0c0e2c8c36a5 tempest-VolumesExtendTest-1935484449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:13:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bbb52c07-ce3b-4633-947a-0c0e2c8c36a5 tempest-VolumesExtendTest-1935484449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:13:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bbb52c07-ce3b-4633-947a-0c0e2c8c36a5 tempest-VolumesExtendTest-1935484449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:01 devstack sudo[94733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:13:01 devstack sudo[94733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f6c8355f-c7a7-405d-b875-611c72bf8920 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Acquiring lock "cinder-0328567f-fd6a-4d67-9b72-344380c2d12d-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:13:02 devstack sudo[94731]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d4ac5639-b163-4f4b-9288-b22fd44afaf0 tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91069d7f-4eda-4f96-9ba2-e0094150265d -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d.04826e62-a453-4465-8dbc-d874ba4da412" returned: 0 in 0.376s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:02 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-d4ac5639-b163-4f4b-9288-b22fd44afaf0 tempest-GroupSnapshotsTest-1971566374 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d.04826e62-a453-4465-8dbc-d874ba4da412 is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 19:13:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d4ac5639-b163-4f4b-9288-b22fd44afaf0 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d.04826e62-a453-4465-8dbc-d874ba4da412 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f6c8355f-c7a7-405d-b875-611c72bf8920 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Lock "cinder-0328567f-fd6a-4d67-9b72-344380c2d12d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:13:02 devstack sudo[94738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d.04826e62-a453-4465-8dbc-d874ba4da412
Nov 05 19:13:02 devstack sudo[94738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f6c8355f-c7a7-405d-b875-611c72bf8920 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Acquiring lock "cinder-quobyte-0328567f-fd6a-4d67-9b72-344380c2d12d" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:13:02 devstack sudo[94733]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bbb52c07-ce3b-4633-947a-0c0e2c8c36a5 tempest-VolumesExtendTest-1935484449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.345s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:02 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-bbb52c07-ce3b-4633-947a-0c0e2c8c36a5 tempest-VolumesExtendTest-1935484449 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:13:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f6c8355f-c7a7-405d-b875-611c72bf8920 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Lock "cinder-quobyte-0328567f-fd6a-4d67-9b72-344380c2d12d" acquired by "delete_volume" :: waited 0.040s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:13:02 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-bbb52c07-ce3b-4633-947a-0c0e2c8c36a5 tempest-VolumesExtendTest-1935484449 None] Deleted volume successfully.
Nov 05 19:13:02 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b243f55-758e-4c9d-b89c-6058445a5742]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:13:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f6c8355f-c7a7-405d-b875-611c72bf8920 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0328567f-fd6a-4d67-9b72-344380c2d12d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bbb52c07-ce3b-4633-947a-0c0e2c8c36a5 tempest-VolumesExtendTest-1935484449 None] Lock "cinder-51e775a2-0d3d-4eb0-baab-a25e75af5b61-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:13:02 devstack sudo[94741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0328567f-fd6a-4d67-9b72-344380c2d12d
Nov 05 19:13:02 devstack sudo[94741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:02 devstack sudo[94738]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d4ac5639-b163-4f4b-9288-b22fd44afaf0 tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d.04826e62-a453-4465-8dbc-d874ba4da412" returned: 0 in 0.343s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d4ac5639-b163-4f4b-9288-b22fd44afaf0 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:02 devstack sudo[94744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d.info
Nov 05 19:13:02 devstack sudo[94744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:02 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-f13712f7-87c8-46e0-896f-2d5ac07154f9 tempest-VolumesExtendTest-1935484449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:13:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f13712f7-87c8-46e0-896f-2d5ac07154f9 tempest-VolumesExtendTest-1935484449 None] Flow 'volume_create_manager' (e6cca97a-618d-4562-b5ff-919c52e1f605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:13:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f13712f7-87c8-46e0-896f-2d5ac07154f9 tempest-VolumesExtendTest-1935484449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f32ccdca-22d8-47e1-a18b-2a887cf6b42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f13712f7-87c8-46e0-896f-2d5ac07154f9 tempest-VolumesExtendTest-1935484449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f32ccdca-22d8-47e1-a18b-2a887cf6b42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1002450800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0054a46e-c52c-48df-bc47-256da1819c81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5e709dff314f9b9b5a3bd37f3db746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:13:02Z,use_quota=True,user_id='4888ef249100497a97c6f6315fb1c6c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f13712f7-87c8-46e0-896f-2d5ac07154f9 tempest-VolumesExtendTest-1935484449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87244906-ffda-4f9f-8387-8c9bda71abcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f13712f7-87c8-46e0-896f-2d5ac07154f9 tempest-VolumesExtendTest-1935484449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87244906-ffda-4f9f-8387-8c9bda71abcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f13712f7-87c8-46e0-896f-2d5ac07154f9 tempest-VolumesExtendTest-1935484449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f107c1f-b51e-4d1a-bf26-dcd52c55454b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f13712f7-87c8-46e0-896f-2d5ac07154f9 tempest-VolumesExtendTest-1935484449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f107c1f-b51e-4d1a-bf26-dcd52c55454b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0054a46e-c52c-48df-bc47-256da1819c81', 'volume_name': 'volume-0054a46e-c52c-48df-bc47-256da1819c81', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f13712f7-87c8-46e0-896f-2d5ac07154f9 tempest-VolumesExtendTest-1935484449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9ae4bff-8315-4a6d-967f-ae140a25d022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f13712f7-87c8-46e0-896f-2d5ac07154f9 tempest-VolumesExtendTest-1935484449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9ae4bff-8315-4a6d-967f-ae140a25d022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f13712f7-87c8-46e0-896f-2d5ac07154f9 tempest-VolumesExtendTest-1935484449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2548b108-c8ad-478d-8582-add8d85bbb37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:02 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-f13712f7-87c8-46e0-896f-2d5ac07154f9 tempest-VolumesExtendTest-1935484449 None] Volume 0054a46e-c52c-48df-bc47-256da1819c81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0054a46e-c52c-48df-bc47-256da1819c81', 'volume_size': 1}
Nov 05 19:13:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f13712f7-87c8-46e0-896f-2d5ac07154f9 tempest-VolumesExtendTest-1935484449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:13:02 devstack sudo[94741]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f6c8355f-c7a7-405d-b875-611c72bf8920 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0328567f-fd6a-4d67-9b72-344380c2d12d" returned: 0 in 0.418s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f6c8355f-c7a7-405d-b875-611c72bf8920 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0328567f-fd6a-4d67-9b72-344380c2d12d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:02 devstack sudo[94749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0328567f-fd6a-4d67-9b72-344380c2d12d
Nov 05 19:13:02 devstack sudo[94749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:02 devstack sudo[94744]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d4ac5639-b163-4f4b-9288-b22fd44afaf0 tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d.info" returned: 0 in 0.291s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:02 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-d4ac5639-b163-4f4b-9288-b22fd44afaf0 tempest-GroupSnapshotsTest-1971566374 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 19:13:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d4ac5639-b163-4f4b-9288-b22fd44afaf0 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:02 devstack sudo[94752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d.info
Nov 05 19:13:02 devstack sudo[94752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:02 devstack sudo[94749]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f6c8355f-c7a7-405d-b875-611c72bf8920 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0328567f-fd6a-4d67-9b72-344380c2d12d" returned: 0 in 0.251s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f6c8355f-c7a7-405d-b875-611c72bf8920 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Lock "cinder-quobyte-0328567f-fd6a-4d67-9b72-344380c2d12d" released by "delete_volume" :: held 0.729s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:13:02 devstack sudo[94752]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d4ac5639-b163-4f4b-9288-b22fd44afaf0 tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d.info" returned: 0 in 0.253s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d4ac5639-b163-4f4b-9288-b22fd44afaf0 tempest-GroupSnapshotsTest-1971566374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.285s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:13:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d4ac5639-b163-4f4b-9288-b22fd44afaf0 tempest-GroupSnapshotsTest-1971566374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:13:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d4ac5639-b163-4f4b-9288-b22fd44afaf0 tempest-GroupSnapshotsTest-1971566374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:13:02 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-d4ac5639-b163-4f4b-9288-b22fd44afaf0 tempest-GroupSnapshotsTest-1971566374 None] Creating offline snapshot 0ebcc3ac-896a-4b4d-9e88-c1de6ebd706c of volume a938c9f6-de91-45f1-99d0-68d0a4bf66f8 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:13:03 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-f6c8355f-c7a7-405d-b875-611c72bf8920 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Created reservations ['670ce1d4-0314-47f5-b035-9f4622469539', 'cb460c8c-0311-4c39-914f-f0ea923c169b', 'a0c3e086-4d5e-4e9f-b04d-d5d2cb674b75', '948398eb-aa0e-4fcd-87fb-ae658bd8b49d'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:13:03 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b90bf1-9196-476a-b917-da8888bfc040]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:13:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d4ac5639-b163-4f4b-9288-b22fd44afaf0 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f6c8355f-c7a7-405d-b875-611c72bf8920 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:13:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f6c8355f-c7a7-405d-b875-611c72bf8920 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:13:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f6c8355f-c7a7-405d-b875-611c72bf8920 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:13:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f6c8355f-c7a7-405d-b875-611c72bf8920 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:13:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f6c8355f-c7a7-405d-b875-611c72bf8920 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:13:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f6c8355f-c7a7-405d-b875-611c72bf8920 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:03 devstack sudo[94757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:13:03 devstack sudo[94757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:03 devstack sudo[94756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8
Nov 05 19:13:03 devstack sudo[94756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:03 devstack sudo[94757]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f6c8355f-c7a7-405d-b875-611c72bf8920 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.267s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:03 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-f6c8355f-c7a7-405d-b875-611c72bf8920 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:13:03 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f6c8355f-c7a7-405d-b875-611c72bf8920 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Deleted volume successfully.
Nov 05 19:13:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f6c8355f-c7a7-405d-b875-611c72bf8920 tempest-VolumeQuotasNegativeTestJSON-1554057054 None] Lock "cinder-0328567f-fd6a-4d67-9b72-344380c2d12d-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:13:03 devstack sudo[94756]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d4ac5639-b163-4f4b-9288-b22fd44afaf0 tempest-GroupSnapshotsTest-1971566374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8" returned: 0 in 0.424s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d4ac5639-b163-4f4b-9288-b22fd44afaf0 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8.0ebcc3ac-896a-4b4d-9e88-c1de6ebd706c 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:03 devstack sudo[94764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8.0ebcc3ac-896a-4b4d-9e88-c1de6ebd706c 1G
Nov 05 19:13:03 devstack sudo[94764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:03 devstack sudo[94764]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d4ac5639-b163-4f4b-9288-b22fd44afaf0 tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8.0ebcc3ac-896a-4b4d-9e88-c1de6ebd706c 1G" returned: 0 in 0.425s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d4ac5639-b163-4f4b-9288-b22fd44afaf0 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8.0ebcc3ac-896a-4b4d-9e88-c1de6ebd706c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:03 devstack sudo[94770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8.0ebcc3ac-896a-4b4d-9e88-c1de6ebd706c
Nov 05 19:13:03 devstack sudo[94770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:04 devstack sudo[94770]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d4ac5639-b163-4f4b-9288-b22fd44afaf0 tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8.0ebcc3ac-896a-4b4d-9e88-c1de6ebd706c" returned: 0 in 0.296s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:04 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-d4ac5639-b163-4f4b-9288-b22fd44afaf0 tempest-GroupSnapshotsTest-1971566374 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8.0ebcc3ac-896a-4b4d-9e88-c1de6ebd706c is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 19:13:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d4ac5639-b163-4f4b-9288-b22fd44afaf0 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8.0ebcc3ac-896a-4b4d-9e88-c1de6ebd706c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:04 devstack sudo[94775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8.0ebcc3ac-896a-4b4d-9e88-c1de6ebd706c
Nov 05 19:13:04 devstack sudo[94775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:04 devstack sudo[94775]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d4ac5639-b163-4f4b-9288-b22fd44afaf0 tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8.0ebcc3ac-896a-4b4d-9e88-c1de6ebd706c" returned: 0 in 0.251s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d4ac5639-b163-4f4b-9288-b22fd44afaf0 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:04 devstack sudo[94778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8.info
Nov 05 19:13:04 devstack sudo[94778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:04 devstack sudo[94778]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d4ac5639-b163-4f4b-9288-b22fd44afaf0 tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8.info" returned: 0 in 0.300s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:04 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-d4ac5639-b163-4f4b-9288-b22fd44afaf0 tempest-GroupSnapshotsTest-1971566374 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 19:13:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d4ac5639-b163-4f4b-9288-b22fd44afaf0 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:04 devstack sudo[94781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8.info
Nov 05 19:13:04 devstack sudo[94781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:04 devstack sudo[94781]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d4ac5639-b163-4f4b-9288-b22fd44afaf0 tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8.info" returned: 0 in 0.254s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d4ac5639-b163-4f4b-9288-b22fd44afaf0 tempest-GroupSnapshotsTest-1971566374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.032s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:13:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f13712f7-87c8-46e0-896f-2d5ac07154f9 tempest-VolumesExtendTest-1935484449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.417s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:13:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f13712f7-87c8-46e0-896f-2d5ac07154f9 tempest-VolumesExtendTest-1935484449 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1002450800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0054a46e-c52c-48df-bc47-256da1819c81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5e709dff314f9b9b5a3bd37f3db746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:13:02Z,use_quota=True,user_id='4888ef249100497a97c6f6315fb1c6c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:13:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-f13712f7-87c8-46e0-896f-2d5ac07154f9 tempest-VolumesExtendTest-1935484449 None] Creating volume 0054a46e-c52c-48df-bc47-256da1819c81 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:13:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f13712f7-87c8-46e0-896f-2d5ac07154f9 tempest-VolumesExtendTest-1935484449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:13:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f13712f7-87c8-46e0-896f-2d5ac07154f9 tempest-VolumesExtendTest-1935484449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:13:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f13712f7-87c8-46e0-896f-2d5ac07154f9 tempest-VolumesExtendTest-1935484449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:13:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f13712f7-87c8-46e0-896f-2d5ac07154f9 tempest-VolumesExtendTest-1935484449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:13:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f13712f7-87c8-46e0-896f-2d5ac07154f9 tempest-VolumesExtendTest-1935484449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:13:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f13712f7-87c8-46e0-896f-2d5ac07154f9 tempest-VolumesExtendTest-1935484449 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:13:05 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-f13712f7-87c8-46e0-896f-2d5ac07154f9 tempest-VolumesExtendTest-1935484449 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:13:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f13712f7-87c8-46e0-896f-2d5ac07154f9 tempest-VolumesExtendTest-1935484449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:05 devstack sudo[94784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81 1073741824
Nov 05 19:13:05 devstack sudo[94784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:05 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-d4ac5639-b163-4f4b-9288-b22fd44afaf0 tempest-GroupSnapshotsTest-1971566374 None] group_snapshot aaebded7-add8-453b-9a12-2303b8b625bf: created successfully
Nov 05 19:13:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:13:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:13:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:13:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:13:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:13:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:13:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:05 devstack sudo[94789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:13:05 devstack sudo[94789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:05 devstack sudo[94784]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f13712f7-87c8-46e0-896f-2d5ac07154f9 tempest-VolumesExtendTest-1935484449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81 1073741824" returned: 0 in 0.558s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:05 devstack sudo[94789]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f13712f7-87c8-46e0-896f-2d5ac07154f9 tempest-VolumesExtendTest-1935484449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.327s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:05 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:13:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:13:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread count: 28 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 19:13:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread info: [<_MainThread(MainThread, started 126882883072128)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126882770872512)>, <Thread(Thread-3 (stat_writer), started daemon 126882769837376)>, <Thread(Rabbit-heartbeat, started daemon 126882768896256)>, <Thread(Thread-5 (_runner), started daemon 126882768980928)>, <Thread(Thread-7 (_runner), started daemon 126882767016448)>, <Thread(fd_logger, started daemon 126882764561216)>, <Thread(privsep_reader, started daemon 126882764568576)>, <Thread(tpool_thread_0, started daemon 126882759292608)>, <Thread(tpool_thread_1, started daemon 126882750899904)>, <Thread(tpool_thread_2, started daemon 126882742507200)>, <Thread(tpool_thread_3, started daemon 126882734114496)>, <Thread(tpool_thread_4, started daemon 126882725721792)>, <Thread(tpool_thread_5, started daemon 126882717329088)>, <Thread(tpool_thread_6, started daemon 126882708920000)>, <Thread(tpool_thread_7, started daemon 126882700510912)>, <Thread(tpool_thread_8, started daemon 126882692101824)>, <Thread(tpool_thread_9, started daemon 126882683692736)>, <Thread(tpool_thread_10, started daemon 126882675283648)>, <Thread(tpool_thread_11, started daemon 126882666874560)>, <Thread(tpool_thread_12, started daemon 126882658465472)>, <Thread(tpool_thread_13, started daemon 126882650056384)>, <Thread(tpool_thread_14, started daemon 126882641647296)>, <Thread(tpool_thread_15, started daemon 126882633238208)>, <Thread(tpool_thread_16, started daemon 126882624829120)>, <Thread(tpool_thread_17, started daemon 126882616420032)>, <Thread(tpool_thread_18, started daemon 126882608010944)>, <Thread(tpool_thread_19, started daemon 126882599601856)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 19:13:05 devstack sudo[94792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81
Nov 05 19:13:05 devstack sudo[94792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:05 devstack sudo[94792]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f13712f7-87c8-46e0-896f-2d5ac07154f9 tempest-VolumesExtendTest-1935484449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81" returned: 0 in 0.259s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f13712f7-87c8-46e0-896f-2d5ac07154f9 tempest-VolumesExtendTest-1935484449 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:13:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f13712f7-87c8-46e0-896f-2d5ac07154f9 tempest-VolumesExtendTest-1935484449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:13:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f13712f7-87c8-46e0-896f-2d5ac07154f9 tempest-VolumesExtendTest-1935484449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2548b108-c8ad-478d-8582-add8d85bbb37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0054a46e-c52c-48df-bc47-256da1819c81', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f13712f7-87c8-46e0-896f-2d5ac07154f9 tempest-VolumesExtendTest-1935484449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc9c729a-7232-43d2-b5ae-c03edec9dfd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:05 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-f13712f7-87c8-46e0-896f-2d5ac07154f9 tempest-VolumesExtendTest-1935484449 None] Volume volume-0054a46e-c52c-48df-bc47-256da1819c81 (0054a46e-c52c-48df-bc47-256da1819c81): created successfully
Nov 05 19:13:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f13712f7-87c8-46e0-896f-2d5ac07154f9 tempest-VolumesExtendTest-1935484449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc9c729a-7232-43d2-b5ae-c03edec9dfd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f13712f7-87c8-46e0-896f-2d5ac07154f9 tempest-VolumesExtendTest-1935484449 None] Flow 'volume_create_manager' (e6cca97a-618d-4562-b5ff-919c52e1f605) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:13:05 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f13712f7-87c8-46e0-896f-2d5ac07154f9 tempest-VolumesExtendTest-1935484449 None] Created volume successfully.
Nov 05 19:13:06 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-c4acb18e-352c-4575-8ea0-83b6c9542a08 tempest-GroupSnapshotsTest-1971566374 None] group_snapshot aaebded7-add8-453b-9a12-2303b8b625bf: deleting
Nov 05 19:13:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c4acb18e-352c-4575-8ea0-83b6c9542a08 tempest-GroupSnapshotsTest-1971566374 None] group_snapshot aaebded7-add8-453b-9a12-2303b8b625bf: deleting {{(pid=87184) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 05 19:13:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c4acb18e-352c-4575-8ea0-83b6c9542a08 tempest-GroupSnapshotsTest-1971566374 None] Acquiring lock "cinder-quobyte-91069d7f-4eda-4f96-9ba2-e0094150265d" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:13:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c4acb18e-352c-4575-8ea0-83b6c9542a08 tempest-GroupSnapshotsTest-1971566374 None] Lock "cinder-quobyte-91069d7f-4eda-4f96-9ba2-e0094150265d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:13:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c4acb18e-352c-4575-8ea0-83b6c9542a08 tempest-GroupSnapshotsTest-1971566374 None] Acquiring lock "cinder-quobyte-04826e62-a453-4465-8dbc-d874ba4da412" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:13:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c4acb18e-352c-4575-8ea0-83b6c9542a08 tempest-GroupSnapshotsTest-1971566374 None] Lock "cinder-quobyte-04826e62-a453-4465-8dbc-d874ba4da412" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:13:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-c4acb18e-352c-4575-8ea0-83b6c9542a08 tempest-GroupSnapshotsTest-1971566374 None] Deleting offline snapshot 04826e62-a453-4465-8dbc-d874ba4da412 of volume 91069d7f-4eda-4f96-9ba2-e0094150265d {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:13:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-c4acb18e-352c-4575-8ea0-83b6c9542a08 tempest-GroupSnapshotsTest-1971566374 None] snapshot_file for this snap is: volume-91069d7f-4eda-4f96-9ba2-e0094150265d.04826e62-a453-4465-8dbc-d874ba4da412 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:13:06 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[947713ff-437b-4457-bbcb-d27413176b9a]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:13:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c4acb18e-352c-4575-8ea0-83b6c9542a08 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d.04826e62-a453-4465-8dbc-d874ba4da412 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:06 devstack sudo[94795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d.04826e62-a453-4465-8dbc-d874ba4da412
Nov 05 19:13:06 devstack sudo[94795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:06 devstack sudo[94795]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c4acb18e-352c-4575-8ea0-83b6c9542a08 tempest-GroupSnapshotsTest-1971566374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d.04826e62-a453-4465-8dbc-d874ba4da412" returned: 0 in 0.413s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-c4acb18e-352c-4575-8ea0-83b6c9542a08 tempest-GroupSnapshotsTest-1971566374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91069d7f-4eda-4f96-9ba2-e0094150265d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:13:06 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b0826b-4a1c-420f-bba1-ce0f9fe750ad]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:13:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c4acb18e-352c-4575-8ea0-83b6c9542a08 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:06 devstack sudo[94801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d
Nov 05 19:13:06 devstack sudo[94801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b80eaa3f-9c32-4490-86b5-0f84814bd0b4 tempest-VolumesExtendTest-1935484449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:13:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b80eaa3f-9c32-4490-86b5-0f84814bd0b4 tempest-VolumesExtendTest-1935484449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:13:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-b80eaa3f-9c32-4490-86b5-0f84814bd0b4 tempest-VolumesExtendTest-1935484449 None] Creating offline snapshot 56068403-9dfc-49ca-8a2f-ca46c7bf93d7 of volume 0054a46e-c52c-48df-bc47-256da1819c81 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:13:07 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef4d328-e999-4ed3-95f9-78bfef7f2246]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:13:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b80eaa3f-9c32-4490-86b5-0f84814bd0b4 tempest-VolumesExtendTest-1935484449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:07 devstack sudo[94803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81
Nov 05 19:13:07 devstack sudo[94803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:07 devstack sudo[94801]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c4acb18e-352c-4575-8ea0-83b6c9542a08 tempest-GroupSnapshotsTest-1971566374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d" returned: 0 in 0.495s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c4acb18e-352c-4575-8ea0-83b6c9542a08 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d.04826e62-a453-4465-8dbc-d874ba4da412 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:07 devstack sudo[94808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d.04826e62-a453-4465-8dbc-d874ba4da412
Nov 05 19:13:07 devstack sudo[94808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:07 devstack sudo[94803]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b80eaa3f-9c32-4490-86b5-0f84814bd0b4 tempest-VolumesExtendTest-1935484449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81" returned: 0 in 0.481s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b80eaa3f-9c32-4490-86b5-0f84814bd0b4 tempest-VolumesExtendTest-1935484449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81.56068403-9dfc-49ca-8a2f-ca46c7bf93d7 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:07 devstack sudo[94814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81.56068403-9dfc-49ca-8a2f-ca46c7bf93d7 1G
Nov 05 19:13:07 devstack sudo[94814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:07 devstack sudo[94808]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c4acb18e-352c-4575-8ea0-83b6c9542a08 tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d.04826e62-a453-4465-8dbc-d874ba4da412" returned: 0 in 0.464s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c4acb18e-352c-4575-8ea0-83b6c9542a08 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d.04826e62-a453-4465-8dbc-d874ba4da412 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:07 devstack sudo[94818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d.04826e62-a453-4465-8dbc-d874ba4da412
Nov 05 19:13:07 devstack sudo[94818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:08 devstack sudo[94818]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:08 devstack sudo[94814]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b80eaa3f-9c32-4490-86b5-0f84814bd0b4 tempest-VolumesExtendTest-1935484449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81.56068403-9dfc-49ca-8a2f-ca46c7bf93d7 1G" returned: 0 in 0.537s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c4acb18e-352c-4575-8ea0-83b6c9542a08 tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d.04826e62-a453-4465-8dbc-d874ba4da412" returned: 0 in 0.317s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b80eaa3f-9c32-4490-86b5-0f84814bd0b4 tempest-VolumesExtendTest-1935484449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0054a46e-c52c-48df-bc47-256da1819c81 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81.56068403-9dfc-49ca-8a2f-ca46c7bf93d7 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:08 devstack sudo[94825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0054a46e-c52c-48df-bc47-256da1819c81 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81.56068403-9dfc-49ca-8a2f-ca46c7bf93d7
Nov 05 19:13:08 devstack sudo[94825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c4acb18e-352c-4575-8ea0-83b6c9542a08 tempest-GroupSnapshotsTest-1971566374 None] Lock "cinder-quobyte-04826e62-a453-4465-8dbc-d874ba4da412" released by "_delete_snapshot" :: held 1.838s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:13:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c4acb18e-352c-4575-8ea0-83b6c9542a08 tempest-GroupSnapshotsTest-1971566374 None] Lock "cinder-quobyte-91069d7f-4eda-4f96-9ba2-e0094150265d" released by "delete_snapshot" :: held 1.864s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:13:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c4acb18e-352c-4575-8ea0-83b6c9542a08 tempest-GroupSnapshotsTest-1971566374 None] Acquiring lock "cinder-quobyte-a938c9f6-de91-45f1-99d0-68d0a4bf66f8" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:13:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c4acb18e-352c-4575-8ea0-83b6c9542a08 tempest-GroupSnapshotsTest-1971566374 None] Lock "cinder-quobyte-a938c9f6-de91-45f1-99d0-68d0a4bf66f8" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:13:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c4acb18e-352c-4575-8ea0-83b6c9542a08 tempest-GroupSnapshotsTest-1971566374 None] Acquiring lock "cinder-quobyte-0ebcc3ac-896a-4b4d-9e88-c1de6ebd706c" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:13:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c4acb18e-352c-4575-8ea0-83b6c9542a08 tempest-GroupSnapshotsTest-1971566374 None] Lock "cinder-quobyte-0ebcc3ac-896a-4b4d-9e88-c1de6ebd706c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:13:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-c4acb18e-352c-4575-8ea0-83b6c9542a08 tempest-GroupSnapshotsTest-1971566374 None] Deleting offline snapshot 0ebcc3ac-896a-4b4d-9e88-c1de6ebd706c of volume a938c9f6-de91-45f1-99d0-68d0a4bf66f8 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:13:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-c4acb18e-352c-4575-8ea0-83b6c9542a08 tempest-GroupSnapshotsTest-1971566374 None] snapshot_file for this snap is: volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8.0ebcc3ac-896a-4b4d-9e88-c1de6ebd706c {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:13:08 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf3647d-6926-4c98-9edc-b9090fa38657]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:13:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c4acb18e-352c-4575-8ea0-83b6c9542a08 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8.0ebcc3ac-896a-4b4d-9e88-c1de6ebd706c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:08 devstack sudo[94827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8.0ebcc3ac-896a-4b4d-9e88-c1de6ebd706c
Nov 05 19:13:08 devstack sudo[94827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:08 devstack sudo[94825]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b80eaa3f-9c32-4490-86b5-0f84814bd0b4 tempest-VolumesExtendTest-1935484449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0054a46e-c52c-48df-bc47-256da1819c81 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81.56068403-9dfc-49ca-8a2f-ca46c7bf93d7" returned: 0 in 0.370s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:08 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-b80eaa3f-9c32-4490-86b5-0f84814bd0b4 tempest-VolumesExtendTest-1935484449 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81.56068403-9dfc-49ca-8a2f-ca46c7bf93d7 is being set with open permissions: ugo+rw
Nov 05 19:13:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b80eaa3f-9c32-4490-86b5-0f84814bd0b4 tempest-VolumesExtendTest-1935484449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81.56068403-9dfc-49ca-8a2f-ca46c7bf93d7 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:08 devstack sudo[94832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81.56068403-9dfc-49ca-8a2f-ca46c7bf93d7
Nov 05 19:13:08 devstack sudo[94832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:08 devstack sudo[94827]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c4acb18e-352c-4575-8ea0-83b6c9542a08 tempest-GroupSnapshotsTest-1971566374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8.0ebcc3ac-896a-4b4d-9e88-c1de6ebd706c" returned: 0 in 0.466s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-c4acb18e-352c-4575-8ea0-83b6c9542a08 tempest-GroupSnapshotsTest-1971566374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:13:08 devstack sudo[94832]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b80eaa3f-9c32-4490-86b5-0f84814bd0b4 tempest-VolumesExtendTest-1935484449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81.56068403-9dfc-49ca-8a2f-ca46c7bf93d7" returned: 0 in 0.305s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:08 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3d219d-0a2d-4818-9052-c907b36160b5]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:13:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c4acb18e-352c-4575-8ea0-83b6c9542a08 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b80eaa3f-9c32-4490-86b5-0f84814bd0b4 tempest-VolumesExtendTest-1935484449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:08 devstack sudo[94839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81.info
Nov 05 19:13:08 devstack sudo[94839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:08 devstack sudo[94838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8
Nov 05 19:13:08 devstack sudo[94838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:09 devstack sudo[94839]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b80eaa3f-9c32-4490-86b5-0f84814bd0b4 tempest-VolumesExtendTest-1935484449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81.info" returned: 0 in 0.304s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:09 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-b80eaa3f-9c32-4490-86b5-0f84814bd0b4 tempest-VolumesExtendTest-1935484449 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81.info is being set with open permissions: ugo+rw
Nov 05 19:13:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b80eaa3f-9c32-4490-86b5-0f84814bd0b4 tempest-VolumesExtendTest-1935484449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:09 devstack sudo[94843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81.info
Nov 05 19:13:09 devstack sudo[94843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:09 devstack sudo[94838]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c4acb18e-352c-4575-8ea0-83b6c9542a08 tempest-GroupSnapshotsTest-1971566374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8" returned: 0 in 0.479s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c4acb18e-352c-4575-8ea0-83b6c9542a08 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8.0ebcc3ac-896a-4b4d-9e88-c1de6ebd706c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:09 devstack sudo[94848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8.0ebcc3ac-896a-4b4d-9e88-c1de6ebd706c
Nov 05 19:13:09 devstack sudo[94848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:09 devstack sudo[94843]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b80eaa3f-9c32-4490-86b5-0f84814bd0b4 tempest-VolumesExtendTest-1935484449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81.info" returned: 0 in 0.253s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b80eaa3f-9c32-4490-86b5-0f84814bd0b4 tempest-VolumesExtendTest-1935484449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.395s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:13:09 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b80eaa3f-9c32-4490-86b5-0f84814bd0b4 tempest-VolumesExtendTest-1935484449 None] Create snapshot completed successfully
Nov 05 19:13:09 devstack sudo[94848]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c4acb18e-352c-4575-8ea0-83b6c9542a08 tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8.0ebcc3ac-896a-4b4d-9e88-c1de6ebd706c" returned: 0 in 0.379s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c4acb18e-352c-4575-8ea0-83b6c9542a08 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8.0ebcc3ac-896a-4b4d-9e88-c1de6ebd706c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:09 devstack sudo[94854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8.0ebcc3ac-896a-4b4d-9e88-c1de6ebd706c
Nov 05 19:13:09 devstack sudo[94854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:09 devstack sudo[94854]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c4acb18e-352c-4575-8ea0-83b6c9542a08 tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8.0ebcc3ac-896a-4b4d-9e88-c1de6ebd706c" returned: 0 in 0.257s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c4acb18e-352c-4575-8ea0-83b6c9542a08 tempest-GroupSnapshotsTest-1971566374 None] Lock "cinder-quobyte-0ebcc3ac-896a-4b4d-9e88-c1de6ebd706c" released by "_delete_snapshot" :: held 1.714s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:13:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c4acb18e-352c-4575-8ea0-83b6c9542a08 tempest-GroupSnapshotsTest-1971566374 None] Lock "cinder-quobyte-a938c9f6-de91-45f1-99d0-68d0a4bf66f8" released by "delete_snapshot" :: held 1.745s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:13:09 devstack cinder-volume[87184]: WARNING cinder.quota [None req-c4acb18e-352c-4575-8ea0-83b6c9542a08 tempest-GroupSnapshotsTest-1971566374 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1391762290 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1391762290, it is now deprecated. Please use the default quota class for default quota.
Nov 05 19:13:09 devstack cinder-volume[87184]: WARNING cinder.quota [None req-c4acb18e-352c-4575-8ea0-83b6c9542a08 tempest-GroupSnapshotsTest-1971566374 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1391762290 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1391762290, it is now deprecated. Please use the default quota class for default quota.
Nov 05 19:13:10 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-c4acb18e-352c-4575-8ea0-83b6c9542a08 tempest-GroupSnapshotsTest-1971566374 None] Created reservations ['255c985e-2f8e-4bb6-81d4-1b95fecdfee0', 'a6f5d6c5-6ff0-4655-ac85-3ebafbb5134f', 'e9d219d1-cbfe-467e-9ec4-a04680069ec2', '378e82f0-6f44-430b-b033-947d8fe1769d'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:13:10 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b1faa7b-c444-43df-87f3-7d8192d8ed01 tempest-VolumeTypesAccessTest-800511387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:13:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6b1faa7b-c444-43df-87f3-7d8192d8ed01 tempest-VolumeTypesAccessTest-800511387 None] Flow 'volume_create_manager' (861d486d-3773-4167-95bd-be23f4c34b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:13:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6b1faa7b-c444-43df-87f3-7d8192d8ed01 tempest-VolumeTypesAccessTest-800511387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2587731f-d7e1-45dd-8ba1-3e78114bac00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6b1faa7b-c444-43df-87f3-7d8192d8ed01 tempest-VolumeTypesAccessTest-800511387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2587731f-d7e1-45dd-8ba1-3e78114bac00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1644643493',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=399ff0d5-03d3-4b76-b544-510f546bda78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f95462d6a62342df93d23596616b718b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:13:10Z,use_quota=True,user_id='de7112280ea845a3a02b3d5d44ed0bf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab89b6ac-a679-4f8d-a8af-607a079ba565),volume_type_id=ab89b6ac-a679-4f8d-a8af-607a079ba565)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6b1faa7b-c444-43df-87f3-7d8192d8ed01 tempest-VolumeTypesAccessTest-800511387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22a10624-3eb0-42e4-8e87-6bb4d4f0e879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6b1faa7b-c444-43df-87f3-7d8192d8ed01 tempest-VolumeTypesAccessTest-800511387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22a10624-3eb0-42e4-8e87-6bb4d4f0e879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6b1faa7b-c444-43df-87f3-7d8192d8ed01 tempest-VolumeTypesAccessTest-800511387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46f14611-98e7-49f9-ad88-dd029f86a0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6b1faa7b-c444-43df-87f3-7d8192d8ed01 tempest-VolumeTypesAccessTest-800511387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46f14611-98e7-49f9-ad88-dd029f86a0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '399ff0d5-03d3-4b76-b544-510f546bda78', 'volume_name': 'volume-399ff0d5-03d3-4b76-b544-510f546bda78', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6b1faa7b-c444-43df-87f3-7d8192d8ed01 tempest-VolumeTypesAccessTest-800511387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2fce759-e7a9-4ec3-8521-3892098d0f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6b1faa7b-c444-43df-87f3-7d8192d8ed01 tempest-VolumeTypesAccessTest-800511387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2fce759-e7a9-4ec3-8521-3892098d0f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6b1faa7b-c444-43df-87f3-7d8192d8ed01 tempest-VolumeTypesAccessTest-800511387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9edc3020-44a7-4d66-9fe1-489b63176796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:10 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-6b1faa7b-c444-43df-87f3-7d8192d8ed01 tempest-VolumeTypesAccessTest-800511387 None] Volume 399ff0d5-03d3-4b76-b544-510f546bda78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-399ff0d5-03d3-4b76-b544-510f546bda78', 'volume_size': 1}
Nov 05 19:13:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6b1faa7b-c444-43df-87f3-7d8192d8ed01 tempest-VolumeTypesAccessTest-800511387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:13:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6b1faa7b-c444-43df-87f3-7d8192d8ed01 tempest-VolumeTypesAccessTest-800511387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:13:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6b1faa7b-c444-43df-87f3-7d8192d8ed01 tempest-VolumeTypesAccessTest-800511387 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1644643493',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=399ff0d5-03d3-4b76-b544-510f546bda78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f95462d6a62342df93d23596616b718b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:13:10Z,use_quota=True,user_id='de7112280ea845a3a02b3d5d44ed0bf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab89b6ac-a679-4f8d-a8af-607a079ba565),volume_type_id=ab89b6ac-a679-4f8d-a8af-607a079ba565)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:13:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-6b1faa7b-c444-43df-87f3-7d8192d8ed01 tempest-VolumeTypesAccessTest-800511387 None] Creating volume 399ff0d5-03d3-4b76-b544-510f546bda78 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:13:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6b1faa7b-c444-43df-87f3-7d8192d8ed01 tempest-VolumeTypesAccessTest-800511387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:13:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6b1faa7b-c444-43df-87f3-7d8192d8ed01 tempest-VolumeTypesAccessTest-800511387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:13:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6b1faa7b-c444-43df-87f3-7d8192d8ed01 tempest-VolumeTypesAccessTest-800511387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:13:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6b1faa7b-c444-43df-87f3-7d8192d8ed01 tempest-VolumeTypesAccessTest-800511387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:13:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6b1faa7b-c444-43df-87f3-7d8192d8ed01 tempest-VolumeTypesAccessTest-800511387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:13:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6b1faa7b-c444-43df-87f3-7d8192d8ed01 tempest-VolumeTypesAccessTest-800511387 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:13:10 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-6b1faa7b-c444-43df-87f3-7d8192d8ed01 tempest-VolumeTypesAccessTest-800511387 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:13:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6b1faa7b-c444-43df-87f3-7d8192d8ed01 tempest-VolumeTypesAccessTest-800511387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-399ff0d5-03d3-4b76-b544-510f546bda78 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:10 devstack sudo[94857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-399ff0d5-03d3-4b76-b544-510f546bda78 1073741824
Nov 05 19:13:10 devstack sudo[94857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3247d543-8558-45c0-8e78-d742bd732e87 tempest-VolumesExtendTest-1935484449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:13:10 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-c4acb18e-352c-4575-8ea0-83b6c9542a08 tempest-GroupSnapshotsTest-1971566374 None] Created reservations ['6e342c54-bd05-4fd6-81ab-7e011d083f59', 'a613e12d-d8c0-4f81-b5b6-3091def91d86', 'b2c236fa-6d32-45ee-b0d4-2960dc97bc2c', 'f7805650-7e31-4529-8d14-3144eb983d5a'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:13:10 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-c4acb18e-352c-4575-8ea0-83b6c9542a08 tempest-GroupSnapshotsTest-1971566374 None] group_snapshot aaebded7-add8-453b-9a12-2303b8b625bf: deleted successfully
Nov 05 19:13:10 devstack sudo[94857]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6b1faa7b-c444-43df-87f3-7d8192d8ed01 tempest-VolumeTypesAccessTest-800511387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-399ff0d5-03d3-4b76-b544-510f546bda78 1073741824" returned: 0 in 0.447s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6b1faa7b-c444-43df-87f3-7d8192d8ed01 tempest-VolumeTypesAccessTest-800511387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-399ff0d5-03d3-4b76-b544-510f546bda78 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:10 devstack sudo[94863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-399ff0d5-03d3-4b76-b544-510f546bda78
Nov 05 19:13:10 devstack sudo[94863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:10 devstack sudo[94863]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6b1faa7b-c444-43df-87f3-7d8192d8ed01 tempest-VolumeTypesAccessTest-800511387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-399ff0d5-03d3-4b76-b544-510f546bda78" returned: 0 in 0.248s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6b1faa7b-c444-43df-87f3-7d8192d8ed01 tempest-VolumeTypesAccessTest-800511387 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:13:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6b1faa7b-c444-43df-87f3-7d8192d8ed01 tempest-VolumeTypesAccessTest-800511387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:13:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3247d543-8558-45c0-8e78-d742bd732e87 tempest-VolumesExtendTest-1935484449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.678s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:13:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6b1faa7b-c444-43df-87f3-7d8192d8ed01 tempest-VolumeTypesAccessTest-800511387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9edc3020-44a7-4d66-9fe1-489b63176796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-399ff0d5-03d3-4b76-b544-510f546bda78', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6b1faa7b-c444-43df-87f3-7d8192d8ed01 tempest-VolumeTypesAccessTest-800511387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07946941-9692-4d9a-972d-a50bd63798a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:10 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda41682-55e4-4033-befc-802e8ac3f677]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:13:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3247d543-8558-45c0-8e78-d742bd732e87 tempest-VolumesExtendTest-1935484449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:10 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-6b1faa7b-c444-43df-87f3-7d8192d8ed01 tempest-VolumeTypesAccessTest-800511387 None] Volume volume-399ff0d5-03d3-4b76-b544-510f546bda78 (399ff0d5-03d3-4b76-b544-510f546bda78): created successfully
Nov 05 19:13:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6b1faa7b-c444-43df-87f3-7d8192d8ed01 tempest-VolumeTypesAccessTest-800511387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07946941-9692-4d9a-972d-a50bd63798a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6b1faa7b-c444-43df-87f3-7d8192d8ed01 tempest-VolumeTypesAccessTest-800511387 None] Flow 'volume_create_manager' (861d486d-3773-4167-95bd-be23f4c34b06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:13:11 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-6b1faa7b-c444-43df-87f3-7d8192d8ed01 tempest-VolumeTypesAccessTest-800511387 None] Created volume successfully.
Nov 05 19:13:11 devstack sudo[94866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81
Nov 05 19:13:11 devstack sudo[94866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3d79cbbd-2350-4191-815e-9cd95bd703be tempest-GroupSnapshotsTest-1971566374 None] Acquiring lock "cinder-quobyte-91069d7f-4eda-4f96-9ba2-e0094150265d" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:13:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3d79cbbd-2350-4191-815e-9cd95bd703be tempest-GroupSnapshotsTest-1971566374 None] Lock "cinder-quobyte-91069d7f-4eda-4f96-9ba2-e0094150265d" acquired by "delete_volume" :: waited 0.034s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:13:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c4ba95ff-2886-4ebf-af68-c8c708e5ec09 tempest-VolumeTypesAccessTest-800511387 None] Acquiring lock "cinder-399ff0d5-03d3-4b76-b544-510f546bda78-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:13:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c4ba95ff-2886-4ebf-af68-c8c708e5ec09 tempest-VolumeTypesAccessTest-800511387 None] Lock "cinder-399ff0d5-03d3-4b76-b544-510f546bda78-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:13:11 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[26012450-60d0-4b52-8261-8924a4008b8d]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:13:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3d79cbbd-2350-4191-815e-9cd95bd703be tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c4ba95ff-2886-4ebf-af68-c8c708e5ec09 tempest-VolumeTypesAccessTest-800511387 None] Acquiring lock "cinder-quobyte-399ff0d5-03d3-4b76-b544-510f546bda78" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:13:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c4ba95ff-2886-4ebf-af68-c8c708e5ec09 tempest-VolumeTypesAccessTest-800511387 None] Lock "cinder-quobyte-399ff0d5-03d3-4b76-b544-510f546bda78" acquired by "delete_volume" :: waited 0.031s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:13:11 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e0facc-8457-490a-ba9a-252630d2b5a1]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:13:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c4ba95ff-2886-4ebf-af68-c8c708e5ec09 tempest-VolumeTypesAccessTest-800511387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-399ff0d5-03d3-4b76-b544-510f546bda78 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:11 devstack sudo[94870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d
Nov 05 19:13:11 devstack sudo[94870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:11 devstack sudo[94866]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3247d543-8558-45c0-8e78-d742bd732e87 tempest-VolumesExtendTest-1935484449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81" returned: 0 in 0.494s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3247d543-8558-45c0-8e78-d742bd732e87 tempest-VolumesExtendTest-1935484449 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81.56068403-9dfc-49ca-8a2f-ca46c7bf93d7 2G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:11 devstack sudo[94874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-399ff0d5-03d3-4b76-b544-510f546bda78
Nov 05 19:13:11 devstack sudo[94874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3247d543-8558-45c0-8e78-d742bd732e87 tempest-VolumesExtendTest-1935484449 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81.56068403-9dfc-49ca-8a2f-ca46c7bf93d7 2G" returned: 0 in 0.172s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3247d543-8558-45c0-8e78-d742bd732e87 tempest-VolumesExtendTest-1935484449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.723s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:13:11 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-3247d543-8558-45c0-8e78-d742bd732e87 tempest-VolumesExtendTest-1935484449 None] Extend volume completed successfully.
Nov 05 19:13:11 devstack sudo[94870]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3d79cbbd-2350-4191-815e-9cd95bd703be tempest-GroupSnapshotsTest-1971566374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d" returned: 0 in 0.472s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3d79cbbd-2350-4191-815e-9cd95bd703be tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:11 devstack sudo[94884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d
Nov 05 19:13:11 devstack sudo[94884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:11 devstack sudo[94874]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c4ba95ff-2886-4ebf-af68-c8c708e5ec09 tempest-VolumeTypesAccessTest-800511387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-399ff0d5-03d3-4b76-b544-510f546bda78" returned: 0 in 0.469s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c4ba95ff-2886-4ebf-af68-c8c708e5ec09 tempest-VolumeTypesAccessTest-800511387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-399ff0d5-03d3-4b76-b544-510f546bda78 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:11 devstack sudo[94889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-399ff0d5-03d3-4b76-b544-510f546bda78
Nov 05 19:13:11 devstack sudo[94889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:11 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdd1747d-9e0c-4829-acf1-2b020e285d67 tempest-AttachVolumeNegativeTest-1202125091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:13:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fdd1747d-9e0c-4829-acf1-2b020e285d67 tempest-AttachVolumeNegativeTest-1202125091 None] Flow 'volume_create_manager' (dfcfe99e-ef31-4190-b873-5f16d25888fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:13:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fdd1747d-9e0c-4829-acf1-2b020e285d67 tempest-AttachVolumeNegativeTest-1202125091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3360db12-e315-492d-bc07-55051431ba63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fdd1747d-9e0c-4829-acf1-2b020e285d67 tempest-AttachVolumeNegativeTest-1202125091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3360db12-e315-492d-bc07-55051431ba63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-278766237',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4e40677-b9ab-45ce-b0a4-b3ccc3787407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a74259972a364a99b263b8035b2e6352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:13:12Z,use_quota=True,user_id='b68aef3a93d64fb7a1957146d2ec0757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fdd1747d-9e0c-4829-acf1-2b020e285d67 tempest-AttachVolumeNegativeTest-1202125091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cedb416-d1e1-412f-a577-4273eb29ed1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fdd1747d-9e0c-4829-acf1-2b020e285d67 tempest-AttachVolumeNegativeTest-1202125091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cedb416-d1e1-412f-a577-4273eb29ed1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fdd1747d-9e0c-4829-acf1-2b020e285d67 tempest-AttachVolumeNegativeTest-1202125091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (446b5a16-67be-41cf-a34c-85682d821456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fdd1747d-9e0c-4829-acf1-2b020e285d67 tempest-AttachVolumeNegativeTest-1202125091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (446b5a16-67be-41cf-a34c-85682d821456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4e40677-b9ab-45ce-b0a4-b3ccc3787407', 'volume_name': 'volume-f4e40677-b9ab-45ce-b0a4-b3ccc3787407', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fdd1747d-9e0c-4829-acf1-2b020e285d67 tempest-AttachVolumeNegativeTest-1202125091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (947a4df7-062f-4571-b908-edf4ff4fa735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fdd1747d-9e0c-4829-acf1-2b020e285d67 tempest-AttachVolumeNegativeTest-1202125091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (947a4df7-062f-4571-b908-edf4ff4fa735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fdd1747d-9e0c-4829-acf1-2b020e285d67 tempest-AttachVolumeNegativeTest-1202125091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d98323be-4146-4d6b-9c3c-c05a79b4c886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:11 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-fdd1747d-9e0c-4829-acf1-2b020e285d67 tempest-AttachVolumeNegativeTest-1202125091 None] Volume f4e40677-b9ab-45ce-b0a4-b3ccc3787407: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4e40677-b9ab-45ce-b0a4-b3ccc3787407', 'volume_size': 1}
Nov 05 19:13:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fdd1747d-9e0c-4829-acf1-2b020e285d67 tempest-AttachVolumeNegativeTest-1202125091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:13:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fdd1747d-9e0c-4829-acf1-2b020e285d67 tempest-AttachVolumeNegativeTest-1202125091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:13:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fdd1747d-9e0c-4829-acf1-2b020e285d67 tempest-AttachVolumeNegativeTest-1202125091 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-278766237',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4e40677-b9ab-45ce-b0a4-b3ccc3787407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a74259972a364a99b263b8035b2e6352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:13:12Z,use_quota=True,user_id='b68aef3a93d64fb7a1957146d2ec0757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:13:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-fdd1747d-9e0c-4829-acf1-2b020e285d67 tempest-AttachVolumeNegativeTest-1202125091 None] Creating volume f4e40677-b9ab-45ce-b0a4-b3ccc3787407 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:13:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fdd1747d-9e0c-4829-acf1-2b020e285d67 tempest-AttachVolumeNegativeTest-1202125091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:13:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fdd1747d-9e0c-4829-acf1-2b020e285d67 tempest-AttachVolumeNegativeTest-1202125091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:13:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fdd1747d-9e0c-4829-acf1-2b020e285d67 tempest-AttachVolumeNegativeTest-1202125091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:13:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fdd1747d-9e0c-4829-acf1-2b020e285d67 tempest-AttachVolumeNegativeTest-1202125091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:13:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fdd1747d-9e0c-4829-acf1-2b020e285d67 tempest-AttachVolumeNegativeTest-1202125091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:13:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fdd1747d-9e0c-4829-acf1-2b020e285d67 tempest-AttachVolumeNegativeTest-1202125091 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:13:11 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-fdd1747d-9e0c-4829-acf1-2b020e285d67 tempest-AttachVolumeNegativeTest-1202125091 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:13:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fdd1747d-9e0c-4829-acf1-2b020e285d67 tempest-AttachVolumeNegativeTest-1202125091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f4e40677-b9ab-45ce-b0a4-b3ccc3787407 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:12 devstack sudo[94892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f4e40677-b9ab-45ce-b0a4-b3ccc3787407 1073741824
Nov 05 19:13:12 devstack sudo[94884]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:12 devstack sudo[94892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3d79cbbd-2350-4191-815e-9cd95bd703be tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91069d7f-4eda-4f96-9ba2-e0094150265d" returned: 0 in 0.273s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3d79cbbd-2350-4191-815e-9cd95bd703be tempest-GroupSnapshotsTest-1971566374 None] Lock "cinder-quobyte-91069d7f-4eda-4f96-9ba2-e0094150265d" released by "delete_volume" :: held 0.868s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:13:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3d79cbbd-2350-4191-815e-9cd95bd703be tempest-GroupSnapshotsTest-1971566374 None] Acquiring lock "cinder-quobyte-a938c9f6-de91-45f1-99d0-68d0a4bf66f8" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:13:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3d79cbbd-2350-4191-815e-9cd95bd703be tempest-GroupSnapshotsTest-1971566374 None] Lock "cinder-quobyte-a938c9f6-de91-45f1-99d0-68d0a4bf66f8" acquired by "delete_volume" :: waited 0.014s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:13:12 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e899019-926d-452e-a379-20a462cbe945]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:13:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3d79cbbd-2350-4191-815e-9cd95bd703be tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:12 devstack sudo[94889]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c4ba95ff-2886-4ebf-af68-c8c708e5ec09 tempest-VolumeTypesAccessTest-800511387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-399ff0d5-03d3-4b76-b544-510f546bda78" returned: 0 in 0.259s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c4ba95ff-2886-4ebf-af68-c8c708e5ec09 tempest-VolumeTypesAccessTest-800511387 None] Lock "cinder-quobyte-399ff0d5-03d3-4b76-b544-510f546bda78" released by "delete_volume" :: held 0.774s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:13:12 devstack cinder-volume[87184]: WARNING cinder.quota [None req-c4ba95ff-2886-4ebf-af68-c8c708e5ec09 tempest-VolumeTypesAccessTest-800511387 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1799171971 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1799171971, it is now deprecated. Please use the default quota class for default quota.
Nov 05 19:13:12 devstack cinder-volume[87184]: WARNING cinder.quota [None req-c4ba95ff-2886-4ebf-af68-c8c708e5ec09 tempest-VolumeTypesAccessTest-800511387 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1799171971 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1799171971, it is now deprecated. Please use the default quota class for default quota.
Nov 05 19:13:12 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-c4ba95ff-2886-4ebf-af68-c8c708e5ec09 tempest-VolumeTypesAccessTest-800511387 None] Created reservations ['e2592b78-c53b-4c04-822f-8bdee055e12c', '030d5c38-361e-4af4-8e65-2a7275b32a6f', '1cf19960-bc6b-403a-8e1b-b35a0a7a5f79', '3bcfcfae-672c-459f-8627-c3edda1729ed'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:13:12 devstack sudo[94895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8
Nov 05 19:13:12 devstack sudo[94895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c4ba95ff-2886-4ebf-af68-c8c708e5ec09 tempest-VolumeTypesAccessTest-800511387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:13:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c4ba95ff-2886-4ebf-af68-c8c708e5ec09 tempest-VolumeTypesAccessTest-800511387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:13:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c4ba95ff-2886-4ebf-af68-c8c708e5ec09 tempest-VolumeTypesAccessTest-800511387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:13:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c4ba95ff-2886-4ebf-af68-c8c708e5ec09 tempest-VolumeTypesAccessTest-800511387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:13:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c4ba95ff-2886-4ebf-af68-c8c708e5ec09 tempest-VolumeTypesAccessTest-800511387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:13:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c4ba95ff-2886-4ebf-af68-c8c708e5ec09 tempest-VolumeTypesAccessTest-800511387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:12 devstack sudo[94899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:13:12 devstack sudo[94899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:12 devstack sudo[94895]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3d79cbbd-2350-4191-815e-9cd95bd703be tempest-GroupSnapshotsTest-1971566374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8" returned: 0 in 0.503s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3d79cbbd-2350-4191-815e-9cd95bd703be tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:12 devstack sudo[94892]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fdd1747d-9e0c-4829-acf1-2b020e285d67 tempest-AttachVolumeNegativeTest-1202125091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f4e40677-b9ab-45ce-b0a4-b3ccc3787407 1073741824" returned: 0 in 0.627s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:12 devstack sudo[94899]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c4ba95ff-2886-4ebf-af68-c8c708e5ec09 tempest-VolumeTypesAccessTest-800511387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.395s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:12 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-c4ba95ff-2886-4ebf-af68-c8c708e5ec09 tempest-VolumeTypesAccessTest-800511387 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:13:12 devstack sudo[94906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8
Nov 05 19:13:12 devstack sudo[94906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:12 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-c4ba95ff-2886-4ebf-af68-c8c708e5ec09 tempest-VolumeTypesAccessTest-800511387 None] Deleted volume successfully.
Nov 05 19:13:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-372a2a2b-37d2-4731-aa01-80d7e721ab0a tempest-VolumesExtendTest-1935484449 None] Acquiring lock "cinder-56068403-9dfc-49ca-8a2f-ca46c7bf93d7-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:13:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c4ba95ff-2886-4ebf-af68-c8c708e5ec09 tempest-VolumeTypesAccessTest-800511387 None] Lock "cinder-399ff0d5-03d3-4b76-b544-510f546bda78-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:13:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fdd1747d-9e0c-4829-acf1-2b020e285d67 tempest-AttachVolumeNegativeTest-1202125091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f4e40677-b9ab-45ce-b0a4-b3ccc3787407 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-372a2a2b-37d2-4731-aa01-80d7e721ab0a tempest-VolumesExtendTest-1935484449 None] Lock "cinder-56068403-9dfc-49ca-8a2f-ca46c7bf93d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:13:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-372a2a2b-37d2-4731-aa01-80d7e721ab0a tempest-VolumesExtendTest-1935484449 None] Acquiring lock "cinder-quobyte-0054a46e-c52c-48df-bc47-256da1819c81" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:13:12 devstack sudo[94908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f4e40677-b9ab-45ce-b0a4-b3ccc3787407
Nov 05 19:13:12 devstack sudo[94908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-372a2a2b-37d2-4731-aa01-80d7e721ab0a tempest-VolumesExtendTest-1935484449 None] Lock "cinder-quobyte-0054a46e-c52c-48df-bc47-256da1819c81" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:13:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-372a2a2b-37d2-4731-aa01-80d7e721ab0a tempest-VolumesExtendTest-1935484449 None] Acquiring lock "cinder-quobyte-56068403-9dfc-49ca-8a2f-ca46c7bf93d7" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:13:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-372a2a2b-37d2-4731-aa01-80d7e721ab0a tempest-VolumesExtendTest-1935484449 None] Lock "cinder-quobyte-56068403-9dfc-49ca-8a2f-ca46c7bf93d7" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:13:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-372a2a2b-37d2-4731-aa01-80d7e721ab0a tempest-VolumesExtendTest-1935484449 None] Deleting offline snapshot 56068403-9dfc-49ca-8a2f-ca46c7bf93d7 of volume 0054a46e-c52c-48df-bc47-256da1819c81 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:13:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-372a2a2b-37d2-4731-aa01-80d7e721ab0a tempest-VolumesExtendTest-1935484449 None] snapshot_file for this snap is: volume-0054a46e-c52c-48df-bc47-256da1819c81.56068403-9dfc-49ca-8a2f-ca46c7bf93d7 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:13:12 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e19649-e14b-490f-947a-3556fcd594f1]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:13:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-372a2a2b-37d2-4731-aa01-80d7e721ab0a tempest-VolumesExtendTest-1935484449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81.56068403-9dfc-49ca-8a2f-ca46c7bf93d7 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:12 devstack sudo[94906]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3d79cbbd-2350-4191-815e-9cd95bd703be tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a938c9f6-de91-45f1-99d0-68d0a4bf66f8" returned: 0 in 0.377s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:13 devstack sudo[94910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81.56068403-9dfc-49ca-8a2f-ca46c7bf93d7
Nov 05 19:13:13 devstack sudo[94910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3d79cbbd-2350-4191-815e-9cd95bd703be tempest-GroupSnapshotsTest-1971566374 None] Lock "cinder-quobyte-a938c9f6-de91-45f1-99d0-68d0a4bf66f8" released by "delete_volume" :: held 0.953s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:13:13 devstack sudo[94908]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fdd1747d-9e0c-4829-acf1-2b020e285d67 tempest-AttachVolumeNegativeTest-1202125091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f4e40677-b9ab-45ce-b0a4-b3ccc3787407" returned: 0 in 0.331s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fdd1747d-9e0c-4829-acf1-2b020e285d67 tempest-AttachVolumeNegativeTest-1202125091 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:13:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fdd1747d-9e0c-4829-acf1-2b020e285d67 tempest-AttachVolumeNegativeTest-1202125091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:13:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fdd1747d-9e0c-4829-acf1-2b020e285d67 tempest-AttachVolumeNegativeTest-1202125091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d98323be-4146-4d6b-9c3c-c05a79b4c886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4e40677-b9ab-45ce-b0a4-b3ccc3787407', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fdd1747d-9e0c-4829-acf1-2b020e285d67 tempest-AttachVolumeNegativeTest-1202125091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e09f4ee-3ab2-4561-955c-9fce41888ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:13 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-fdd1747d-9e0c-4829-acf1-2b020e285d67 tempest-AttachVolumeNegativeTest-1202125091 None] Volume volume-f4e40677-b9ab-45ce-b0a4-b3ccc3787407 (f4e40677-b9ab-45ce-b0a4-b3ccc3787407): created successfully
Nov 05 19:13:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fdd1747d-9e0c-4829-acf1-2b020e285d67 tempest-AttachVolumeNegativeTest-1202125091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e09f4ee-3ab2-4561-955c-9fce41888ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fdd1747d-9e0c-4829-acf1-2b020e285d67 tempest-AttachVolumeNegativeTest-1202125091 None] Flow 'volume_create_manager' (dfcfe99e-ef31-4190-b873-5f16d25888fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:13:13 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-fdd1747d-9e0c-4829-acf1-2b020e285d67 tempest-AttachVolumeNegativeTest-1202125091 None] Created volume successfully.
Nov 05 19:13:13 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-3d79cbbd-2350-4191-815e-9cd95bd703be tempest-GroupSnapshotsTest-1971566374 None] Created reservations ['dd5d4aea-c219-4639-9cf5-b4e6eb80b176'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:13:13 devstack cinder-volume[87184]: WARNING cinder.quota [None req-3d79cbbd-2350-4191-815e-9cd95bd703be tempest-GroupSnapshotsTest-1971566374 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1391762290 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1391762290, it is now deprecated. Please use the default quota class for default quota.
Nov 05 19:13:13 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-3d79cbbd-2350-4191-815e-9cd95bd703be tempest-GroupSnapshotsTest-1971566374 None] Created reservations ['b44b1774-ec4a-4e2f-9d17-f596cf9bd44c', '18ecb51d-91b8-41af-b153-725c38ecd259', '5740a727-71fa-493c-b578-c1cada85c4ef', '8b3c2149-6243-486c-8ff0-31f2a43288e6'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:13:13 devstack sudo[94910]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-372a2a2b-37d2-4731-aa01-80d7e721ab0a tempest-VolumesExtendTest-1935484449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81.56068403-9dfc-49ca-8a2f-ca46c7bf93d7" returned: 0 in 0.415s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-372a2a2b-37d2-4731-aa01-80d7e721ab0a tempest-VolumesExtendTest-1935484449 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0054a46e-c52c-48df-bc47-256da1819c81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:13:13 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-3d79cbbd-2350-4191-815e-9cd95bd703be tempest-GroupSnapshotsTest-1971566374 None] Created reservations ['f137f3c6-6db7-46c2-9b14-d8bcc9f5c4f7', '8bc1ed16-172b-4249-80ec-9c525fde7498', 'fe6185bf-c38c-4101-8364-ed6d18d69a3e', '11cb864b-9e43-4c26-b94a-4e0aed41eaa8'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:13:13 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3cd90f-6fe1-4821-8b1e-46d8dad3601a]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:13:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-372a2a2b-37d2-4731-aa01-80d7e721ab0a tempest-VolumesExtendTest-1935484449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3d79cbbd-2350-4191-815e-9cd95bd703be tempest-GroupSnapshotsTest-1971566374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:13:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3d79cbbd-2350-4191-815e-9cd95bd703be tempest-GroupSnapshotsTest-1971566374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:13:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3d79cbbd-2350-4191-815e-9cd95bd703be tempest-GroupSnapshotsTest-1971566374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:13:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3d79cbbd-2350-4191-815e-9cd95bd703be tempest-GroupSnapshotsTest-1971566374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:13:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3d79cbbd-2350-4191-815e-9cd95bd703be tempest-GroupSnapshotsTest-1971566374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:13:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3d79cbbd-2350-4191-815e-9cd95bd703be tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:13 devstack sudo[94918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81
Nov 05 19:13:13 devstack sudo[94918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:13 devstack sudo[94919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:13:13 devstack sudo[94919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:13 devstack sudo[94919]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3d79cbbd-2350-4191-815e-9cd95bd703be tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.330s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:13 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-3d79cbbd-2350-4191-815e-9cd95bd703be tempest-GroupSnapshotsTest-1971566374 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:13:13 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-3d79cbbd-2350-4191-815e-9cd95bd703be tempest-GroupSnapshotsTest-1971566374 None] Delete group completed successfully.
Nov 05 19:13:13 devstack sudo[94918]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-372a2a2b-37d2-4731-aa01-80d7e721ab0a tempest-VolumesExtendTest-1935484449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81" returned: 0 in 0.493s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-372a2a2b-37d2-4731-aa01-80d7e721ab0a tempest-VolumesExtendTest-1935484449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81.56068403-9dfc-49ca-8a2f-ca46c7bf93d7 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:13 devstack sudo[94927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81.56068403-9dfc-49ca-8a2f-ca46c7bf93d7
Nov 05 19:13:13 devstack sudo[94927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:14 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-883c1f1b-38d7-4313-b4c2-db56b8e99a6f tempest-GroupSnapshotsTest-1971566374 None] Group tempest-GroupSnapshotsTest-Group-1503633438: creating
Nov 05 19:13:14 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-883c1f1b-38d7-4313-b4c2-db56b8e99a6f tempest-GroupSnapshotsTest-1971566374 None] Group tempest-GroupSnapshotsTest-Group-1503633438: created successfully
Nov 05 19:13:14 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-883c1f1b-38d7-4313-b4c2-db56b8e99a6f tempest-GroupSnapshotsTest-1971566374 None] Create group completed successfully.
Nov 05 19:13:14 devstack sudo[94927]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-372a2a2b-37d2-4731-aa01-80d7e721ab0a tempest-VolumesExtendTest-1935484449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81.56068403-9dfc-49ca-8a2f-ca46c7bf93d7" returned: 0 in 0.498s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-372a2a2b-37d2-4731-aa01-80d7e721ab0a tempest-VolumesExtendTest-1935484449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81.56068403-9dfc-49ca-8a2f-ca46c7bf93d7 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:14 devstack sudo[94936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81.56068403-9dfc-49ca-8a2f-ca46c7bf93d7
Nov 05 19:13:14 devstack sudo[94936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:14 devstack sudo[94936]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-372a2a2b-37d2-4731-aa01-80d7e721ab0a tempest-VolumesExtendTest-1935484449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81.56068403-9dfc-49ca-8a2f-ca46c7bf93d7" returned: 0 in 0.296s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-372a2a2b-37d2-4731-aa01-80d7e721ab0a tempest-VolumesExtendTest-1935484449 None] Lock "cinder-quobyte-56068403-9dfc-49ca-8a2f-ca46c7bf93d7" released by "_delete_snapshot" :: held 1.863s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:13:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-372a2a2b-37d2-4731-aa01-80d7e721ab0a tempest-VolumesExtendTest-1935484449 None] Lock "cinder-quobyte-0054a46e-c52c-48df-bc47-256da1819c81" released by "delete_snapshot" :: held 1.903s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:13:14 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-372a2a2b-37d2-4731-aa01-80d7e721ab0a tempest-VolumesExtendTest-1935484449 None] Created reservations ['fbbfa14d-de95-44cd-afe4-4c7003320aee', '8c05d89c-689f-462d-9a71-1fb91ccd1f7e', '2441a354-ddbb-4da4-a3c1-124c7ea219a4', '14fe1f4f-3952-45fa-bea2-13cab3fc044a'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:13:14 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-372a2a2b-37d2-4731-aa01-80d7e721ab0a tempest-VolumesExtendTest-1935484449 None] Delete snapshot completed successfully.
Nov 05 19:13:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-372a2a2b-37d2-4731-aa01-80d7e721ab0a tempest-VolumesExtendTest-1935484449 None] Lock "cinder-56068403-9dfc-49ca-8a2f-ca46c7bf93d7-delete_snapshot" released by "delete_snapshot" :: held 2.162s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:13:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-632889ab-36b4-4436-9ab0-30f0ef5b9959 req-b7db8467-a13f-444b-8bbb-bcf8680b6091 tempest-AttachVolumeNegativeTest-1202125091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:13:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-632889ab-36b4-4436-9ab0-30f0ef5b9959 req-b7db8467-a13f-444b-8bbb-bcf8680b6091 tempest-AttachVolumeNegativeTest-1202125091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:13:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-632889ab-36b4-4436-9ab0-30f0ef5b9959 req-b7db8467-a13f-444b-8bbb-bcf8680b6091 tempest-AttachVolumeNegativeTest-1202125091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:13:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-632889ab-36b4-4436-9ab0-30f0ef5b9959 req-b7db8467-a13f-444b-8bbb-bcf8680b6091 tempest-AttachVolumeNegativeTest-1202125091 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec', 'name': 'volume-f4e40677-b9ab-45ce-b0a4-b3ccc3787407', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0763e4fe-ca1d-4ae4-8938-34b4d2f7a93b', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 19:13:15 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-632889ab-36b4-4436-9ab0-30f0ef5b9959 req-b7db8467-a13f-444b-8bbb-bcf8680b6091 tempest-AttachVolumeNegativeTest-1202125091 None] attachment_update completed successfully.
Nov 05 19:13:15 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-5657a9f0-7420-402c-92a3-7ff09562df1b tempest-GroupSnapshotsTest-1971566374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:13:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5657a9f0-7420-402c-92a3-7ff09562df1b tempest-GroupSnapshotsTest-1971566374 None] Flow 'volume_create_manager' (d43170c8-3c5b-42b6-9228-b274fac62e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:13:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5657a9f0-7420-402c-92a3-7ff09562df1b tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07b7059d-b736-4336-9633-fb61d8ca9640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5657a9f0-7420-402c-92a3-7ff09562df1b tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07b7059d-b736-4336-9633-fb61d8ca9640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2067547920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1924d87a-8b22-4b01-96df-72a2efc3569d,host='devstack@QuobyteHD#QuobyteHD',id=66c4391a-02de-475a-9950-ab3b1f95e65a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75ade83722d84a799eff399843986cb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:13:16Z,use_quota=True,user_id='e3f9060bf2674e44a7ef4fc02ea1d058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea6513a4-f0c2-4f16-86fb-f8cc3cd36af2),volume_type_id=ea6513a4-f0c2-4f16-86fb-f8cc3cd36af2)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5657a9f0-7420-402c-92a3-7ff09562df1b tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54b2a91c-f96f-48f9-8058-bb3b2a20c4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5657a9f0-7420-402c-92a3-7ff09562df1b tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54b2a91c-f96f-48f9-8058-bb3b2a20c4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5657a9f0-7420-402c-92a3-7ff09562df1b tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (902eb77a-20e9-4a62-a400-3b7ea57122f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5657a9f0-7420-402c-92a3-7ff09562df1b tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (902eb77a-20e9-4a62-a400-3b7ea57122f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66c4391a-02de-475a-9950-ab3b1f95e65a', 'volume_name': 'volume-66c4391a-02de-475a-9950-ab3b1f95e65a', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5657a9f0-7420-402c-92a3-7ff09562df1b tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a8b2a58-bf91-4154-82e4-93e75d7c61ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5657a9f0-7420-402c-92a3-7ff09562df1b tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a8b2a58-bf91-4154-82e4-93e75d7c61ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5657a9f0-7420-402c-92a3-7ff09562df1b tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3f51caa-d70e-4ae4-a570-1b61a82c5434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:16 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-5657a9f0-7420-402c-92a3-7ff09562df1b tempest-GroupSnapshotsTest-1971566374 None] Volume 66c4391a-02de-475a-9950-ab3b1f95e65a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66c4391a-02de-475a-9950-ab3b1f95e65a', 'volume_size': 1}
Nov 05 19:13:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5657a9f0-7420-402c-92a3-7ff09562df1b tempest-GroupSnapshotsTest-1971566374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:13:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5657a9f0-7420-402c-92a3-7ff09562df1b tempest-GroupSnapshotsTest-1971566374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:13:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5657a9f0-7420-402c-92a3-7ff09562df1b tempest-GroupSnapshotsTest-1971566374 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=1924d87a-8b22-4b01-96df-72a2efc3569d,created_at=2026-11-05T18:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2067547920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1924d87a-8b22-4b01-96df-72a2efc3569d,host='devstack@QuobyteHD#QuobyteHD',id=66c4391a-02de-475a-9950-ab3b1f95e65a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75ade83722d84a799eff399843986cb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:13:16Z,use_quota=True,user_id='e3f9060bf2674e44a7ef4fc02ea1d058',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea6513a4-f0c2-4f16-86fb-f8cc3cd36af2),volume_type_id=ea6513a4-f0c2-4f16-86fb-f8cc3cd36af2)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:13:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-5657a9f0-7420-402c-92a3-7ff09562df1b tempest-GroupSnapshotsTest-1971566374 None] Creating volume 66c4391a-02de-475a-9950-ab3b1f95e65a {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:13:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5657a9f0-7420-402c-92a3-7ff09562df1b tempest-GroupSnapshotsTest-1971566374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:13:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5657a9f0-7420-402c-92a3-7ff09562df1b tempest-GroupSnapshotsTest-1971566374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:13:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5657a9f0-7420-402c-92a3-7ff09562df1b tempest-GroupSnapshotsTest-1971566374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:13:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5657a9f0-7420-402c-92a3-7ff09562df1b tempest-GroupSnapshotsTest-1971566374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:13:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5657a9f0-7420-402c-92a3-7ff09562df1b tempest-GroupSnapshotsTest-1971566374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:13:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5657a9f0-7420-402c-92a3-7ff09562df1b tempest-GroupSnapshotsTest-1971566374 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:13:16 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-5657a9f0-7420-402c-92a3-7ff09562df1b tempest-GroupSnapshotsTest-1971566374 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:13:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5657a9f0-7420-402c-92a3-7ff09562df1b tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-287141e5-6918-4da7-b604-f35adfe618e1 tempest-VolumesExtendTest-1935484449 None] Acquiring lock "cinder-0054a46e-c52c-48df-bc47-256da1819c81-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:13:16 devstack sudo[95364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a 1073741824
Nov 05 19:13:16 devstack sudo[95364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-287141e5-6918-4da7-b604-f35adfe618e1 tempest-VolumesExtendTest-1935484449 None] Lock "cinder-0054a46e-c52c-48df-bc47-256da1819c81-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:13:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-287141e5-6918-4da7-b604-f35adfe618e1 tempest-VolumesExtendTest-1935484449 None] Acquiring lock "cinder-quobyte-0054a46e-c52c-48df-bc47-256da1819c81" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:13:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-287141e5-6918-4da7-b604-f35adfe618e1 tempest-VolumesExtendTest-1935484449 None] Lock "cinder-quobyte-0054a46e-c52c-48df-bc47-256da1819c81" acquired by "delete_volume" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:13:16 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8aab10-9289-4c00-8b16-2728d279cdeb]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:13:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-287141e5-6918-4da7-b604-f35adfe618e1 tempest-VolumesExtendTest-1935484449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:16 devstack sudo[95366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81
Nov 05 19:13:16 devstack sudo[95366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:16 devstack sudo[95366]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-287141e5-6918-4da7-b604-f35adfe618e1 tempest-VolumesExtendTest-1935484449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81" returned: 0 in 0.447s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-287141e5-6918-4da7-b604-f35adfe618e1 tempest-VolumesExtendTest-1935484449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:16 devstack sudo[95376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81
Nov 05 19:13:16 devstack sudo[95376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:16 devstack sudo[95364]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5657a9f0-7420-402c-92a3-7ff09562df1b tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a 1073741824" returned: 0 in 0.740s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5657a9f0-7420-402c-92a3-7ff09562df1b tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:16 devstack sudo[95378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a
Nov 05 19:13:16 devstack sudo[95378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:16 devstack sudo[95376]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-287141e5-6918-4da7-b604-f35adfe618e1 tempest-VolumesExtendTest-1935484449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0054a46e-c52c-48df-bc47-256da1819c81" returned: 0 in 0.274s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-287141e5-6918-4da7-b604-f35adfe618e1 tempest-VolumesExtendTest-1935484449 None] Lock "cinder-quobyte-0054a46e-c52c-48df-bc47-256da1819c81" released by "delete_volume" :: held 0.827s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:13:17 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-287141e5-6918-4da7-b604-f35adfe618e1 tempest-VolumesExtendTest-1935484449 None] Created reservations ['78eeef1e-f6a0-4698-b394-7cb98bc42181', '623f2451-1004-4939-affb-d4fb238b012c', '5f5f2f6c-9113-495b-b75e-c5f7b2ebfb4d', '7f50d48d-b711-40e9-b07e-d504b943255a'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:13:17 devstack sudo[95378]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5657a9f0-7420-402c-92a3-7ff09562df1b tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a" returned: 0 in 0.265s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5657a9f0-7420-402c-92a3-7ff09562df1b tempest-GroupSnapshotsTest-1971566374 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:13:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5657a9f0-7420-402c-92a3-7ff09562df1b tempest-GroupSnapshotsTest-1971566374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:13:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5657a9f0-7420-402c-92a3-7ff09562df1b tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3f51caa-d70e-4ae4-a570-1b61a82c5434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66c4391a-02de-475a-9950-ab3b1f95e65a', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5657a9f0-7420-402c-92a3-7ff09562df1b tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a766e7f6-a590-4375-9bb2-d6af0392861e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:17 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-5657a9f0-7420-402c-92a3-7ff09562df1b tempest-GroupSnapshotsTest-1971566374 None] Volume volume-66c4391a-02de-475a-9950-ab3b1f95e65a (66c4391a-02de-475a-9950-ab3b1f95e65a): created successfully
Nov 05 19:13:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5657a9f0-7420-402c-92a3-7ff09562df1b tempest-GroupSnapshotsTest-1971566374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a766e7f6-a590-4375-9bb2-d6af0392861e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-5657a9f0-7420-402c-92a3-7ff09562df1b tempest-GroupSnapshotsTest-1971566374 None] Flow 'volume_create_manager' (d43170c8-3c5b-42b6-9228-b274fac62e06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:13:17 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-5657a9f0-7420-402c-92a3-7ff09562df1b tempest-GroupSnapshotsTest-1971566374 None] Created volume successfully.
Nov 05 19:13:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-287141e5-6918-4da7-b604-f35adfe618e1 tempest-VolumesExtendTest-1935484449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:13:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-287141e5-6918-4da7-b604-f35adfe618e1 tempest-VolumesExtendTest-1935484449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:13:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-287141e5-6918-4da7-b604-f35adfe618e1 tempest-VolumesExtendTest-1935484449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:13:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-287141e5-6918-4da7-b604-f35adfe618e1 tempest-VolumesExtendTest-1935484449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:13:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-287141e5-6918-4da7-b604-f35adfe618e1 tempest-VolumesExtendTest-1935484449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:13:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-287141e5-6918-4da7-b604-f35adfe618e1 tempest-VolumesExtendTest-1935484449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:17 devstack sudo[95382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:13:17 devstack sudo[95382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:17 devstack sudo[95382]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-287141e5-6918-4da7-b604-f35adfe618e1 tempest-VolumesExtendTest-1935484449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.426s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:17 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-287141e5-6918-4da7-b604-f35adfe618e1 tempest-VolumesExtendTest-1935484449 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:13:17 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-287141e5-6918-4da7-b604-f35adfe618e1 tempest-VolumesExtendTest-1935484449 None] Deleted volume successfully.
Nov 05 19:13:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-287141e5-6918-4da7-b604-f35adfe618e1 tempest-VolumesExtendTest-1935484449 None] Lock "cinder-0054a46e-c52c-48df-bc47-256da1819c81-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:13:17 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-d7295b13-f534-4424-9bbd-42e0681ba5d2 tempest-GroupSnapshotsTest-1971566374 None] GroupSnapshot 49aae31d-6a17-458d-b56f-38ddcfa7d6ba: creating.
Nov 05 19:13:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d7295b13-f534-4424-9bbd-42e0681ba5d2 tempest-GroupSnapshotsTest-1971566374 None] Group snapshot 49aae31d-6a17-458d-b56f-38ddcfa7d6ba: creating. {{(pid=87184) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 05 19:13:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d7295b13-f534-4424-9bbd-42e0681ba5d2 tempest-GroupSnapshotsTest-1971566374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:13:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d7295b13-f534-4424-9bbd-42e0681ba5d2 tempest-GroupSnapshotsTest-1971566374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:13:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-d7295b13-f534-4424-9bbd-42e0681ba5d2 tempest-GroupSnapshotsTest-1971566374 None] Creating offline snapshot 847d0c50-5028-46b7-aaec-bc184719975a of volume 66c4391a-02de-475a-9950-ab3b1f95e65a {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:13:17 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ac8bbd-325f-4a9a-b1bc-b8165bbac522]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:13:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d7295b13-f534-4424-9bbd-42e0681ba5d2 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:17 devstack sudo[95385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a
Nov 05 19:13:17 devstack sudo[95385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:18 devstack sudo[95385]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d7295b13-f534-4424-9bbd-42e0681ba5d2 tempest-GroupSnapshotsTest-1971566374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a" returned: 0 in 0.552s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d7295b13-f534-4424-9bbd-42e0681ba5d2 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a.847d0c50-5028-46b7-aaec-bc184719975a 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:18 devstack sudo[95390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a.847d0c50-5028-46b7-aaec-bc184719975a 1G
Nov 05 19:13:18 devstack sudo[95390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:18 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-7ace1ad3-3352-4637-9dd1-00738122089d req-12fb15c8-f3d2-4cbc-9319-01f7d24e657d tempest-AttachVolumeNegativeTest-1202125091 None] Terminate volume connection completed successfully.
Nov 05 19:13:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-7ace1ad3-3352-4637-9dd1-00738122089d req-12fb15c8-f3d2-4cbc-9319-01f7d24e657d tempest-AttachVolumeNegativeTest-1202125091 None] Deleting attachment 0763e4fe-ca1d-4ae4-8938-34b4d2f7a93b. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 19:13:19 devstack sudo[95390]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d7295b13-f534-4424-9bbd-42e0681ba5d2 tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a.847d0c50-5028-46b7-aaec-bc184719975a 1G" returned: 0 in 0.599s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d7295b13-f534-4424-9bbd-42e0681ba5d2 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66c4391a-02de-475a-9950-ab3b1f95e65a -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a.847d0c50-5028-46b7-aaec-bc184719975a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:19 devstack sudo[95424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66c4391a-02de-475a-9950-ab3b1f95e65a -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a.847d0c50-5028-46b7-aaec-bc184719975a
Nov 05 19:13:19 devstack sudo[95424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:19 devstack sudo[95424]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d7295b13-f534-4424-9bbd-42e0681ba5d2 tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66c4391a-02de-475a-9950-ab3b1f95e65a -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a.847d0c50-5028-46b7-aaec-bc184719975a" returned: 0 in 0.340s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:19 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-d7295b13-f534-4424-9bbd-42e0681ba5d2 tempest-GroupSnapshotsTest-1971566374 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a.847d0c50-5028-46b7-aaec-bc184719975a is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 19:13:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d7295b13-f534-4424-9bbd-42e0681ba5d2 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a.847d0c50-5028-46b7-aaec-bc184719975a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:19 devstack sudo[95429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a.847d0c50-5028-46b7-aaec-bc184719975a
Nov 05 19:13:19 devstack sudo[95429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:19 devstack sudo[95429]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d7295b13-f534-4424-9bbd-42e0681ba5d2 tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a.847d0c50-5028-46b7-aaec-bc184719975a" returned: 0 in 0.349s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d7295b13-f534-4424-9bbd-42e0681ba5d2 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:19 devstack sudo[95432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a.info
Nov 05 19:13:19 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:20 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d7295b13-f534-4424-9bbd-42e0681ba5d2 tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a.info" returned: 0 in 0.430s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:20 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-d7295b13-f534-4424-9bbd-42e0681ba5d2 tempest-GroupSnapshotsTest-1971566374 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 19:13:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d7295b13-f534-4424-9bbd-42e0681ba5d2 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:20 devstack sudo[95444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a.info
Nov 05 19:13:20 devstack sudo[95444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:20 devstack sudo[95444]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d7295b13-f534-4424-9bbd-42e0681ba5d2 tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a.info" returned: 0 in 0.492s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d7295b13-f534-4424-9bbd-42e0681ba5d2 tempest-GroupSnapshotsTest-1971566374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.909s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:13:20 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=159,cinder:INSERT=45,cinder:UPDATE=186,cinder:DELETE=7 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:13:20 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=180,cinder:UPDATE=168,cinder:DELETE=11,cinder:INSERT=48 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:13:20 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-d7295b13-f534-4424-9bbd-42e0681ba5d2 tempest-GroupSnapshotsTest-1971566374 None] group_snapshot 49aae31d-6a17-458d-b56f-38ddcfa7d6ba: created successfully
Nov 05 19:13:21 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-02a0a267-3af9-49d7-b2eb-64d44f0ee9c5 tempest-GroupSnapshotsTest-1971566374 None] group_snapshot 49aae31d-6a17-458d-b56f-38ddcfa7d6ba: deleting
Nov 05 19:13:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-02a0a267-3af9-49d7-b2eb-64d44f0ee9c5 tempest-GroupSnapshotsTest-1971566374 None] group_snapshot 49aae31d-6a17-458d-b56f-38ddcfa7d6ba: deleting {{(pid=87184) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 05 19:13:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-02a0a267-3af9-49d7-b2eb-64d44f0ee9c5 tempest-GroupSnapshotsTest-1971566374 None] Acquiring lock "cinder-quobyte-66c4391a-02de-475a-9950-ab3b1f95e65a" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:13:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-02a0a267-3af9-49d7-b2eb-64d44f0ee9c5 tempest-GroupSnapshotsTest-1971566374 None] Lock "cinder-quobyte-66c4391a-02de-475a-9950-ab3b1f95e65a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:13:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-02a0a267-3af9-49d7-b2eb-64d44f0ee9c5 tempest-GroupSnapshotsTest-1971566374 None] Acquiring lock "cinder-quobyte-847d0c50-5028-46b7-aaec-bc184719975a" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:13:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-02a0a267-3af9-49d7-b2eb-64d44f0ee9c5 tempest-GroupSnapshotsTest-1971566374 None] Lock "cinder-quobyte-847d0c50-5028-46b7-aaec-bc184719975a" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:13:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-02a0a267-3af9-49d7-b2eb-64d44f0ee9c5 tempest-GroupSnapshotsTest-1971566374 None] Deleting offline snapshot 847d0c50-5028-46b7-aaec-bc184719975a of volume 66c4391a-02de-475a-9950-ab3b1f95e65a {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:13:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-02a0a267-3af9-49d7-b2eb-64d44f0ee9c5 tempest-GroupSnapshotsTest-1971566374 None] snapshot_file for this snap is: volume-66c4391a-02de-475a-9950-ab3b1f95e65a.847d0c50-5028-46b7-aaec-bc184719975a {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:13:21 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df7b096-5e51-49ff-8d56-fea897c66c87]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:13:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-02a0a267-3af9-49d7-b2eb-64d44f0ee9c5 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a.847d0c50-5028-46b7-aaec-bc184719975a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:21 devstack sudo[95460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a.847d0c50-5028-46b7-aaec-bc184719975a
Nov 05 19:13:21 devstack sudo[95460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:22 devstack sudo[95460]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-02a0a267-3af9-49d7-b2eb-64d44f0ee9c5 tempest-GroupSnapshotsTest-1971566374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a.847d0c50-5028-46b7-aaec-bc184719975a" returned: 0 in 0.482s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-02a0a267-3af9-49d7-b2eb-64d44f0ee9c5 tempest-GroupSnapshotsTest-1971566374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66c4391a-02de-475a-9950-ab3b1f95e65a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:13:22 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e93bbb-78da-4168-af7a-6eeb1bb750ee]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:13:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-02a0a267-3af9-49d7-b2eb-64d44f0ee9c5 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:22 devstack sudo[95466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a
Nov 05 19:13:22 devstack sudo[95466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:22 devstack sudo[95466]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-02a0a267-3af9-49d7-b2eb-64d44f0ee9c5 tempest-GroupSnapshotsTest-1971566374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a" returned: 0 in 0.596s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-02a0a267-3af9-49d7-b2eb-64d44f0ee9c5 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a.847d0c50-5028-46b7-aaec-bc184719975a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:22 devstack sudo[95471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a.847d0c50-5028-46b7-aaec-bc184719975a
Nov 05 19:13:22 devstack sudo[95471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:23 devstack sudo[95471]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-02a0a267-3af9-49d7-b2eb-64d44f0ee9c5 tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a.847d0c50-5028-46b7-aaec-bc184719975a" returned: 0 in 0.460s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-02a0a267-3af9-49d7-b2eb-64d44f0ee9c5 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a.847d0c50-5028-46b7-aaec-bc184719975a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:23 devstack sudo[95476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a.847d0c50-5028-46b7-aaec-bc184719975a
Nov 05 19:13:23 devstack sudo[95476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:23 devstack sudo[95476]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-02a0a267-3af9-49d7-b2eb-64d44f0ee9c5 tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a.847d0c50-5028-46b7-aaec-bc184719975a" returned: 0 in 0.405s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:23 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-02a0a267-3af9-49d7-b2eb-64d44f0ee9c5 tempest-GroupSnapshotsTest-1971566374 None] Lock "cinder-quobyte-847d0c50-5028-46b7-aaec-bc184719975a" released by "_delete_snapshot" :: held 2.141s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:13:23 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-02a0a267-3af9-49d7-b2eb-64d44f0ee9c5 tempest-GroupSnapshotsTest-1971566374 None] Lock "cinder-quobyte-66c4391a-02de-475a-9950-ab3b1f95e65a" released by "delete_snapshot" :: held 2.186s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:13:23 devstack cinder-volume[87184]: WARNING cinder.quota [None req-02a0a267-3af9-49d7-b2eb-64d44f0ee9c5 tempest-GroupSnapshotsTest-1971566374 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-806128410 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-806128410, it is now deprecated. Please use the default quota class for default quota.
Nov 05 19:13:23 devstack cinder-volume[87184]: WARNING cinder.quota [None req-02a0a267-3af9-49d7-b2eb-64d44f0ee9c5 tempest-GroupSnapshotsTest-1971566374 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-806128410 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-806128410, it is now deprecated. Please use the default quota class for default quota.
Nov 05 19:13:23 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-02a0a267-3af9-49d7-b2eb-64d44f0ee9c5 tempest-GroupSnapshotsTest-1971566374 None] Created reservations ['88286065-3b57-468e-9934-6ce6c148d465', '39f0b217-e956-4478-871b-f8904d5ecae4', 'b24f46d0-becc-4b9e-9848-91689a2541f2', '1bc34732-ba60-4bc7-a9b0-c7a84c7e83df'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:13:23 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-02a0a267-3af9-49d7-b2eb-64d44f0ee9c5 tempest-GroupSnapshotsTest-1971566374 None] group_snapshot 49aae31d-6a17-458d-b56f-38ddcfa7d6ba: deleted successfully
Nov 05 19:13:25 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7db23954-12c5-4762-82e7-73ae77d9d406 tempest-GroupSnapshotsTest-1971566374 None] Acquiring lock "cinder-quobyte-66c4391a-02de-475a-9950-ab3b1f95e65a" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:13:25 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7db23954-12c5-4762-82e7-73ae77d9d406 tempest-GroupSnapshotsTest-1971566374 None] Lock "cinder-quobyte-66c4391a-02de-475a-9950-ab3b1f95e65a" acquired by "delete_volume" :: waited 0.027s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:13:25 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef995a9-65fa-4ba7-bfaa-75987a3b4cf9]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:13:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7db23954-12c5-4762-82e7-73ae77d9d406 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:25 devstack sudo[95479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a
Nov 05 19:13:25 devstack sudo[95479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:25 devstack sudo[95479]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7db23954-12c5-4762-82e7-73ae77d9d406 tempest-GroupSnapshotsTest-1971566374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a" returned: 0 in 0.531s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7db23954-12c5-4762-82e7-73ae77d9d406 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:25 devstack sudo[95484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a
Nov 05 19:13:25 devstack sudo[95484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:26 devstack sudo[95484]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7db23954-12c5-4762-82e7-73ae77d9d406 tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-66c4391a-02de-475a-9950-ab3b1f95e65a" returned: 0 in 0.288s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7db23954-12c5-4762-82e7-73ae77d9d406 tempest-GroupSnapshotsTest-1971566374 None] Lock "cinder-quobyte-66c4391a-02de-475a-9950-ab3b1f95e65a" released by "delete_volume" :: held 0.920s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:13:26 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-7db23954-12c5-4762-82e7-73ae77d9d406 tempest-GroupSnapshotsTest-1971566374 None] Created reservations ['0ee24c4e-557c-4a3f-969a-6102ce4cefdd'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:13:26 devstack cinder-volume[87184]: WARNING cinder.quota [None req-7db23954-12c5-4762-82e7-73ae77d9d406 tempest-GroupSnapshotsTest-1971566374 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-806128410 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-806128410, it is now deprecated. Please use the default quota class for default quota.
Nov 05 19:13:26 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-7db23954-12c5-4762-82e7-73ae77d9d406 tempest-GroupSnapshotsTest-1971566374 None] Created reservations ['1a7de9a9-e6ba-4cd1-b051-e060ba4958d5', '2609dc2c-db79-407f-a574-d67da5e67d21', 'f23ce1a4-c62e-4890-a32b-13dc39919b8b', 'cca54975-6f54-465e-b99a-677fcf0c5731'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:13:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7db23954-12c5-4762-82e7-73ae77d9d406 tempest-GroupSnapshotsTest-1971566374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:13:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7db23954-12c5-4762-82e7-73ae77d9d406 tempest-GroupSnapshotsTest-1971566374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:13:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7db23954-12c5-4762-82e7-73ae77d9d406 tempest-GroupSnapshotsTest-1971566374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:13:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7db23954-12c5-4762-82e7-73ae77d9d406 tempest-GroupSnapshotsTest-1971566374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:13:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7db23954-12c5-4762-82e7-73ae77d9d406 tempest-GroupSnapshotsTest-1971566374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:13:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7db23954-12c5-4762-82e7-73ae77d9d406 tempest-GroupSnapshotsTest-1971566374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:26 devstack sudo[95487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:13:26 devstack sudo[95487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:26 devstack sudo[95487]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7db23954-12c5-4762-82e7-73ae77d9d406 tempest-GroupSnapshotsTest-1971566374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.317s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:26 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-7db23954-12c5-4762-82e7-73ae77d9d406 tempest-GroupSnapshotsTest-1971566374 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:13:26 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-7db23954-12c5-4762-82e7-73ae77d9d406 tempest-GroupSnapshotsTest-1971566374 None] Delete group completed successfully.
Nov 05 19:13:36 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b3cbf07-bdef-41ca-9873-8493ebfd6bfa tempest-VolumesSnapshotTestJSON-1250160096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:13:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6b3cbf07-bdef-41ca-9873-8493ebfd6bfa tempest-VolumesSnapshotTestJSON-1250160096 None] Flow 'volume_create_manager' (f6b2a793-696d-47bc-a53c-88e8c5005cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:13:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6b3cbf07-bdef-41ca-9873-8493ebfd6bfa tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d25f7fca-f9f1-4882-bf29-ffd46bc6c9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6b3cbf07-bdef-41ca-9873-8493ebfd6bfa tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d25f7fca-f9f1-4882-bf29-ffd46bc6c9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-362831251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcaab0c0-adb7-4e69-848f-4915bc93410b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2f776d18f5e4d06accc37697484a770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:13:37Z,use_quota=True,user_id='c4be2d0faca24936a7799988f3d60760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6b3cbf07-bdef-41ca-9873-8493ebfd6bfa tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f514bae-27d6-483b-b357-7b5a9d047a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6b3cbf07-bdef-41ca-9873-8493ebfd6bfa tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f514bae-27d6-483b-b357-7b5a9d047a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6b3cbf07-bdef-41ca-9873-8493ebfd6bfa tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8db453d-6847-4ffd-9f7a-ff3cb4ee8e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6b3cbf07-bdef-41ca-9873-8493ebfd6bfa tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8db453d-6847-4ffd-9f7a-ff3cb4ee8e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcaab0c0-adb7-4e69-848f-4915bc93410b', 'volume_name': 'volume-fcaab0c0-adb7-4e69-848f-4915bc93410b', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6b3cbf07-bdef-41ca-9873-8493ebfd6bfa tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0c6cb85-03a9-41da-9ca4-5b475ca5943a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6b3cbf07-bdef-41ca-9873-8493ebfd6bfa tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0c6cb85-03a9-41da-9ca4-5b475ca5943a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6b3cbf07-bdef-41ca-9873-8493ebfd6bfa tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b65f764a-4acc-45fe-9fa7-b1b7249b75b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:36 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-6b3cbf07-bdef-41ca-9873-8493ebfd6bfa tempest-VolumesSnapshotTestJSON-1250160096 None] Volume fcaab0c0-adb7-4e69-848f-4915bc93410b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcaab0c0-adb7-4e69-848f-4915bc93410b', 'volume_size': 1}
Nov 05 19:13:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6b3cbf07-bdef-41ca-9873-8493ebfd6bfa tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:13:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6b3cbf07-bdef-41ca-9873-8493ebfd6bfa tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:13:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6b3cbf07-bdef-41ca-9873-8493ebfd6bfa tempest-VolumesSnapshotTestJSON-1250160096 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-362831251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcaab0c0-adb7-4e69-848f-4915bc93410b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2f776d18f5e4d06accc37697484a770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:13:37Z,use_quota=True,user_id='c4be2d0faca24936a7799988f3d60760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:13:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-6b3cbf07-bdef-41ca-9873-8493ebfd6bfa tempest-VolumesSnapshotTestJSON-1250160096 None] Creating volume fcaab0c0-adb7-4e69-848f-4915bc93410b {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:13:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6b3cbf07-bdef-41ca-9873-8493ebfd6bfa tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:13:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6b3cbf07-bdef-41ca-9873-8493ebfd6bfa tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:13:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6b3cbf07-bdef-41ca-9873-8493ebfd6bfa tempest-VolumesSnapshotTestJSON-1250160096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:13:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6b3cbf07-bdef-41ca-9873-8493ebfd6bfa tempest-VolumesSnapshotTestJSON-1250160096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:13:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6b3cbf07-bdef-41ca-9873-8493ebfd6bfa tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:13:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6b3cbf07-bdef-41ca-9873-8493ebfd6bfa tempest-VolumesSnapshotTestJSON-1250160096 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:13:36 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-6b3cbf07-bdef-41ca-9873-8493ebfd6bfa tempest-VolumesSnapshotTestJSON-1250160096 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:13:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6b3cbf07-bdef-41ca-9873-8493ebfd6bfa tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:36 devstack sudo[95514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b 1073741824
Nov 05 19:13:36 devstack sudo[95514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:37 devstack sudo[95514]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6b3cbf07-bdef-41ca-9873-8493ebfd6bfa tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b 1073741824" returned: 0 in 0.712s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6b3cbf07-bdef-41ca-9873-8493ebfd6bfa tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:37 devstack sudo[95523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b
Nov 05 19:13:37 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:37 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6b3cbf07-bdef-41ca-9873-8493ebfd6bfa tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b" returned: 0 in 0.421s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6b3cbf07-bdef-41ca-9873-8493ebfd6bfa tempest-VolumesSnapshotTestJSON-1250160096 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:13:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6b3cbf07-bdef-41ca-9873-8493ebfd6bfa tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:13:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6b3cbf07-bdef-41ca-9873-8493ebfd6bfa tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b65f764a-4acc-45fe-9fa7-b1b7249b75b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcaab0c0-adb7-4e69-848f-4915bc93410b', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6b3cbf07-bdef-41ca-9873-8493ebfd6bfa tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3984f60d-9e11-459a-b616-a99a1bad6212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:37 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-6b3cbf07-bdef-41ca-9873-8493ebfd6bfa tempest-VolumesSnapshotTestJSON-1250160096 None] Volume volume-fcaab0c0-adb7-4e69-848f-4915bc93410b (fcaab0c0-adb7-4e69-848f-4915bc93410b): created successfully
Nov 05 19:13:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6b3cbf07-bdef-41ca-9873-8493ebfd6bfa tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3984f60d-9e11-459a-b616-a99a1bad6212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6b3cbf07-bdef-41ca-9873-8493ebfd6bfa tempest-VolumesSnapshotTestJSON-1250160096 None] Flow 'volume_create_manager' (f6b2a793-696d-47bc-a53c-88e8c5005cf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:13:38 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-6b3cbf07-bdef-41ca-9873-8493ebfd6bfa tempest-VolumesSnapshotTestJSON-1250160096 None] Created volume successfully.
Nov 05 19:13:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3237fc21-5845-45cf-91d9-87b0f070f762 tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:13:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3237fc21-5845-45cf-91d9-87b0f070f762 tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:13:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-3237fc21-5845-45cf-91d9-87b0f070f762 tempest-VolumesSnapshotTestJSON-1250160096 None] Creating offline snapshot 4c56bcf9-11a8-408a-b844-5929ae37366e of volume fcaab0c0-adb7-4e69-848f-4915bc93410b {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:13:39 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab564d6a-e08d-4f34-bdf1-9afeb1a3d9f9]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:13:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3237fc21-5845-45cf-91d9-87b0f070f762 tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:40 devstack sudo[95600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b
Nov 05 19:13:40 devstack sudo[95600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:40 devstack sudo[95600]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3237fc21-5845-45cf-91d9-87b0f070f762 tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b" returned: 0 in 0.720s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3237fc21-5845-45cf-91d9-87b0f070f762 tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b.4c56bcf9-11a8-408a-b844-5929ae37366e 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:40 devstack sudo[95609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b.4c56bcf9-11a8-408a-b844-5929ae37366e 1G
Nov 05 19:13:40 devstack sudo[95609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:41 devstack sudo[95609]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3237fc21-5845-45cf-91d9-87b0f070f762 tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b.4c56bcf9-11a8-408a-b844-5929ae37366e 1G" returned: 0 in 0.906s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3237fc21-5845-45cf-91d9-87b0f070f762 tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcaab0c0-adb7-4e69-848f-4915bc93410b -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b.4c56bcf9-11a8-408a-b844-5929ae37366e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:41 devstack sudo[95614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcaab0c0-adb7-4e69-848f-4915bc93410b -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b.4c56bcf9-11a8-408a-b844-5929ae37366e
Nov 05 19:13:41 devstack sudo[95614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:41 devstack sudo[95614]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3237fc21-5845-45cf-91d9-87b0f070f762 tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcaab0c0-adb7-4e69-848f-4915bc93410b -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b.4c56bcf9-11a8-408a-b844-5929ae37366e" returned: 0 in 0.433s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:41 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-3237fc21-5845-45cf-91d9-87b0f070f762 tempest-VolumesSnapshotTestJSON-1250160096 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b.4c56bcf9-11a8-408a-b844-5929ae37366e is being set with open permissions: ugo+rw
Nov 05 19:13:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3237fc21-5845-45cf-91d9-87b0f070f762 tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b.4c56bcf9-11a8-408a-b844-5929ae37366e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:42 devstack sudo[95619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b.4c56bcf9-11a8-408a-b844-5929ae37366e
Nov 05 19:13:42 devstack sudo[95619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:42 devstack sudo[95619]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3237fc21-5845-45cf-91d9-87b0f070f762 tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b.4c56bcf9-11a8-408a-b844-5929ae37366e" returned: 0 in 0.522s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3237fc21-5845-45cf-91d9-87b0f070f762 tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:42 devstack sudo[95622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b.info
Nov 05 19:13:42 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:43 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3237fc21-5845-45cf-91d9-87b0f070f762 tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b.info" returned: 0 in 0.529s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:43 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-3237fc21-5845-45cf-91d9-87b0f070f762 tempest-VolumesSnapshotTestJSON-1250160096 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b.info is being set with open permissions: ugo+rw
Nov 05 19:13:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3237fc21-5845-45cf-91d9-87b0f070f762 tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:43 devstack sudo[95625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b.info
Nov 05 19:13:43 devstack sudo[95625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:43 devstack sudo[95625]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3237fc21-5845-45cf-91d9-87b0f070f762 tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b.info" returned: 0 in 0.660s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3237fc21-5845-45cf-91d9-87b0f070f762 tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.951s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:13:43 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-3237fc21-5845-45cf-91d9-87b0f070f762 tempest-VolumesSnapshotTestJSON-1250160096 None] Create snapshot completed successfully
Nov 05 19:13:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8d0bec93-1b73-416b-9734-e12fc3300564 tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "cinder-4c56bcf9-11a8-408a-b844-5929ae37366e-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:13:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8d0bec93-1b73-416b-9734-e12fc3300564 tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-4c56bcf9-11a8-408a-b844-5929ae37366e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:13:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8d0bec93-1b73-416b-9734-e12fc3300564 tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "cinder-quobyte-fcaab0c0-adb7-4e69-848f-4915bc93410b" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:13:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8d0bec93-1b73-416b-9734-e12fc3300564 tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-quobyte-fcaab0c0-adb7-4e69-848f-4915bc93410b" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:13:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8d0bec93-1b73-416b-9734-e12fc3300564 tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "cinder-quobyte-4c56bcf9-11a8-408a-b844-5929ae37366e" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:13:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8d0bec93-1b73-416b-9734-e12fc3300564 tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-quobyte-4c56bcf9-11a8-408a-b844-5929ae37366e" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:13:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-8d0bec93-1b73-416b-9734-e12fc3300564 tempest-VolumesSnapshotTestJSON-1250160096 None] Deleting offline snapshot 4c56bcf9-11a8-408a-b844-5929ae37366e of volume fcaab0c0-adb7-4e69-848f-4915bc93410b {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:13:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-8d0bec93-1b73-416b-9734-e12fc3300564 tempest-VolumesSnapshotTestJSON-1250160096 None] snapshot_file for this snap is: volume-fcaab0c0-adb7-4e69-848f-4915bc93410b.4c56bcf9-11a8-408a-b844-5929ae37366e {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:13:44 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f073832e-8049-4ba1-ad51-3abac9b12430]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:13:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8d0bec93-1b73-416b-9734-e12fc3300564 tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b.4c56bcf9-11a8-408a-b844-5929ae37366e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:44 devstack sudo[95666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b.4c56bcf9-11a8-408a-b844-5929ae37366e
Nov 05 19:13:44 devstack sudo[95666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:45 devstack sudo[95666]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8d0bec93-1b73-416b-9734-e12fc3300564 tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b.4c56bcf9-11a8-408a-b844-5929ae37366e" returned: 0 in 0.660s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-8d0bec93-1b73-416b-9734-e12fc3300564 tempest-VolumesSnapshotTestJSON-1250160096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fcaab0c0-adb7-4e69-848f-4915bc93410b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:13:45 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de269fa-2659-41d6-ad33-1d356255a55a]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:13:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8d0bec93-1b73-416b-9734-e12fc3300564 tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:45 devstack sudo[95671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b
Nov 05 19:13:45 devstack sudo[95671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:45 devstack sudo[95671]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8d0bec93-1b73-416b-9734-e12fc3300564 tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b" returned: 0 in 0.543s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8d0bec93-1b73-416b-9734-e12fc3300564 tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b.4c56bcf9-11a8-408a-b844-5929ae37366e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:45 devstack sudo[95676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b.4c56bcf9-11a8-408a-b844-5929ae37366e
Nov 05 19:13:45 devstack sudo[95676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:46 devstack sudo[95676]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8d0bec93-1b73-416b-9734-e12fc3300564 tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b.4c56bcf9-11a8-408a-b844-5929ae37366e" returned: 0 in 0.513s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8d0bec93-1b73-416b-9734-e12fc3300564 tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b.4c56bcf9-11a8-408a-b844-5929ae37366e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:46 devstack sudo[95685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b.4c56bcf9-11a8-408a-b844-5929ae37366e
Nov 05 19:13:46 devstack sudo[95685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:46 devstack sudo[95685]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8d0bec93-1b73-416b-9734-e12fc3300564 tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b.4c56bcf9-11a8-408a-b844-5929ae37366e" returned: 0 in 0.343s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:46 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8d0bec93-1b73-416b-9734-e12fc3300564 tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-quobyte-4c56bcf9-11a8-408a-b844-5929ae37366e" released by "_delete_snapshot" :: held 2.226s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:13:46 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8d0bec93-1b73-416b-9734-e12fc3300564 tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-quobyte-fcaab0c0-adb7-4e69-848f-4915bc93410b" released by "delete_snapshot" :: held 2.275s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:13:46 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-8d0bec93-1b73-416b-9734-e12fc3300564 tempest-VolumesSnapshotTestJSON-1250160096 None] Created reservations ['24c30a13-6653-4de0-9f54-58c9955f15fa', '1da20904-68ab-437b-82b4-f574406388cb', 'a6d11d6e-5e55-48b5-b3d2-3c66c6f9be9d', '7cafa887-517d-455e-877f-439da147f0e5'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:13:46 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-8d0bec93-1b73-416b-9734-e12fc3300564 tempest-VolumesSnapshotTestJSON-1250160096 None] Delete snapshot completed successfully.
Nov 05 19:13:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8d0bec93-1b73-416b-9734-e12fc3300564 tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-4c56bcf9-11a8-408a-b844-5929ae37366e-delete_snapshot" released by "delete_snapshot" :: held 2.492s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-f20e64ca-efd1-4b16-bf69-94f6f78a0b75 tempest-SnapshotsActionsTest-1023533080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f20e64ca-efd1-4b16-bf69-94f6f78a0b75 tempest-SnapshotsActionsTest-1023533080 None] Flow 'volume_create_manager' (da545637-14bd-4ca5-a3e7-9532f4aa854d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f20e64ca-efd1-4b16-bf69-94f6f78a0b75 tempest-SnapshotsActionsTest-1023533080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (881022f6-9769-4746-9c12-243b07e7a974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f20e64ca-efd1-4b16-bf69-94f6f78a0b75 tempest-SnapshotsActionsTest-1023533080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (881022f6-9769-4746-9c12-243b07e7a974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1437830100',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ea23a53-8ebf-495d-91ca-dd13f63e9516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7392c77d3a28480793f7bb059c565377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:13:48Z,use_quota=True,user_id='3c9a44fd09c54131a9b99a20eb62db60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f20e64ca-efd1-4b16-bf69-94f6f78a0b75 tempest-SnapshotsActionsTest-1023533080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8228f2d-12c9-4fb2-85aa-5c2af9f86c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f20e64ca-efd1-4b16-bf69-94f6f78a0b75 tempest-SnapshotsActionsTest-1023533080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8228f2d-12c9-4fb2-85aa-5c2af9f86c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f20e64ca-efd1-4b16-bf69-94f6f78a0b75 tempest-SnapshotsActionsTest-1023533080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d01c116e-1d6a-4677-ae25-cea68e85d758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f20e64ca-efd1-4b16-bf69-94f6f78a0b75 tempest-SnapshotsActionsTest-1023533080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d01c116e-1d6a-4677-ae25-cea68e85d758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ea23a53-8ebf-495d-91ca-dd13f63e9516', 'volume_name': 'volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f20e64ca-efd1-4b16-bf69-94f6f78a0b75 tempest-SnapshotsActionsTest-1023533080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98ca8dfa-3873-441f-b9f7-62684a123c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f20e64ca-efd1-4b16-bf69-94f6f78a0b75 tempest-SnapshotsActionsTest-1023533080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98ca8dfa-3873-441f-b9f7-62684a123c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f20e64ca-efd1-4b16-bf69-94f6f78a0b75 tempest-SnapshotsActionsTest-1023533080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e90fbcf-c531-4c48-a8dc-8a0ea5257dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:48 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-f20e64ca-efd1-4b16-bf69-94f6f78a0b75 tempest-SnapshotsActionsTest-1023533080 None] Volume 0ea23a53-8ebf-495d-91ca-dd13f63e9516: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516', 'volume_size': 1}
Nov 05 19:13:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f20e64ca-efd1-4b16-bf69-94f6f78a0b75 tempest-SnapshotsActionsTest-1023533080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:13:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f20e64ca-efd1-4b16-bf69-94f6f78a0b75 tempest-SnapshotsActionsTest-1023533080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f20e64ca-efd1-4b16-bf69-94f6f78a0b75 tempest-SnapshotsActionsTest-1023533080 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1437830100',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ea23a53-8ebf-495d-91ca-dd13f63e9516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7392c77d3a28480793f7bb059c565377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:13:48Z,use_quota=True,user_id='3c9a44fd09c54131a9b99a20eb62db60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-f20e64ca-efd1-4b16-bf69-94f6f78a0b75 tempest-SnapshotsActionsTest-1023533080 None] Creating volume 0ea23a53-8ebf-495d-91ca-dd13f63e9516 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:13:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f20e64ca-efd1-4b16-bf69-94f6f78a0b75 tempest-SnapshotsActionsTest-1023533080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:13:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f20e64ca-efd1-4b16-bf69-94f6f78a0b75 tempest-SnapshotsActionsTest-1023533080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f20e64ca-efd1-4b16-bf69-94f6f78a0b75 tempest-SnapshotsActionsTest-1023533080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f20e64ca-efd1-4b16-bf69-94f6f78a0b75 tempest-SnapshotsActionsTest-1023533080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:13:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f20e64ca-efd1-4b16-bf69-94f6f78a0b75 tempest-SnapshotsActionsTest-1023533080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f20e64ca-efd1-4b16-bf69-94f6f78a0b75 tempest-SnapshotsActionsTest-1023533080 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:13:48 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-f20e64ca-efd1-4b16-bf69-94f6f78a0b75 tempest-SnapshotsActionsTest-1023533080 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:13:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f20e64ca-efd1-4b16-bf69-94f6f78a0b75 tempest-SnapshotsActionsTest-1023533080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:48 devstack sudo[95690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516 1073741824
Nov 05 19:13:48 devstack sudo[95690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-929f623a-b428-40e5-a79b-0ef7075fad89 tempest-VolumesSnapshotTestJSON-1250160096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-929f623a-b428-40e5-a79b-0ef7075fad89 tempest-VolumesSnapshotTestJSON-1250160096 None] Flow 'volume_create_manager' (f7c6a625-ea09-4d8c-80b1-9e3d568fbc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-929f623a-b428-40e5-a79b-0ef7075fad89 tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f9d369-d2c9-4c57-8a46-154d798c52c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-929f623a-b428-40e5-a79b-0ef7075fad89 tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f9d369-d2c9-4c57-8a46-154d798c52c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-108482835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52737dfe-f0a1-4b51-9ad3-60f32909d94a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2f776d18f5e4d06accc37697484a770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:13:49Z,use_quota=True,user_id='c4be2d0faca24936a7799988f3d60760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-929f623a-b428-40e5-a79b-0ef7075fad89 tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58c7aed8-4af2-415f-9541-180705eb24d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-929f623a-b428-40e5-a79b-0ef7075fad89 tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58c7aed8-4af2-415f-9541-180705eb24d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-929f623a-b428-40e5-a79b-0ef7075fad89 tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b141c55d-0589-414f-ac2b-4059f024e285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-929f623a-b428-40e5-a79b-0ef7075fad89 tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b141c55d-0589-414f-ac2b-4059f024e285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52737dfe-f0a1-4b51-9ad3-60f32909d94a', 'volume_name': 'volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-929f623a-b428-40e5-a79b-0ef7075fad89 tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb7fc062-6410-4d2b-9e92-af8e4192a04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-929f623a-b428-40e5-a79b-0ef7075fad89 tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb7fc062-6410-4d2b-9e92-af8e4192a04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-929f623a-b428-40e5-a79b-0ef7075fad89 tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1c028bf-56cb-45cb-851f-edc9379df34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:48 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-929f623a-b428-40e5-a79b-0ef7075fad89 tempest-VolumesSnapshotTestJSON-1250160096 None] Volume 52737dfe-f0a1-4b51-9ad3-60f32909d94a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a', 'volume_size': 1}
Nov 05 19:13:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-929f623a-b428-40e5-a79b-0ef7075fad89 tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:13:49 devstack sudo[95690]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f20e64ca-efd1-4b16-bf69-94f6f78a0b75 tempest-SnapshotsActionsTest-1023533080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516 1073741824" returned: 0 in 0.672s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f20e64ca-efd1-4b16-bf69-94f6f78a0b75 tempest-SnapshotsActionsTest-1023533080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:49 devstack sudo[95696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516
Nov 05 19:13:49 devstack sudo[95696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:49 devstack sudo[95696]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f20e64ca-efd1-4b16-bf69-94f6f78a0b75 tempest-SnapshotsActionsTest-1023533080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516" returned: 0 in 0.255s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f20e64ca-efd1-4b16-bf69-94f6f78a0b75 tempest-SnapshotsActionsTest-1023533080 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:13:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f20e64ca-efd1-4b16-bf69-94f6f78a0b75 tempest-SnapshotsActionsTest-1023533080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:13:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-929f623a-b428-40e5-a79b-0ef7075fad89 tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.539s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-929f623a-b428-40e5-a79b-0ef7075fad89 tempest-VolumesSnapshotTestJSON-1250160096 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-108482835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52737dfe-f0a1-4b51-9ad3-60f32909d94a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2f776d18f5e4d06accc37697484a770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:13:49Z,use_quota=True,user_id='c4be2d0faca24936a7799988f3d60760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-929f623a-b428-40e5-a79b-0ef7075fad89 tempest-VolumesSnapshotTestJSON-1250160096 None] Creating volume 52737dfe-f0a1-4b51-9ad3-60f32909d94a {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:13:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-929f623a-b428-40e5-a79b-0ef7075fad89 tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:13:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-929f623a-b428-40e5-a79b-0ef7075fad89 tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-929f623a-b428-40e5-a79b-0ef7075fad89 tempest-VolumesSnapshotTestJSON-1250160096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-929f623a-b428-40e5-a79b-0ef7075fad89 tempest-VolumesSnapshotTestJSON-1250160096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:13:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-929f623a-b428-40e5-a79b-0ef7075fad89 tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-929f623a-b428-40e5-a79b-0ef7075fad89 tempest-VolumesSnapshotTestJSON-1250160096 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:13:49 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-929f623a-b428-40e5-a79b-0ef7075fad89 tempest-VolumesSnapshotTestJSON-1250160096 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:13:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-929f623a-b428-40e5-a79b-0ef7075fad89 tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:49 devstack sudo[95699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a 1073741824
Nov 05 19:13:49 devstack sudo[95699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f20e64ca-efd1-4b16-bf69-94f6f78a0b75 tempest-SnapshotsActionsTest-1023533080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e90fbcf-c531-4c48-a8dc-8a0ea5257dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f20e64ca-efd1-4b16-bf69-94f6f78a0b75 tempest-SnapshotsActionsTest-1023533080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59f97748-955a-4611-94d8-15c266fd0f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:49 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-f20e64ca-efd1-4b16-bf69-94f6f78a0b75 tempest-SnapshotsActionsTest-1023533080 None] Volume volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516 (0ea23a53-8ebf-495d-91ca-dd13f63e9516): created successfully
Nov 05 19:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f20e64ca-efd1-4b16-bf69-94f6f78a0b75 tempest-SnapshotsActionsTest-1023533080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59f97748-955a-4611-94d8-15c266fd0f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f20e64ca-efd1-4b16-bf69-94f6f78a0b75 tempest-SnapshotsActionsTest-1023533080 None] Flow 'volume_create_manager' (da545637-14bd-4ca5-a3e7-9532f4aa854d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:13:49 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f20e64ca-efd1-4b16-bf69-94f6f78a0b75 tempest-SnapshotsActionsTest-1023533080 None] Created volume successfully.
Nov 05 19:13:49 devstack sudo[95699]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-929f623a-b428-40e5-a79b-0ef7075fad89 tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a 1073741824" returned: 0 in 0.578s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-929f623a-b428-40e5-a79b-0ef7075fad89 tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:50 devstack sudo[95704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a
Nov 05 19:13:50 devstack sudo[95704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:50 devstack sudo[95704]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-929f623a-b428-40e5-a79b-0ef7075fad89 tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a" returned: 0 in 0.256s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-929f623a-b428-40e5-a79b-0ef7075fad89 tempest-VolumesSnapshotTestJSON-1250160096 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:13:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-929f623a-b428-40e5-a79b-0ef7075fad89 tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:13:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-929f623a-b428-40e5-a79b-0ef7075fad89 tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1c028bf-56cb-45cb-851f-edc9379df34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-929f623a-b428-40e5-a79b-0ef7075fad89 tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af1340d5-06d2-48c5-a92e-7d94caee98b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:50 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-929f623a-b428-40e5-a79b-0ef7075fad89 tempest-VolumesSnapshotTestJSON-1250160096 None] Volume volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a (52737dfe-f0a1-4b51-9ad3-60f32909d94a): created successfully
Nov 05 19:13:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-929f623a-b428-40e5-a79b-0ef7075fad89 tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af1340d5-06d2-48c5-a92e-7d94caee98b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-929f623a-b428-40e5-a79b-0ef7075fad89 tempest-VolumesSnapshotTestJSON-1250160096 None] Flow 'volume_create_manager' (f7c6a625-ea09-4d8c-80b1-9e3d568fbc55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:13:50 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-929f623a-b428-40e5-a79b-0ef7075fad89 tempest-VolumesSnapshotTestJSON-1250160096 None] Created volume successfully.
Nov 05 19:13:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bb02bdad-1b20-4356-a194-da116828fdf2 tempest-SnapshotsActionsTest-1023533080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:13:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bb02bdad-1b20-4356-a194-da116828fdf2 tempest-SnapshotsActionsTest-1023533080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:13:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-bb02bdad-1b20-4356-a194-da116828fdf2 tempest-SnapshotsActionsTest-1023533080 None] Creating offline snapshot 5f4957d2-3474-4031-a147-63f515179e95 of volume 0ea23a53-8ebf-495d-91ca-dd13f63e9516 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:13:50 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09465ab-6e63-4660-995a-2e954938d3c5]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:13:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bb02bdad-1b20-4356-a194-da116828fdf2 tempest-SnapshotsActionsTest-1023533080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:50 devstack sudo[95707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516
Nov 05 19:13:50 devstack sudo[95707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-37da9a07-eab0-4c96-b94f-863cd5041008 tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:13:51 devstack sudo[95707]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bb02bdad-1b20-4356-a194-da116828fdf2 tempest-SnapshotsActionsTest-1023533080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516" returned: 0 in 0.436s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bb02bdad-1b20-4356-a194-da116828fdf2 tempest-SnapshotsActionsTest-1023533080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:51 devstack sudo[95712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95 1G
Nov 05 19:13:51 devstack sudo[95712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:51 devstack sudo[95712]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bb02bdad-1b20-4356-a194-da116828fdf2 tempest-SnapshotsActionsTest-1023533080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95 1G" returned: 0 in 0.452s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bb02bdad-1b20-4356-a194-da116828fdf2 tempest-SnapshotsActionsTest-1023533080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:51 devstack sudo[95718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95
Nov 05 19:13:51 devstack sudo[95718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:51 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb77326a-1f5d-4f6b-88d5-56858a719b8e tempest-VolumesListAdminTestJSON-251344915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:13:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bb77326a-1f5d-4f6b-88d5-56858a719b8e tempest-VolumesListAdminTestJSON-251344915 None] Flow 'volume_create_manager' (b1fc6653-accd-47c6-8d62-96959ac1731c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:13:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bb77326a-1f5d-4f6b-88d5-56858a719b8e tempest-VolumesListAdminTestJSON-251344915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00cbf143-3d11-4b87-b9fb-ab0ea1831407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bb77326a-1f5d-4f6b-88d5-56858a719b8e tempest-VolumesListAdminTestJSON-251344915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00cbf143-3d11-4b87-b9fb-ab0ea1831407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1659146629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47c34950-f305-4cf3-b918-240c93a00478,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f74a149fbd5041d9bbb6440bb931440a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:13:52Z,use_quota=True,user_id='8ef0fe486ca94cf2a1ff07eb1a14612e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bb77326a-1f5d-4f6b-88d5-56858a719b8e tempest-VolumesListAdminTestJSON-251344915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (014e90b5-7f20-4d59-8d92-af17612201e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bb77326a-1f5d-4f6b-88d5-56858a719b8e tempest-VolumesListAdminTestJSON-251344915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (014e90b5-7f20-4d59-8d92-af17612201e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bb77326a-1f5d-4f6b-88d5-56858a719b8e tempest-VolumesListAdminTestJSON-251344915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d379ac9-5944-4e99-a63d-0d2dbf583245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bb77326a-1f5d-4f6b-88d5-56858a719b8e tempest-VolumesListAdminTestJSON-251344915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d379ac9-5944-4e99-a63d-0d2dbf583245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47c34950-f305-4cf3-b918-240c93a00478', 'volume_name': 'volume-47c34950-f305-4cf3-b918-240c93a00478', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bb77326a-1f5d-4f6b-88d5-56858a719b8e tempest-VolumesListAdminTestJSON-251344915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da9db9f5-3416-44f5-97fe-6d7d0c9a0620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bb77326a-1f5d-4f6b-88d5-56858a719b8e tempest-VolumesListAdminTestJSON-251344915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da9db9f5-3416-44f5-97fe-6d7d0c9a0620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:51 devstack sudo[95718]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bb77326a-1f5d-4f6b-88d5-56858a719b8e tempest-VolumesListAdminTestJSON-251344915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (888ec1a9-39f7-4fa5-9b68-e8d2eee2dac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:51 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-bb77326a-1f5d-4f6b-88d5-56858a719b8e tempest-VolumesListAdminTestJSON-251344915 None] Volume 47c34950-f305-4cf3-b918-240c93a00478: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47c34950-f305-4cf3-b918-240c93a00478', 'volume_size': 1}
Nov 05 19:13:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bb77326a-1f5d-4f6b-88d5-56858a719b8e tempest-VolumesListAdminTestJSON-251344915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:13:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bb02bdad-1b20-4356-a194-da116828fdf2 tempest-SnapshotsActionsTest-1023533080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95" returned: 0 in 0.339s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:51 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-bb02bdad-1b20-4356-a194-da116828fdf2 tempest-SnapshotsActionsTest-1023533080 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95 is being set with open permissions: ugo+rw
Nov 05 19:13:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bb02bdad-1b20-4356-a194-da116828fdf2 tempest-SnapshotsActionsTest-1023533080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:51 devstack sudo[95724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95
Nov 05 19:13:51 devstack sudo[95724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:52 devstack sudo[95724]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bb02bdad-1b20-4356-a194-da116828fdf2 tempest-SnapshotsActionsTest-1023533080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95" returned: 0 in 0.250s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bb02bdad-1b20-4356-a194-da116828fdf2 tempest-SnapshotsActionsTest-1023533080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:52 devstack sudo[95727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.info
Nov 05 19:13:52 devstack sudo[95727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:52 devstack sudo[95727]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bb02bdad-1b20-4356-a194-da116828fdf2 tempest-SnapshotsActionsTest-1023533080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.info" returned: 0 in 0.249s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:52 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-bb02bdad-1b20-4356-a194-da116828fdf2 tempest-SnapshotsActionsTest-1023533080 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.info is being set with open permissions: ugo+rw
Nov 05 19:13:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bb02bdad-1b20-4356-a194-da116828fdf2 tempest-SnapshotsActionsTest-1023533080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:52 devstack sudo[95730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.info
Nov 05 19:13:52 devstack sudo[95730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:52 devstack sudo[95730]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bb02bdad-1b20-4356-a194-da116828fdf2 tempest-SnapshotsActionsTest-1023533080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.info" returned: 0 in 0.266s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bb02bdad-1b20-4356-a194-da116828fdf2 tempest-SnapshotsActionsTest-1023533080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.102s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:13:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-37da9a07-eab0-4c96-b94f-863cd5041008 tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.687s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:13:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-37da9a07-eab0-4c96-b94f-863cd5041008 tempest-VolumesSnapshotTestJSON-1250160096 None] Creating offline snapshot 931b6552-0b12-4360-a757-63c6fae3f654 of volume 52737dfe-f0a1-4b51-9ad3-60f32909d94a {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:13:52 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[046bbaec-764a-4d2b-b12d-acb941b6d213]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:13:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-37da9a07-eab0-4c96-b94f-863cd5041008 tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:52 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-bb02bdad-1b20-4356-a194-da116828fdf2 tempest-SnapshotsActionsTest-1023533080 None] Create snapshot completed successfully
Nov 05 19:13:52 devstack sudo[95733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a
Nov 05 19:13:52 devstack sudo[95733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:53 devstack sudo[95733]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-37da9a07-eab0-4c96-b94f-863cd5041008 tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a" returned: 0 in 0.420s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-37da9a07-eab0-4c96-b94f-863cd5041008 tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a.931b6552-0b12-4360-a757-63c6fae3f654 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:53 devstack sudo[95752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a.931b6552-0b12-4360-a757-63c6fae3f654 1G
Nov 05 19:13:53 devstack sudo[95752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:53 devstack sudo[95752]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-37da9a07-eab0-4c96-b94f-863cd5041008 tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a.931b6552-0b12-4360-a757-63c6fae3f654 1G" returned: 0 in 0.415s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-37da9a07-eab0-4c96-b94f-863cd5041008 tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a.931b6552-0b12-4360-a757-63c6fae3f654 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:53 devstack sudo[95757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a.931b6552-0b12-4360-a757-63c6fae3f654
Nov 05 19:13:53 devstack sudo[95757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:53 devstack sudo[95757]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-37da9a07-eab0-4c96-b94f-863cd5041008 tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a.931b6552-0b12-4360-a757-63c6fae3f654" returned: 0 in 0.306s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:53 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-37da9a07-eab0-4c96-b94f-863cd5041008 tempest-VolumesSnapshotTestJSON-1250160096 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a.931b6552-0b12-4360-a757-63c6fae3f654 is being set with open permissions: ugo+rw
Nov 05 19:13:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-37da9a07-eab0-4c96-b94f-863cd5041008 tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a.931b6552-0b12-4360-a757-63c6fae3f654 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:53 devstack sudo[95762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a.931b6552-0b12-4360-a757-63c6fae3f654
Nov 05 19:13:53 devstack sudo[95762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:54 devstack sudo[95762]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-37da9a07-eab0-4c96-b94f-863cd5041008 tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a.931b6552-0b12-4360-a757-63c6fae3f654" returned: 0 in 0.284s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-37da9a07-eab0-4c96-b94f-863cd5041008 tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:54 devstack sudo[95765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a.info
Nov 05 19:13:54 devstack sudo[95765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0f098f6f-f3a1-4fde-bfad-c64cb705c80e tempest-SnapshotsActionsTest-1023533080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:13:54 devstack sudo[95765]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-37da9a07-eab0-4c96-b94f-863cd5041008 tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a.info" returned: 0 in 0.260s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:54 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-37da9a07-eab0-4c96-b94f-863cd5041008 tempest-VolumesSnapshotTestJSON-1250160096 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a.info is being set with open permissions: ugo+rw
Nov 05 19:13:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-37da9a07-eab0-4c96-b94f-863cd5041008 tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:54 devstack sudo[95768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a.info
Nov 05 19:13:54 devstack sudo[95768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:54 devstack sudo[95768]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-37da9a07-eab0-4c96-b94f-863cd5041008 tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a.info" returned: 0 in 0.243s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-37da9a07-eab0-4c96-b94f-863cd5041008 tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.027s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:13:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bb77326a-1f5d-4f6b-88d5-56858a719b8e tempest-VolumesListAdminTestJSON-251344915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.862s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:13:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bb77326a-1f5d-4f6b-88d5-56858a719b8e tempest-VolumesListAdminTestJSON-251344915 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1659146629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47c34950-f305-4cf3-b918-240c93a00478,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f74a149fbd5041d9bbb6440bb931440a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:13:52Z,use_quota=True,user_id='8ef0fe486ca94cf2a1ff07eb1a14612e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:13:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-bb77326a-1f5d-4f6b-88d5-56858a719b8e tempest-VolumesListAdminTestJSON-251344915 None] Creating volume 47c34950-f305-4cf3-b918-240c93a00478 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:13:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bb77326a-1f5d-4f6b-88d5-56858a719b8e tempest-VolumesListAdminTestJSON-251344915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:13:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bb77326a-1f5d-4f6b-88d5-56858a719b8e tempest-VolumesListAdminTestJSON-251344915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:13:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bb77326a-1f5d-4f6b-88d5-56858a719b8e tempest-VolumesListAdminTestJSON-251344915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:13:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bb77326a-1f5d-4f6b-88d5-56858a719b8e tempest-VolumesListAdminTestJSON-251344915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:13:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bb77326a-1f5d-4f6b-88d5-56858a719b8e tempest-VolumesListAdminTestJSON-251344915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:13:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bb77326a-1f5d-4f6b-88d5-56858a719b8e tempest-VolumesListAdminTestJSON-251344915 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:13:54 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-bb77326a-1f5d-4f6b-88d5-56858a719b8e tempest-VolumesListAdminTestJSON-251344915 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:13:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bb77326a-1f5d-4f6b-88d5-56858a719b8e tempest-VolumesListAdminTestJSON-251344915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-47c34950-f305-4cf3-b918-240c93a00478 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:54 devstack sudo[95771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-47c34950-f305-4cf3-b918-240c93a00478 1073741824
Nov 05 19:13:54 devstack sudo[95771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:54 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-37da9a07-eab0-4c96-b94f-863cd5041008 tempest-VolumesSnapshotTestJSON-1250160096 None] Create snapshot completed successfully
Nov 05 19:13:55 devstack sudo[95771]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bb77326a-1f5d-4f6b-88d5-56858a719b8e tempest-VolumesListAdminTestJSON-251344915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-47c34950-f305-4cf3-b918-240c93a00478 1073741824" returned: 0 in 0.432s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bb77326a-1f5d-4f6b-88d5-56858a719b8e tempest-VolumesListAdminTestJSON-251344915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-47c34950-f305-4cf3-b918-240c93a00478 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:55 devstack sudo[95777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-47c34950-f305-4cf3-b918-240c93a00478
Nov 05 19:13:55 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:55 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bb77326a-1f5d-4f6b-88d5-56858a719b8e tempest-VolumesListAdminTestJSON-251344915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-47c34950-f305-4cf3-b918-240c93a00478" returned: 0 in 0.258s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:55 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bb77326a-1f5d-4f6b-88d5-56858a719b8e tempest-VolumesListAdminTestJSON-251344915 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:13:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bb77326a-1f5d-4f6b-88d5-56858a719b8e tempest-VolumesListAdminTestJSON-251344915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:13:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0f098f6f-f3a1-4fde-bfad-c64cb705c80e tempest-SnapshotsActionsTest-1023533080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.080s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:13:55 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-0f098f6f-f3a1-4fde-bfad-c64cb705c80e tempest-SnapshotsActionsTest-1023533080 None] Creating offline snapshot 82792448-d0d1-4952-a62f-be2e1fd2a5ca of volume 0ea23a53-8ebf-495d-91ca-dd13f63e9516 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:13:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bb77326a-1f5d-4f6b-88d5-56858a719b8e tempest-VolumesListAdminTestJSON-251344915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (888ec1a9-39f7-4fa5-9b68-e8d2eee2dac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47c34950-f305-4cf3-b918-240c93a00478', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bb77326a-1f5d-4f6b-88d5-56858a719b8e tempest-VolumesListAdminTestJSON-251344915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7611bb7-2d2e-4037-bef0-683868156d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:55 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1976c745-e86a-41ba-bb66-17e45ecd91ae]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:13:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f098f6f-f3a1-4fde-bfad-c64cb705c80e tempest-SnapshotsActionsTest-1023533080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:55 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-bb77326a-1f5d-4f6b-88d5-56858a719b8e tempest-VolumesListAdminTestJSON-251344915 None] Volume volume-47c34950-f305-4cf3-b918-240c93a00478 (47c34950-f305-4cf3-b918-240c93a00478): created successfully
Nov 05 19:13:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bb77326a-1f5d-4f6b-88d5-56858a719b8e tempest-VolumesListAdminTestJSON-251344915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7611bb7-2d2e-4037-bef0-683868156d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bb77326a-1f5d-4f6b-88d5-56858a719b8e tempest-VolumesListAdminTestJSON-251344915 None] Flow 'volume_create_manager' (b1fc6653-accd-47c6-8d62-96959ac1731c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:13:55 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-bb77326a-1f5d-4f6b-88d5-56858a719b8e tempest-VolumesListAdminTestJSON-251344915 None] Created volume successfully.
Nov 05 19:13:55 devstack sudo[95780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95
Nov 05 19:13:55 devstack sudo[95780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:55 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:13:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Flow 'volume_create_manager' (3e1a19b4-36b1-4dc3-a40f-f651d172bc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:13:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56e382e5-81c2-4741-a511-1fce1553a586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56e382e5-81c2-4741-a511-1fce1553a586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1157053701',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9cf8ecf-c2ab-4d0a-bfe1-b112d5377414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2f776d18f5e4d06accc37697484a770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:13:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=931b6552-0b12-4360-a757-63c6fae3f654,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:13:56Z,use_quota=True,user_id='c4be2d0faca24936a7799988f3d60760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a30e29f4-9fa5-4954-a7e1-8796bd640be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a30e29f4-9fa5-4954-a7e1-8796bd640be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5595528-4fd8-4548-bbbb-49c5d61f86e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5595528-4fd8-4548-bbbb-49c5d61f86e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e9cf8ecf-c2ab-4d0a-bfe1-b112d5377414', 'volume_name': 'volume-e9cf8ecf-c2ab-4d0a-bfe1-b112d5377414', 'volume_size': 2, 'snapshot_id': '931b6552-0b12-4360-a757-63c6fae3f654'}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e94672a1-a613-46c0-afb1-3178284831d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e94672a1-a613-46c0-afb1-3178284831d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ebfdcae-f5f6-4945-a05b-e13250a6b542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:55 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Volume e9cf8ecf-c2ab-4d0a-bfe1-b112d5377414: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e9cf8ecf-c2ab-4d0a-bfe1-b112d5377414', 'volume_size': 2, 'snapshot_id': '931b6552-0b12-4360-a757-63c6fae3f654'}
Nov 05 19:13:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:13:56 devstack sudo[95780]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f098f6f-f3a1-4fde-bfad-c64cb705c80e tempest-SnapshotsActionsTest-1023533080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95" returned: 0 in 0.414s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:56 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-0f098f6f-f3a1-4fde-bfad-c64cb705c80e tempest-SnapshotsActionsTest-1023533080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:13:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f098f6f-f3a1-4fde-bfad-c64cb705c80e tempest-SnapshotsActionsTest-1023533080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.82792448-d0d1-4952-a62f-be2e1fd2a5ca 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:56 devstack sudo[95785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.82792448-d0d1-4952-a62f-be2e1fd2a5ca 1G
Nov 05 19:13:56 devstack sudo[95785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:56 devstack sudo[95785]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f098f6f-f3a1-4fde-bfad-c64cb705c80e tempest-SnapshotsActionsTest-1023533080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.82792448-d0d1-4952-a62f-be2e1fd2a5ca 1G" returned: 0 in 0.491s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f098f6f-f3a1-4fde-bfad-c64cb705c80e tempest-SnapshotsActionsTest-1023533080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.82792448-d0d1-4952-a62f-be2e1fd2a5ca {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:56 devstack sudo[95791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.82792448-d0d1-4952-a62f-be2e1fd2a5ca
Nov 05 19:13:56 devstack sudo[95791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:56 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-512b2371-9247-4c13-a108-a447a6571d71 tempest-VolumesListAdminTestJSON-251344915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:13:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-512b2371-9247-4c13-a108-a447a6571d71 tempest-VolumesListAdminTestJSON-251344915 None] Flow 'volume_create_manager' (710b949a-16d8-4b86-b843-794e1b0ea1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:13:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-512b2371-9247-4c13-a108-a447a6571d71 tempest-VolumesListAdminTestJSON-251344915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7125a226-9e16-404c-9b6d-e2ccb44250e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-512b2371-9247-4c13-a108-a447a6571d71 tempest-VolumesListAdminTestJSON-251344915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7125a226-9e16-404c-9b6d-e2ccb44250e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-450224765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bd0538c-aade-4c87-9c03-f6fbc309121b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f74a149fbd5041d9bbb6440bb931440a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:13:56Z,use_quota=True,user_id='8ef0fe486ca94cf2a1ff07eb1a14612e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-512b2371-9247-4c13-a108-a447a6571d71 tempest-VolumesListAdminTestJSON-251344915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a467013d-03b7-47d3-92d5-9241dae4e6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-512b2371-9247-4c13-a108-a447a6571d71 tempest-VolumesListAdminTestJSON-251344915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a467013d-03b7-47d3-92d5-9241dae4e6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-512b2371-9247-4c13-a108-a447a6571d71 tempest-VolumesListAdminTestJSON-251344915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df5197f1-38a6-42a5-84e7-545d77456f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-512b2371-9247-4c13-a108-a447a6571d71 tempest-VolumesListAdminTestJSON-251344915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df5197f1-38a6-42a5-84e7-545d77456f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bd0538c-aade-4c87-9c03-f6fbc309121b', 'volume_name': 'volume-0bd0538c-aade-4c87-9c03-f6fbc309121b', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-512b2371-9247-4c13-a108-a447a6571d71 tempest-VolumesListAdminTestJSON-251344915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7755b10-0c9a-473c-a79f-0760d0eceea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-512b2371-9247-4c13-a108-a447a6571d71 tempest-VolumesListAdminTestJSON-251344915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7755b10-0c9a-473c-a79f-0760d0eceea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:13:56 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-512b2371-9247-4c13-a108-a447a6571d71 tempest-VolumesListAdminTestJSON-251344915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9294bf29-be70-4773-9f53-d9b450846484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:13:56 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-512b2371-9247-4c13-a108-a447a6571d71 tempest-VolumesListAdminTestJSON-251344915 None] Volume 0bd0538c-aade-4c87-9c03-f6fbc309121b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bd0538c-aade-4c87-9c03-f6fbc309121b', 'volume_size': 1}
Nov 05 19:13:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-512b2371-9247-4c13-a108-a447a6571d71 tempest-VolumesListAdminTestJSON-251344915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:13:56 devstack sudo[95791]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f098f6f-f3a1-4fde-bfad-c64cb705c80e tempest-SnapshotsActionsTest-1023533080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.82792448-d0d1-4952-a62f-be2e1fd2a5ca" returned: 0 in 0.308s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:56 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-0f098f6f-f3a1-4fde-bfad-c64cb705c80e tempest-SnapshotsActionsTest-1023533080 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.82792448-d0d1-4952-a62f-be2e1fd2a5ca is being set with open permissions: ugo+rw
Nov 05 19:13:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f098f6f-f3a1-4fde-bfad-c64cb705c80e tempest-SnapshotsActionsTest-1023533080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.82792448-d0d1-4952-a62f-be2e1fd2a5ca {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:56 devstack sudo[95797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.82792448-d0d1-4952-a62f-be2e1fd2a5ca
Nov 05 19:13:56 devstack sudo[95797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:57 devstack sudo[95797]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0f098f6f-f3a1-4fde-bfad-c64cb705c80e tempest-SnapshotsActionsTest-1023533080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.82792448-d0d1-4952-a62f-be2e1fd2a5ca" returned: 0 in 0.232s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0f098f6f-f3a1-4fde-bfad-c64cb705c80e tempest-SnapshotsActionsTest-1023533080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.571s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:13:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.145s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:13:57 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "cinder-quobyte-931b6552-0b12-4360-a757-63c6fae3f654-e9cf8ecf-c2ab-4d0a-bfe1-b112d5377414" by "_create_volume_from_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:13:57 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-quobyte-931b6552-0b12-4360-a757-63c6fae3f654-e9cf8ecf-c2ab-4d0a-bfe1-b112d5377414" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:13:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Creating volume e9cf8ecf-c2ab-4d0a-bfe1-b112d5377414 from snapshot 931b6552-0b12-4360-a757-63c6fae3f654 {{(pid=87184) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 19:13:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:13:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:13:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:13:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:13:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:13:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:13:57 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "cinder-quobyte-e9cf8ecf-c2ab-4d0a-bfe1-b112d5377414" by "_copy_volume_from_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:13:57 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-0f098f6f-f3a1-4fde-bfad-c64cb705c80e tempest-SnapshotsActionsTest-1023533080 None] Create snapshot completed successfully
Nov 05 19:13:57 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-quobyte-e9cf8ecf-c2ab-4d0a-bfe1-b112d5377414" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:13:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] snapshot: 931b6552-0b12-4360-a757-63c6fae3f654, volume: e9cf8ecf-c2ab-4d0a-bfe1-b112d5377414,  {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 19:13:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:13:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:13:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:13:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:13:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:13:57 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a6ffd6-a1f3-4921-a24e-80bd9907110c]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:13:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a.931b6552-0b12-4360-a757-63c6fae3f654 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:57 devstack sudo[95801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a.931b6552-0b12-4360-a757-63c6fae3f654
Nov 05 19:13:57 devstack sudo[95801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:57 devstack sudo[95801]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a.931b6552-0b12-4360-a757-63c6fae3f654" returned: 0 in 0.383s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:13:57 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4dd279-f7e9-4b0b-ac49-af3632d4e22f]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:13:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:57 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8aeab706-2e8c-44c5-b32a-4f93e077454d tempest-SnapshotsActionsTest-2090918635 None] Acquiring lock "cinder-82792448-d0d1-4952-a62f-be2e1fd2a5ca-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:13:57 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8aeab706-2e8c-44c5-b32a-4f93e077454d tempest-SnapshotsActionsTest-2090918635 None] Lock "cinder-82792448-d0d1-4952-a62f-be2e1fd2a5ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:13:57 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8aeab706-2e8c-44c5-b32a-4f93e077454d tempest-SnapshotsActionsTest-2090918635 None] Acquiring lock "cinder-quobyte-0ea23a53-8ebf-495d-91ca-dd13f63e9516" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:13:57 devstack sudo[95806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a
Nov 05 19:13:57 devstack sudo[95806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:57 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8aeab706-2e8c-44c5-b32a-4f93e077454d tempest-SnapshotsActionsTest-2090918635 None] Lock "cinder-quobyte-0ea23a53-8ebf-495d-91ca-dd13f63e9516" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:13:57 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8aeab706-2e8c-44c5-b32a-4f93e077454d tempest-SnapshotsActionsTest-2090918635 None] Acquiring lock "cinder-quobyte-82792448-d0d1-4952-a62f-be2e1fd2a5ca" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:13:57 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8aeab706-2e8c-44c5-b32a-4f93e077454d tempest-SnapshotsActionsTest-2090918635 None] Lock "cinder-quobyte-82792448-d0d1-4952-a62f-be2e1fd2a5ca" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:13:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-8aeab706-2e8c-44c5-b32a-4f93e077454d tempest-SnapshotsActionsTest-2090918635 None] Deleting offline snapshot 82792448-d0d1-4952-a62f-be2e1fd2a5ca of volume 0ea23a53-8ebf-495d-91ca-dd13f63e9516 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:13:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-8aeab706-2e8c-44c5-b32a-4f93e077454d tempest-SnapshotsActionsTest-2090918635 None] snapshot_file for this snap is: volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.82792448-d0d1-4952-a62f-be2e1fd2a5ca {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:13:57 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fb9ae4-5440-4a8b-8419-f05b61ff4983]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:13:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8aeab706-2e8c-44c5-b32a-4f93e077454d tempest-SnapshotsActionsTest-2090918635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.82792448-d0d1-4952-a62f-be2e1fd2a5ca {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:57 devstack sudo[95808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.82792448-d0d1-4952-a62f-be2e1fd2a5ca
Nov 05 19:13:57 devstack sudo[95808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:57 devstack sudo[95806]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a" returned: 0 in 0.369s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 19:13:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Creating direct copy from snapshot {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 19:13:57 devstack cinder-volume[87184]: DEBUG cinder.utils [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Path /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e9cf8ecf-c2ab-4d0a-bfe1-b112d5377414 not found in is_blk_device check {{(pid=87184) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 19:13:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e9cf8ecf-c2ab-4d0a-bfe1-b112d5377414 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:57 devstack sudo[95813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e9cf8ecf-c2ab-4d0a-bfe1-b112d5377414
Nov 05 19:13:57 devstack sudo[95813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:58 devstack sudo[95808]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8aeab706-2e8c-44c5-b32a-4f93e077454d tempest-SnapshotsActionsTest-2090918635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.82792448-d0d1-4952-a62f-be2e1fd2a5ca" returned: 0 in 0.366s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-8aeab706-2e8c-44c5-b32a-4f93e077454d tempest-SnapshotsActionsTest-2090918635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:13:58 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f716b2-c41d-4096-b7e7-3ce493970d03]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:13:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8aeab706-2e8c-44c5-b32a-4f93e077454d tempest-SnapshotsActionsTest-2090918635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:58 devstack sudo[95820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95
Nov 05 19:13:58 devstack sudo[95820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:58 devstack sudo[95820]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8aeab706-2e8c-44c5-b32a-4f93e077454d tempest-SnapshotsActionsTest-2090918635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95" returned: 0 in 0.633s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-8aeab706-2e8c-44c5-b32a-4f93e077454d tempest-SnapshotsActionsTest-2090918635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:13:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8aeab706-2e8c-44c5-b32a-4f93e077454d tempest-SnapshotsActionsTest-2090918635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.82792448-d0d1-4952-a62f-be2e1fd2a5ca {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:58 devstack sudo[95833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.82792448-d0d1-4952-a62f-be2e1fd2a5ca
Nov 05 19:13:58 devstack sudo[95833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:59 devstack sudo[95833]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8aeab706-2e8c-44c5-b32a-4f93e077454d tempest-SnapshotsActionsTest-2090918635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.82792448-d0d1-4952-a62f-be2e1fd2a5ca" returned: 0 in 0.749s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:13:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8aeab706-2e8c-44c5-b32a-4f93e077454d tempest-SnapshotsActionsTest-2090918635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.82792448-d0d1-4952-a62f-be2e1fd2a5ca {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:13:59 devstack sudo[95840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.82792448-d0d1-4952-a62f-be2e1fd2a5ca
Nov 05 19:13:59 devstack sudo[95840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:13:59 devstack sudo[95840]: pam_unix(sudo:session): session closed for user root
Nov 05 19:13:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8aeab706-2e8c-44c5-b32a-4f93e077454d tempest-SnapshotsActionsTest-2090918635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.82792448-d0d1-4952-a62f-be2e1fd2a5ca" returned: 0 in 0.400s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8aeab706-2e8c-44c5-b32a-4f93e077454d tempest-SnapshotsActionsTest-2090918635 None] Lock "cinder-quobyte-82792448-d0d1-4952-a62f-be2e1fd2a5ca" released by "_delete_snapshot" :: held 2.316s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8aeab706-2e8c-44c5-b32a-4f93e077454d tempest-SnapshotsActionsTest-2090918635 None] Lock "cinder-quobyte-0ea23a53-8ebf-495d-91ca-dd13f63e9516" released by "delete_snapshot" :: held 2.349s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:00 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-8aeab706-2e8c-44c5-b32a-4f93e077454d tempest-SnapshotsActionsTest-2090918635 None] Created reservations ['a52b72eb-15ae-4d3c-b912-44463ffce399', '1244b5a7-e3d7-4fd7-adf0-b62720baedb6', 'd6043777-3165-4665-aeba-ab8ff81fa5ab', '93f08fd7-6440-47f1-b798-6d1e04dd8c87'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:14:00 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-8aeab706-2e8c-44c5-b32a-4f93e077454d tempest-SnapshotsActionsTest-2090918635 None] Delete snapshot completed successfully.
Nov 05 19:14:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8aeab706-2e8c-44c5-b32a-4f93e077454d tempest-SnapshotsActionsTest-2090918635 None] Lock "cinder-82792448-d0d1-4952-a62f-be2e1fd2a5ca-delete_snapshot" released by "delete_snapshot" :: held 2.604s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-030dd480-3374-40ed-82d6-39ad7032410b tempest-SnapshotsActionsTest-1023533080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:14:04 devstack sudo[95813]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e9cf8ecf-c2ab-4d0a-bfe1-b112d5377414" returned: 0 in 6.985s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:04 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Image conversion details: src /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a, size 1024.00 MB, duration 6.99 sec, destination /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e9cf8ecf-c2ab-4d0a-bfe1-b112d5377414 {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 19:14:04 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Converted 1024.00 MB image at 146.58 MB/s
Nov 05 19:14:04 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e9cf8ecf-c2ab-4d0a-bfe1-b112d5377414 is being set with open permissions: ugo+rw
Nov 05 19:14:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e9cf8ecf-c2ab-4d0a-bfe1-b112d5377414 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:04 devstack sudo[95845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e9cf8ecf-c2ab-4d0a-bfe1-b112d5377414
Nov 05 19:14:04 devstack sudo[95845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-efa9a9b8-89f9-464e-bf90-a889a471ccc5 tempest-AttachVolumeNegativeTest-1202125091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:14:05 devstack sudo[95845]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-efa9a9b8-89f9-464e-bf90-a889a471ccc5 tempest-AttachVolumeNegativeTest-1202125091 None] Flow 'volume_create_manager' (b6d03c77-abef-48b8-b5b0-656d818c1d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-efa9a9b8-89f9-464e-bf90-a889a471ccc5 tempest-AttachVolumeNegativeTest-1202125091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5dfd463-d44b-4829-8c62-c4719218323b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e9cf8ecf-c2ab-4d0a-bfe1-b112d5377414" returned: 0 in 0.279s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-efa9a9b8-89f9-464e-bf90-a889a471ccc5 tempest-AttachVolumeNegativeTest-1202125091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5dfd463-d44b-4829-8c62-c4719218323b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2139968633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85dda47b-fd4a-4cb1-a009-1ef8bb639e31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a74259972a364a99b263b8035b2e6352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:14:05Z,use_quota=True,user_id='b68aef3a93d64fb7a1957146d2ec0757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-efa9a9b8-89f9-464e-bf90-a889a471ccc5 tempest-AttachVolumeNegativeTest-1202125091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c531aad7-978c-495e-957c-127beeced004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-efa9a9b8-89f9-464e-bf90-a889a471ccc5 tempest-AttachVolumeNegativeTest-1202125091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c531aad7-978c-495e-957c-127beeced004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-efa9a9b8-89f9-464e-bf90-a889a471ccc5 tempest-AttachVolumeNegativeTest-1202125091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94f15f36-ee35-409a-b0f4-e86c5eaae8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-efa9a9b8-89f9-464e-bf90-a889a471ccc5 tempest-AttachVolumeNegativeTest-1202125091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94f15f36-ee35-409a-b0f4-e86c5eaae8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85dda47b-fd4a-4cb1-a009-1ef8bb639e31', 'volume_name': 'volume-85dda47b-fd4a-4cb1-a009-1ef8bb639e31', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-efa9a9b8-89f9-464e-bf90-a889a471ccc5 tempest-AttachVolumeNegativeTest-1202125091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b54544d7-acf0-4ca4-bfab-a921674dda5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-efa9a9b8-89f9-464e-bf90-a889a471ccc5 tempest-AttachVolumeNegativeTest-1202125091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b54544d7-acf0-4ca4-bfab-a921674dda5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-efa9a9b8-89f9-464e-bf90-a889a471ccc5 tempest-AttachVolumeNegativeTest-1202125091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1319295e-2194-41b4-a692-c1368a86e5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:05 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-efa9a9b8-89f9-464e-bf90-a889a471ccc5 tempest-AttachVolumeNegativeTest-1202125091 None] Volume 85dda47b-fd4a-4cb1-a009-1ef8bb639e31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85dda47b-fd4a-4cb1-a009-1ef8bb639e31', 'volume_size': 1}
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-efa9a9b8-89f9-464e-bf90-a889a471ccc5 tempest-AttachVolumeNegativeTest-1202125091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-quobyte-e9cf8ecf-c2ab-4d0a-bfe1-b112d5377414" released by "_copy_volume_from_snapshot" :: held 8.153s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-quobyte-931b6552-0b12-4360-a757-63c6fae3f654-e9cf8ecf-c2ab-4d0a-bfe1-b112d5377414" released by "_create_volume_from_snapshot" :: held 8.216s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.237s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-512b2371-9247-4c13-a108-a447a6571d71 tempest-VolumesListAdminTestJSON-251344915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.713s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-512b2371-9247-4c13-a108-a447a6571d71 tempest-VolumesListAdminTestJSON-251344915 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-450224765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bd0538c-aade-4c87-9c03-f6fbc309121b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f74a149fbd5041d9bbb6440bb931440a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:13:56Z,use_quota=True,user_id='8ef0fe486ca94cf2a1ff07eb1a14612e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-512b2371-9247-4c13-a108-a447a6571d71 tempest-VolumesListAdminTestJSON-251344915 None] Creating volume 0bd0538c-aade-4c87-9c03-f6fbc309121b {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-512b2371-9247-4c13-a108-a447a6571d71 tempest-VolumesListAdminTestJSON-251344915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-512b2371-9247-4c13-a108-a447a6571d71 tempest-VolumesListAdminTestJSON-251344915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-512b2371-9247-4c13-a108-a447a6571d71 tempest-VolumesListAdminTestJSON-251344915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-512b2371-9247-4c13-a108-a447a6571d71 tempest-VolumesListAdminTestJSON-251344915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-512b2371-9247-4c13-a108-a447a6571d71 tempest-VolumesListAdminTestJSON-251344915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-512b2371-9247-4c13-a108-a447a6571d71 tempest-VolumesListAdminTestJSON-251344915 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:14:05 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-512b2371-9247-4c13-a108-a447a6571d71 tempest-VolumesListAdminTestJSON-251344915 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-512b2371-9247-4c13-a108-a447a6571d71 tempest-VolumesListAdminTestJSON-251344915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0bd0538c-aade-4c87-9c03-f6fbc309121b 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:05 devstack sudo[95848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:14:05 devstack sudo[95848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:05 devstack sudo[95850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0bd0538c-aade-4c87-9c03-f6fbc309121b 1073741824
Nov 05 19:14:05 devstack sudo[95850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ebfdcae-f5f6-4945-a05b-e13250a6b542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9cf8ecf-c2ab-4d0a-bfe1-b112d5377414', 'volume_size': 2, 'snapshot_id': '931b6552-0b12-4360-a757-63c6fae3f654'}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9acef5a-6743-4adb-a5d2-35c7091145d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:05 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Volume volume-e9cf8ecf-c2ab-4d0a-bfe1-b112d5377414 (e9cf8ecf-c2ab-4d0a-bfe1-b112d5377414): created successfully
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9acef5a-6743-4adb-a5d2-35c7091145d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Flow 'volume_create_manager' (3e1a19b4-36b1-4dc3-a40f-f651d172bc7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:14:05 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-af38a164-31f9-463b-b510-12fae73107ca tempest-VolumesSnapshotTestJSON-1250160096 None] Created volume successfully.
Nov 05 19:14:05 devstack sudo[95848]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.249s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread count: 28 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread info: [<_MainThread(MainThread, started 126882883072128)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126882770872512)>, <Thread(Thread-3 (stat_writer), started daemon 126882769837376)>, <Thread(Rabbit-heartbeat, started daemon 126882768896256)>, <Thread(Thread-5 (_runner), started daemon 126882768980928)>, <Thread(Thread-7 (_runner), started daemon 126882767016448)>, <Thread(fd_logger, started daemon 126882764561216)>, <Thread(privsep_reader, started daemon 126882764568576)>, <Thread(tpool_thread_0, started daemon 126882759292608)>, <Thread(tpool_thread_1, started daemon 126882750899904)>, <Thread(tpool_thread_2, started daemon 126882742507200)>, <Thread(tpool_thread_3, started daemon 126882734114496)>, <Thread(tpool_thread_4, started daemon 126882725721792)>, <Thread(tpool_thread_5, started daemon 126882717329088)>, <Thread(tpool_thread_6, started daemon 126882708920000)>, <Thread(tpool_thread_7, started daemon 126882700510912)>, <Thread(tpool_thread_8, started daemon 126882692101824)>, <Thread(tpool_thread_9, started daemon 126882683692736)>, <Thread(tpool_thread_10, started daemon 126882675283648)>, <Thread(tpool_thread_11, started daemon 126882666874560)>, <Thread(tpool_thread_12, started daemon 126882658465472)>, <Thread(tpool_thread_13, started daemon 126882650056384)>, <Thread(tpool_thread_14, started daemon 126882641647296)>, <Thread(tpool_thread_15, started daemon 126882633238208)>, <Thread(tpool_thread_16, started daemon 126882624829120)>, <Thread(tpool_thread_17, started daemon 126882616420032)>, <Thread(tpool_thread_18, started daemon 126882608010944)>, <Thread(tpool_thread_19, started daemon 126882599601856)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3fcfef9a-467b-4b24-924c-e43cccf4c673 tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "cinder-e9cf8ecf-c2ab-4d0a-bfe1-b112d5377414-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:05 devstack sudo[95850]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3fcfef9a-467b-4b24-924c-e43cccf4c673 tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-e9cf8ecf-c2ab-4d0a-bfe1-b112d5377414-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-512b2371-9247-4c13-a108-a447a6571d71 tempest-VolumesListAdminTestJSON-251344915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0bd0538c-aade-4c87-9c03-f6fbc309121b 1073741824" returned: 0 in 0.456s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3fcfef9a-467b-4b24-924c-e43cccf4c673 tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "cinder-quobyte-e9cf8ecf-c2ab-4d0a-bfe1-b112d5377414" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-512b2371-9247-4c13-a108-a447a6571d71 tempest-VolumesListAdminTestJSON-251344915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0bd0538c-aade-4c87-9c03-f6fbc309121b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3fcfef9a-467b-4b24-924c-e43cccf4c673 tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-quobyte-e9cf8ecf-c2ab-4d0a-bfe1-b112d5377414" acquired by "delete_volume" :: waited 0.030s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:05 devstack sudo[95857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0bd0538c-aade-4c87-9c03-f6fbc309121b
Nov 05 19:14:05 devstack sudo[95857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ad8bd8-f039-4107-afa9-1814b250033a]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:14:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3fcfef9a-467b-4b24-924c-e43cccf4c673 tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e9cf8ecf-c2ab-4d0a-bfe1-b112d5377414 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:06 devstack sudo[95859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e9cf8ecf-c2ab-4d0a-bfe1-b112d5377414
Nov 05 19:14:06 devstack sudo[95859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:06 devstack sudo[95857]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-512b2371-9247-4c13-a108-a447a6571d71 tempest-VolumesListAdminTestJSON-251344915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0bd0538c-aade-4c87-9c03-f6fbc309121b" returned: 0 in 0.238s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-512b2371-9247-4c13-a108-a447a6571d71 tempest-VolumesListAdminTestJSON-251344915 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:14:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-512b2371-9247-4c13-a108-a447a6571d71 tempest-VolumesListAdminTestJSON-251344915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:14:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-030dd480-3374-40ed-82d6-39ad7032410b tempest-SnapshotsActionsTest-1023533080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.456s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:14:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-512b2371-9247-4c13-a108-a447a6571d71 tempest-VolumesListAdminTestJSON-251344915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9294bf29-be70-4773-9f53-d9b450846484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bd0538c-aade-4c87-9c03-f6fbc309121b', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-512b2371-9247-4c13-a108-a447a6571d71 tempest-VolumesListAdminTestJSON-251344915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c5607e2-a8b9-46ce-9309-f3bf7feb8eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:06 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-512b2371-9247-4c13-a108-a447a6571d71 tempest-VolumesListAdminTestJSON-251344915 None] Volume volume-0bd0538c-aade-4c87-9c03-f6fbc309121b (0bd0538c-aade-4c87-9c03-f6fbc309121b): created successfully
Nov 05 19:14:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-512b2371-9247-4c13-a108-a447a6571d71 tempest-VolumesListAdminTestJSON-251344915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c5607e2-a8b9-46ce-9309-f3bf7feb8eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-512b2371-9247-4c13-a108-a447a6571d71 tempest-VolumesListAdminTestJSON-251344915 None] Flow 'volume_create_manager' (710b949a-16d8-4b86-b843-794e1b0ea1c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:14:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-030dd480-3374-40ed-82d6-39ad7032410b tempest-SnapshotsActionsTest-1023533080 None] Creating offline snapshot ec8ac1ec-5775-44b7-a431-0d5c81b4274d of volume 0ea23a53-8ebf-495d-91ca-dd13f63e9516 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:14:06 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-512b2371-9247-4c13-a108-a447a6571d71 tempest-VolumesListAdminTestJSON-251344915 None] Created volume successfully.
Nov 05 19:14:06 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2169135d-d9d2-4bf2-bf1a-f7be1fa0a12f]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:14:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-030dd480-3374-40ed-82d6-39ad7032410b tempest-SnapshotsActionsTest-1023533080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:06 devstack sudo[95859]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3fcfef9a-467b-4b24-924c-e43cccf4c673 tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e9cf8ecf-c2ab-4d0a-bfe1-b112d5377414" returned: 0 in 0.376s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3fcfef9a-467b-4b24-924c-e43cccf4c673 tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e9cf8ecf-c2ab-4d0a-bfe1-b112d5377414 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:06 devstack sudo[95866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e9cf8ecf-c2ab-4d0a-bfe1-b112d5377414
Nov 05 19:14:06 devstack sudo[95866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:06 devstack sudo[95865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95
Nov 05 19:14:06 devstack sudo[95865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:06 devstack sudo[95866]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3fcfef9a-467b-4b24-924c-e43cccf4c673 tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e9cf8ecf-c2ab-4d0a-bfe1-b112d5377414" returned: 0 in 0.265s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3fcfef9a-467b-4b24-924c-e43cccf4c673 tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-quobyte-e9cf8ecf-c2ab-4d0a-bfe1-b112d5377414" released by "delete_volume" :: held 0.686s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:06 devstack sudo[95865]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-030dd480-3374-40ed-82d6-39ad7032410b tempest-SnapshotsActionsTest-1023533080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95" returned: 0 in 0.388s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-030dd480-3374-40ed-82d6-39ad7032410b tempest-SnapshotsActionsTest-1023533080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:14:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-030dd480-3374-40ed-82d6-39ad7032410b tempest-SnapshotsActionsTest-1023533080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.ec8ac1ec-5775-44b7-a431-0d5c81b4274d 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:06 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-3fcfef9a-467b-4b24-924c-e43cccf4c673 tempest-VolumesSnapshotTestJSON-1250160096 None] Created reservations ['21d541be-a665-4669-9642-b69cf8bdd13e', 'dd5295e0-49bd-48cf-938e-c82c00aad5e7', '59e3e737-c214-4ed4-bea3-ced921a25cbf', '3a5cb407-dfbb-4e80-a53b-d302e3579c9b'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:14:06 devstack sudo[95873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.ec8ac1ec-5775-44b7-a431-0d5c81b4274d 1G
Nov 05 19:14:06 devstack sudo[95873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3fcfef9a-467b-4b24-924c-e43cccf4c673 tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:14:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3fcfef9a-467b-4b24-924c-e43cccf4c673 tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:14:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3fcfef9a-467b-4b24-924c-e43cccf4c673 tempest-VolumesSnapshotTestJSON-1250160096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:14:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3fcfef9a-467b-4b24-924c-e43cccf4c673 tempest-VolumesSnapshotTestJSON-1250160096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:14:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3fcfef9a-467b-4b24-924c-e43cccf4c673 tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:14:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3fcfef9a-467b-4b24-924c-e43cccf4c673 tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:06 devstack sudo[95875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:14:06 devstack sudo[95875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:06 devstack sudo[95875]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3fcfef9a-467b-4b24-924c-e43cccf4c673 tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.322s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ca5f6d6e-7c54-4ecf-8153-6fe7cc2e958c tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "cinder-931b6552-0b12-4360-a757-63c6fae3f654-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-3fcfef9a-467b-4b24-924c-e43cccf4c673 tempest-VolumesSnapshotTestJSON-1250160096 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:14:07 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-3fcfef9a-467b-4b24-924c-e43cccf4c673 tempest-VolumesSnapshotTestJSON-1250160096 None] Deleted volume successfully.
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ca5f6d6e-7c54-4ecf-8153-6fe7cc2e958c tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-931b6552-0b12-4360-a757-63c6fae3f654-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ca5f6d6e-7c54-4ecf-8153-6fe7cc2e958c tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "cinder-quobyte-52737dfe-f0a1-4b51-9ad3-60f32909d94a" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-90d07061-29f6-430e-a507-a6efa93b6264 tempest-VolumesListAdminTestJSON-251344915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-90d07061-29f6-430e-a507-a6efa93b6264 tempest-VolumesListAdminTestJSON-251344915 None] Flow 'volume_create_manager' (8bfee027-f017-4905-9b85-6340d7ea3aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-90d07061-29f6-430e-a507-a6efa93b6264 tempest-VolumesListAdminTestJSON-251344915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3644e5fd-37b5-4335-80ee-e51472196ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ca5f6d6e-7c54-4ecf-8153-6fe7cc2e958c tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-quobyte-52737dfe-f0a1-4b51-9ad3-60f32909d94a" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ca5f6d6e-7c54-4ecf-8153-6fe7cc2e958c tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "cinder-quobyte-931b6552-0b12-4360-a757-63c6fae3f654" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3fcfef9a-467b-4b24-924c-e43cccf4c673 tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-e9cf8ecf-c2ab-4d0a-bfe1-b112d5377414-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-90d07061-29f6-430e-a507-a6efa93b6264 tempest-VolumesListAdminTestJSON-251344915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3644e5fd-37b5-4335-80ee-e51472196ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1253789202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=313e502c-9ef2-4786-bbd5-64c8794c915d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f74a149fbd5041d9bbb6440bb931440a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:14:07Z,use_quota=True,user_id='8ef0fe486ca94cf2a1ff07eb1a14612e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-90d07061-29f6-430e-a507-a6efa93b6264 tempest-VolumesListAdminTestJSON-251344915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86223975-d84e-458d-9bc0-d212a015c452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-90d07061-29f6-430e-a507-a6efa93b6264 tempest-VolumesListAdminTestJSON-251344915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86223975-d84e-458d-9bc0-d212a015c452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-90d07061-29f6-430e-a507-a6efa93b6264 tempest-VolumesListAdminTestJSON-251344915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (283f93a0-3e38-4896-ac39-e235b7c7dbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-90d07061-29f6-430e-a507-a6efa93b6264 tempest-VolumesListAdminTestJSON-251344915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (283f93a0-3e38-4896-ac39-e235b7c7dbf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '313e502c-9ef2-4786-bbd5-64c8794c915d', 'volume_name': 'volume-313e502c-9ef2-4786-bbd5-64c8794c915d', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-90d07061-29f6-430e-a507-a6efa93b6264 tempest-VolumesListAdminTestJSON-251344915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b12cd54-1dcc-44e2-8b2a-c084a34abfb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-90d07061-29f6-430e-a507-a6efa93b6264 tempest-VolumesListAdminTestJSON-251344915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b12cd54-1dcc-44e2-8b2a-c084a34abfb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-90d07061-29f6-430e-a507-a6efa93b6264 tempest-VolumesListAdminTestJSON-251344915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e88d9c76-b97f-4ca6-b80b-5a2dc7a4f809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:07 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-90d07061-29f6-430e-a507-a6efa93b6264 tempest-VolumesListAdminTestJSON-251344915 None] Volume 313e502c-9ef2-4786-bbd5-64c8794c915d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-313e502c-9ef2-4786-bbd5-64c8794c915d', 'volume_size': 1}
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-90d07061-29f6-430e-a507-a6efa93b6264 tempest-VolumesListAdminTestJSON-251344915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ca5f6d6e-7c54-4ecf-8153-6fe7cc2e958c tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-quobyte-931b6552-0b12-4360-a757-63c6fae3f654" acquired by "_delete_snapshot" :: waited 0.060s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-ca5f6d6e-7c54-4ecf-8153-6fe7cc2e958c tempest-VolumesSnapshotTestJSON-1250160096 None] Deleting offline snapshot 931b6552-0b12-4360-a757-63c6fae3f654 of volume 52737dfe-f0a1-4b51-9ad3-60f32909d94a {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:14:07 devstack sudo[95873]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-ca5f6d6e-7c54-4ecf-8153-6fe7cc2e958c tempest-VolumesSnapshotTestJSON-1250160096 None] snapshot_file for this snap is: volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a.931b6552-0b12-4360-a757-63c6fae3f654 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-030dd480-3374-40ed-82d6-39ad7032410b tempest-SnapshotsActionsTest-1023533080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.ec8ac1ec-5775-44b7-a431-0d5c81b4274d 1G" returned: 0 in 0.604s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-030dd480-3374-40ed-82d6-39ad7032410b tempest-SnapshotsActionsTest-1023533080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.ec8ac1ec-5775-44b7-a431-0d5c81b4274d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0f9616-e56a-4237-a4ba-e4e12e71b680]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ca5f6d6e-7c54-4ecf-8153-6fe7cc2e958c tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a.931b6552-0b12-4360-a757-63c6fae3f654 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:07 devstack sudo[95883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.ec8ac1ec-5775-44b7-a431-0d5c81b4274d
Nov 05 19:14:07 devstack sudo[95883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:07 devstack sudo[95884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a.931b6552-0b12-4360-a757-63c6fae3f654
Nov 05 19:14:07 devstack sudo[95884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:07 devstack sudo[95883]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-030dd480-3374-40ed-82d6-39ad7032410b tempest-SnapshotsActionsTest-1023533080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.ec8ac1ec-5775-44b7-a431-0d5c81b4274d" returned: 0 in 0.298s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:07 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-030dd480-3374-40ed-82d6-39ad7032410b tempest-SnapshotsActionsTest-1023533080 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.ec8ac1ec-5775-44b7-a431-0d5c81b4274d is being set with open permissions: ugo+rw
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-030dd480-3374-40ed-82d6-39ad7032410b tempest-SnapshotsActionsTest-1023533080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.ec8ac1ec-5775-44b7-a431-0d5c81b4274d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:07 devstack sudo[95890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.ec8ac1ec-5775-44b7-a431-0d5c81b4274d
Nov 05 19:14:07 devstack sudo[95890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:07 devstack sudo[95884]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ca5f6d6e-7c54-4ecf-8153-6fe7cc2e958c tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a.931b6552-0b12-4360-a757-63c6fae3f654" returned: 0 in 0.380s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-ca5f6d6e-7c54-4ecf-8153-6fe7cc2e958c tempest-VolumesSnapshotTestJSON-1250160096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[74edbc4d-7ad8-47a8-a196-05809f5f6b8b]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ca5f6d6e-7c54-4ecf-8153-6fe7cc2e958c tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:07 devstack sudo[95895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a
Nov 05 19:14:07 devstack sudo[95895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:07 devstack sudo[95890]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-030dd480-3374-40ed-82d6-39ad7032410b tempest-SnapshotsActionsTest-1023533080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.ec8ac1ec-5775-44b7-a431-0d5c81b4274d" returned: 0 in 0.253s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-030dd480-3374-40ed-82d6-39ad7032410b tempest-SnapshotsActionsTest-1023533080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.702s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-efa9a9b8-89f9-464e-bf90-a889a471ccc5 tempest-AttachVolumeNegativeTest-1202125091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.524s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-efa9a9b8-89f9-464e-bf90-a889a471ccc5 tempest-AttachVolumeNegativeTest-1202125091 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2139968633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85dda47b-fd4a-4cb1-a009-1ef8bb639e31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a74259972a364a99b263b8035b2e6352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:14:05Z,use_quota=True,user_id='b68aef3a93d64fb7a1957146d2ec0757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-efa9a9b8-89f9-464e-bf90-a889a471ccc5 tempest-AttachVolumeNegativeTest-1202125091 None] Creating volume 85dda47b-fd4a-4cb1-a009-1ef8bb639e31 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-efa9a9b8-89f9-464e-bf90-a889a471ccc5 tempest-AttachVolumeNegativeTest-1202125091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-efa9a9b8-89f9-464e-bf90-a889a471ccc5 tempest-AttachVolumeNegativeTest-1202125091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-efa9a9b8-89f9-464e-bf90-a889a471ccc5 tempest-AttachVolumeNegativeTest-1202125091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-efa9a9b8-89f9-464e-bf90-a889a471ccc5 tempest-AttachVolumeNegativeTest-1202125091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-efa9a9b8-89f9-464e-bf90-a889a471ccc5 tempest-AttachVolumeNegativeTest-1202125091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-efa9a9b8-89f9-464e-bf90-a889a471ccc5 tempest-AttachVolumeNegativeTest-1202125091 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:14:07 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-efa9a9b8-89f9-464e-bf90-a889a471ccc5 tempest-AttachVolumeNegativeTest-1202125091 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:14:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-efa9a9b8-89f9-464e-bf90-a889a471ccc5 tempest-AttachVolumeNegativeTest-1202125091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-85dda47b-fd4a-4cb1-a009-1ef8bb639e31 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:07 devstack sudo[95898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-85dda47b-fd4a-4cb1-a009-1ef8bb639e31 1073741824
Nov 05 19:14:07 devstack sudo[95898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:07 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-030dd480-3374-40ed-82d6-39ad7032410b tempest-SnapshotsActionsTest-1023533080 None] Create snapshot completed successfully
Nov 05 19:14:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-06f91de1-5313-46c1-b6d4-e948c3a77f4f tempest-SnapshotsActionsTest-2090918635 None] Acquiring lock "cinder-ec8ac1ec-5775-44b7-a431-0d5c81b4274d-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-06f91de1-5313-46c1-b6d4-e948c3a77f4f tempest-SnapshotsActionsTest-2090918635 None] Lock "cinder-ec8ac1ec-5775-44b7-a431-0d5c81b4274d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-06f91de1-5313-46c1-b6d4-e948c3a77f4f tempest-SnapshotsActionsTest-2090918635 None] Acquiring lock "cinder-quobyte-0ea23a53-8ebf-495d-91ca-dd13f63e9516" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-06f91de1-5313-46c1-b6d4-e948c3a77f4f tempest-SnapshotsActionsTest-2090918635 None] Lock "cinder-quobyte-0ea23a53-8ebf-495d-91ca-dd13f63e9516" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-06f91de1-5313-46c1-b6d4-e948c3a77f4f tempest-SnapshotsActionsTest-2090918635 None] Acquiring lock "cinder-quobyte-ec8ac1ec-5775-44b7-a431-0d5c81b4274d" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:08 devstack sudo[95895]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ca5f6d6e-7c54-4ecf-8153-6fe7cc2e958c tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a" returned: 0 in 0.538s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ca5f6d6e-7c54-4ecf-8153-6fe7cc2e958c tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a.931b6552-0b12-4360-a757-63c6fae3f654 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-06f91de1-5313-46c1-b6d4-e948c3a77f4f tempest-SnapshotsActionsTest-2090918635 None] Lock "cinder-quobyte-ec8ac1ec-5775-44b7-a431-0d5c81b4274d" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-06f91de1-5313-46c1-b6d4-e948c3a77f4f tempest-SnapshotsActionsTest-2090918635 None] Deleting offline snapshot ec8ac1ec-5775-44b7-a431-0d5c81b4274d of volume 0ea23a53-8ebf-495d-91ca-dd13f63e9516 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:14:08 devstack sudo[95907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a.931b6552-0b12-4360-a757-63c6fae3f654
Nov 05 19:14:08 devstack sudo[95907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-06f91de1-5313-46c1-b6d4-e948c3a77f4f tempest-SnapshotsActionsTest-2090918635 None] snapshot_file for this snap is: volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.ec8ac1ec-5775-44b7-a431-0d5c81b4274d {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:14:08 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b21ea4-cd27-4224-82e4-22a7027dc566]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:14:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-06f91de1-5313-46c1-b6d4-e948c3a77f4f tempest-SnapshotsActionsTest-2090918635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.ec8ac1ec-5775-44b7-a431-0d5c81b4274d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:08 devstack sudo[95898]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-efa9a9b8-89f9-464e-bf90-a889a471ccc5 tempest-AttachVolumeNegativeTest-1202125091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-85dda47b-fd4a-4cb1-a009-1ef8bb639e31 1073741824" returned: 0 in 0.548s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:08 devstack sudo[95909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.ec8ac1ec-5775-44b7-a431-0d5c81b4274d
Nov 05 19:14:08 devstack sudo[95909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-efa9a9b8-89f9-464e-bf90-a889a471ccc5 tempest-AttachVolumeNegativeTest-1202125091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-85dda47b-fd4a-4cb1-a009-1ef8bb639e31 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:08 devstack sudo[95912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-85dda47b-fd4a-4cb1-a009-1ef8bb639e31
Nov 05 19:14:08 devstack sudo[95912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:08 devstack sudo[95907]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ca5f6d6e-7c54-4ecf-8153-6fe7cc2e958c tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a.931b6552-0b12-4360-a757-63c6fae3f654" returned: 0 in 0.400s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ca5f6d6e-7c54-4ecf-8153-6fe7cc2e958c tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a.931b6552-0b12-4360-a757-63c6fae3f654 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:08 devstack sudo[95920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a.931b6552-0b12-4360-a757-63c6fae3f654
Nov 05 19:14:08 devstack sudo[95920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:08 devstack sudo[95909]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-06f91de1-5313-46c1-b6d4-e948c3a77f4f tempest-SnapshotsActionsTest-2090918635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.ec8ac1ec-5775-44b7-a431-0d5c81b4274d" returned: 0 in 0.418s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-06f91de1-5313-46c1-b6d4-e948c3a77f4f tempest-SnapshotsActionsTest-2090918635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:14:08 devstack sudo[95912]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-efa9a9b8-89f9-464e-bf90-a889a471ccc5 tempest-AttachVolumeNegativeTest-1202125091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-85dda47b-fd4a-4cb1-a009-1ef8bb639e31" returned: 0 in 0.295s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-efa9a9b8-89f9-464e-bf90-a889a471ccc5 tempest-AttachVolumeNegativeTest-1202125091 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:14:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-efa9a9b8-89f9-464e-bf90-a889a471ccc5 tempest-AttachVolumeNegativeTest-1202125091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:14:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-90d07061-29f6-430e-a507-a6efa93b6264 tempest-VolumesListAdminTestJSON-251344915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.538s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:14:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-90d07061-29f6-430e-a507-a6efa93b6264 tempest-VolumesListAdminTestJSON-251344915 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1253789202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=313e502c-9ef2-4786-bbd5-64c8794c915d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f74a149fbd5041d9bbb6440bb931440a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:14:07Z,use_quota=True,user_id='8ef0fe486ca94cf2a1ff07eb1a14612e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:14:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-90d07061-29f6-430e-a507-a6efa93b6264 tempest-VolumesListAdminTestJSON-251344915 None] Creating volume 313e502c-9ef2-4786-bbd5-64c8794c915d {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:14:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-90d07061-29f6-430e-a507-a6efa93b6264 tempest-VolumesListAdminTestJSON-251344915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:14:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-90d07061-29f6-430e-a507-a6efa93b6264 tempest-VolumesListAdminTestJSON-251344915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:14:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-90d07061-29f6-430e-a507-a6efa93b6264 tempest-VolumesListAdminTestJSON-251344915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:14:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-90d07061-29f6-430e-a507-a6efa93b6264 tempest-VolumesListAdminTestJSON-251344915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:14:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-90d07061-29f6-430e-a507-a6efa93b6264 tempest-VolumesListAdminTestJSON-251344915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:14:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-90d07061-29f6-430e-a507-a6efa93b6264 tempest-VolumesListAdminTestJSON-251344915 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:14:08 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-90d07061-29f6-430e-a507-a6efa93b6264 tempest-VolumesListAdminTestJSON-251344915 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:14:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-90d07061-29f6-430e-a507-a6efa93b6264 tempest-VolumesListAdminTestJSON-251344915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-313e502c-9ef2-4786-bbd5-64c8794c915d 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:08 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46ac26b-113f-4849-af72-4a1dc45bc15d]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:14:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-06f91de1-5313-46c1-b6d4-e948c3a77f4f tempest-SnapshotsActionsTest-2090918635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:08 devstack sudo[95924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-313e502c-9ef2-4786-bbd5-64c8794c915d 1073741824
Nov 05 19:14:08 devstack sudo[95924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-efa9a9b8-89f9-464e-bf90-a889a471ccc5 tempest-AttachVolumeNegativeTest-1202125091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1319295e-2194-41b4-a692-c1368a86e5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85dda47b-fd4a-4cb1-a009-1ef8bb639e31', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-efa9a9b8-89f9-464e-bf90-a889a471ccc5 tempest-AttachVolumeNegativeTest-1202125091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7c159b5-d063-48c6-ad85-0fa0878dabf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:08 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-efa9a9b8-89f9-464e-bf90-a889a471ccc5 tempest-AttachVolumeNegativeTest-1202125091 None] Volume volume-85dda47b-fd4a-4cb1-a009-1ef8bb639e31 (85dda47b-fd4a-4cb1-a009-1ef8bb639e31): created successfully
Nov 05 19:14:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-efa9a9b8-89f9-464e-bf90-a889a471ccc5 tempest-AttachVolumeNegativeTest-1202125091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7c159b5-d063-48c6-ad85-0fa0878dabf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-efa9a9b8-89f9-464e-bf90-a889a471ccc5 tempest-AttachVolumeNegativeTest-1202125091 None] Flow 'volume_create_manager' (b6d03c77-abef-48b8-b5b0-656d818c1d3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:14:08 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-efa9a9b8-89f9-464e-bf90-a889a471ccc5 tempest-AttachVolumeNegativeTest-1202125091 None] Created volume successfully.
Nov 05 19:14:08 devstack sudo[95926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95
Nov 05 19:14:08 devstack sudo[95926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:08 devstack sudo[95920]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ca5f6d6e-7c54-4ecf-8153-6fe7cc2e958c tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a.931b6552-0b12-4360-a757-63c6fae3f654" returned: 0 in 0.294s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ca5f6d6e-7c54-4ecf-8153-6fe7cc2e958c tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-quobyte-931b6552-0b12-4360-a757-63c6fae3f654" released by "_delete_snapshot" :: held 1.740s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ca5f6d6e-7c54-4ecf-8153-6fe7cc2e958c tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-quobyte-52737dfe-f0a1-4b51-9ad3-60f32909d94a" released by "delete_snapshot" :: held 1.811s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:09 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-ca5f6d6e-7c54-4ecf-8153-6fe7cc2e958c tempest-VolumesSnapshotTestJSON-1250160096 None] Created reservations ['933ca928-8fbf-43e4-9810-c274b2526ad8', '8b99b4fe-084f-4e5c-b5bf-00aaf03a966d', 'e43647f6-70e2-446e-8a7f-13680d91875c', '5536d8b9-3cc6-4f2e-a024-7f28b89226f5'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:14:09 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-ca5f6d6e-7c54-4ecf-8153-6fe7cc2e958c tempest-VolumesSnapshotTestJSON-1250160096 None] Delete snapshot completed successfully.
Nov 05 19:14:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ca5f6d6e-7c54-4ecf-8153-6fe7cc2e958c tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-931b6552-0b12-4360-a757-63c6fae3f654-delete_snapshot" released by "delete_snapshot" :: held 2.028s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:09 devstack sudo[95926]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-06f91de1-5313-46c1-b6d4-e948c3a77f4f tempest-SnapshotsActionsTest-2090918635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95" returned: 0 in 0.438s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-06f91de1-5313-46c1-b6d4-e948c3a77f4f tempest-SnapshotsActionsTest-2090918635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:14:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-06f91de1-5313-46c1-b6d4-e948c3a77f4f tempest-SnapshotsActionsTest-2090918635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.ec8ac1ec-5775-44b7-a431-0d5c81b4274d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:09 devstack sudo[95936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.ec8ac1ec-5775-44b7-a431-0d5c81b4274d
Nov 05 19:14:09 devstack sudo[95936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:09 devstack sudo[95924]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-90d07061-29f6-430e-a507-a6efa93b6264 tempest-VolumesListAdminTestJSON-251344915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-313e502c-9ef2-4786-bbd5-64c8794c915d 1073741824" returned: 0 in 0.524s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9affca2a-c1eb-4648-b584-03359990404a tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "cinder-52737dfe-f0a1-4b51-9ad3-60f32909d94a-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9affca2a-c1eb-4648-b584-03359990404a tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-52737dfe-f0a1-4b51-9ad3-60f32909d94a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-90d07061-29f6-430e-a507-a6efa93b6264 tempest-VolumesListAdminTestJSON-251344915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-313e502c-9ef2-4786-bbd5-64c8794c915d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:09 devstack sudo[95938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-313e502c-9ef2-4786-bbd5-64c8794c915d
Nov 05 19:14:09 devstack sudo[95938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9affca2a-c1eb-4648-b584-03359990404a tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "cinder-quobyte-52737dfe-f0a1-4b51-9ad3-60f32909d94a" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9affca2a-c1eb-4648-b584-03359990404a tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-quobyte-52737dfe-f0a1-4b51-9ad3-60f32909d94a" acquired by "delete_volume" :: waited 0.026s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:09 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5ea66a-648e-4643-aaa2-578fce059e9f]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:14:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9affca2a-c1eb-4648-b584-03359990404a tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:09 devstack sudo[95938]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-90d07061-29f6-430e-a507-a6efa93b6264 tempest-VolumesListAdminTestJSON-251344915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-313e502c-9ef2-4786-bbd5-64c8794c915d" returned: 0 in 0.298s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-90d07061-29f6-430e-a507-a6efa93b6264 tempest-VolumesListAdminTestJSON-251344915 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:14:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-90d07061-29f6-430e-a507-a6efa93b6264 tempest-VolumesListAdminTestJSON-251344915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:14:09 devstack sudo[95943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a
Nov 05 19:14:09 devstack sudo[95943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-90d07061-29f6-430e-a507-a6efa93b6264 tempest-VolumesListAdminTestJSON-251344915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e88d9c76-b97f-4ca6-b80b-5a2dc7a4f809) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-313e502c-9ef2-4786-bbd5-64c8794c915d', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-90d07061-29f6-430e-a507-a6efa93b6264 tempest-VolumesListAdminTestJSON-251344915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (378cfedb-6fb9-4825-a0e0-63bd81fb2ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:09 devstack sudo[95936]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-06f91de1-5313-46c1-b6d4-e948c3a77f4f tempest-SnapshotsActionsTest-2090918635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.ec8ac1ec-5775-44b7-a431-0d5c81b4274d" returned: 0 in 0.466s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-06f91de1-5313-46c1-b6d4-e948c3a77f4f tempest-SnapshotsActionsTest-2090918635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.ec8ac1ec-5775-44b7-a431-0d5c81b4274d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:09 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-90d07061-29f6-430e-a507-a6efa93b6264 tempest-VolumesListAdminTestJSON-251344915 None] Volume volume-313e502c-9ef2-4786-bbd5-64c8794c915d (313e502c-9ef2-4786-bbd5-64c8794c915d): created successfully
Nov 05 19:14:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-90d07061-29f6-430e-a507-a6efa93b6264 tempest-VolumesListAdminTestJSON-251344915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (378cfedb-6fb9-4825-a0e0-63bd81fb2ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-90d07061-29f6-430e-a507-a6efa93b6264 tempest-VolumesListAdminTestJSON-251344915 None] Flow 'volume_create_manager' (8bfee027-f017-4905-9b85-6340d7ea3aa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:14:09 devstack sudo[95950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.ec8ac1ec-5775-44b7-a431-0d5c81b4274d
Nov 05 19:14:09 devstack sudo[95950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:09 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-90d07061-29f6-430e-a507-a6efa93b6264 tempest-VolumesListAdminTestJSON-251344915 None] Created volume successfully.
Nov 05 19:14:09 devstack sudo[95943]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9affca2a-c1eb-4648-b584-03359990404a tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a" returned: 0 in 0.454s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9affca2a-c1eb-4648-b584-03359990404a tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:09 devstack sudo[95956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a
Nov 05 19:14:09 devstack sudo[95956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:09 devstack sudo[95950]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-06f91de1-5313-46c1-b6d4-e948c3a77f4f tempest-SnapshotsActionsTest-2090918635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.ec8ac1ec-5775-44b7-a431-0d5c81b4274d" returned: 0 in 0.309s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-06f91de1-5313-46c1-b6d4-e948c3a77f4f tempest-SnapshotsActionsTest-2090918635 None] Lock "cinder-quobyte-ec8ac1ec-5775-44b7-a431-0d5c81b4274d" released by "_delete_snapshot" :: held 1.824s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-06f91de1-5313-46c1-b6d4-e948c3a77f4f tempest-SnapshotsActionsTest-2090918635 None] Lock "cinder-quobyte-0ea23a53-8ebf-495d-91ca-dd13f63e9516" released by "delete_snapshot" :: held 1.864s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:10 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-06f91de1-5313-46c1-b6d4-e948c3a77f4f tempest-SnapshotsActionsTest-2090918635 None] Created reservations ['4462e097-9469-4852-a7d1-29d2dca29e16', '02109d53-39d2-4de7-bc35-b0db09e15462', 'e30983f3-7400-4817-bbd9-383ead98596b', '5d44a38f-578f-4750-b23d-ef432e1d689c'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:14:10 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-06f91de1-5313-46c1-b6d4-e948c3a77f4f tempest-SnapshotsActionsTest-2090918635 None] Delete snapshot completed successfully.
Nov 05 19:14:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-06f91de1-5313-46c1-b6d4-e948c3a77f4f tempest-SnapshotsActionsTest-2090918635 None] Lock "cinder-ec8ac1ec-5775-44b7-a431-0d5c81b4274d-delete_snapshot" released by "delete_snapshot" :: held 2.037s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:10 devstack sudo[95956]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9affca2a-c1eb-4648-b584-03359990404a tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-52737dfe-f0a1-4b51-9ad3-60f32909d94a" returned: 0 in 0.333s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9affca2a-c1eb-4648-b584-03359990404a tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-quobyte-52737dfe-f0a1-4b51-9ad3-60f32909d94a" released by "delete_volume" :: held 0.875s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:10 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-9affca2a-c1eb-4648-b584-03359990404a tempest-VolumesSnapshotTestJSON-1250160096 None] Created reservations ['3523308c-f5b3-4843-8a29-989266d34e93', '22718cf8-9353-4610-83a5-8b7d3f03849f', '353062b1-15dc-48ae-aee6-894f9aa9870f', 'a28fc15f-f07c-42ac-bf07-a3c60633170b'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:14:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9affca2a-c1eb-4648-b584-03359990404a tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:14:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9affca2a-c1eb-4648-b584-03359990404a tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:14:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9affca2a-c1eb-4648-b584-03359990404a tempest-VolumesSnapshotTestJSON-1250160096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:14:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9affca2a-c1eb-4648-b584-03359990404a tempest-VolumesSnapshotTestJSON-1250160096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:14:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9affca2a-c1eb-4648-b584-03359990404a tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:14:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9affca2a-c1eb-4648-b584-03359990404a tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-70ff4177-dfcc-442e-9732-0e60d8fa6a3c req-87dc4e43-08cc-4a0d-9ae4-06d2eb17bb07 tempest-AttachVolumeNegativeTest-1202125091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:14:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-70ff4177-dfcc-442e-9732-0e60d8fa6a3c req-87dc4e43-08cc-4a0d-9ae4-06d2eb17bb07 tempest-AttachVolumeNegativeTest-1202125091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:14:10 devstack sudo[95967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:14:10 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-70ff4177-dfcc-442e-9732-0e60d8fa6a3c req-87dc4e43-08cc-4a0d-9ae4-06d2eb17bb07 tempest-AttachVolumeNegativeTest-1202125091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:14:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-70ff4177-dfcc-442e-9732-0e60d8fa6a3c req-87dc4e43-08cc-4a0d-9ae4-06d2eb17bb07 tempest-AttachVolumeNegativeTest-1202125091 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec', 'name': 'volume-85dda47b-fd4a-4cb1-a009-1ef8bb639e31', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b4dc7264-fa48-4c21-9319-6e40fde83bda', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 19:14:10 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-70ff4177-dfcc-442e-9732-0e60d8fa6a3c req-87dc4e43-08cc-4a0d-9ae4-06d2eb17bb07 tempest-AttachVolumeNegativeTest-1202125091 None] attachment_update completed successfully.
Nov 05 19:14:10 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9affca2a-c1eb-4648-b584-03359990404a tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.325s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:10 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-9affca2a-c1eb-4648-b584-03359990404a tempest-VolumesSnapshotTestJSON-1250160096 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:14:10 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-9affca2a-c1eb-4648-b584-03359990404a tempest-VolumesSnapshotTestJSON-1250160096 None] Deleted volume successfully.
Nov 05 19:14:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9affca2a-c1eb-4648-b584-03359990404a tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-52737dfe-f0a1-4b51-9ad3-60f32909d94a-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c63ba549-948a-4ad4-a853-2e228fcc2011 tempest-SnapshotsActionsTest-1023533080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:14:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c63ba549-948a-4ad4-a853-2e228fcc2011 tempest-SnapshotsActionsTest-1023533080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:14:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-c63ba549-948a-4ad4-a853-2e228fcc2011 tempest-SnapshotsActionsTest-1023533080 None] Creating offline snapshot 32131a94-8f05-4fc5-8d57-2b948dd9affa of volume 0ea23a53-8ebf-495d-91ca-dd13f63e9516 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:14:11 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-714c7cb3-b8eb-419f-9c5a-5b565ac287f8 tempest-VolumesListAdminTestJSON-497129550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:14:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-714c7cb3-b8eb-419f-9c5a-5b565ac287f8 tempest-VolumesListAdminTestJSON-497129550 None] Flow 'volume_create_manager' (2f06bebf-09ca-495a-a4e1-bcd69e76e849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:14:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-714c7cb3-b8eb-419f-9c5a-5b565ac287f8 tempest-VolumesListAdminTestJSON-497129550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ce18140-7c4e-4a15-98fe-769dd1521db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:11 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[da192017-29e5-4c96-953a-4f9c627fec8d]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:14:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c63ba549-948a-4ad4-a853-2e228fcc2011 tempest-SnapshotsActionsTest-1023533080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-714c7cb3-b8eb-419f-9c5a-5b565ac287f8 tempest-VolumesListAdminTestJSON-497129550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ce18140-7c4e-4a15-98fe-769dd1521db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f0b84bb-ff45-4ffd-b737-4d347cb19a84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e92dcf93c674840b79bee07b58930b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:14:11Z,use_quota=True,user_id='3d0858c74199452fb18ac09d68ca15e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-714c7cb3-b8eb-419f-9c5a-5b565ac287f8 tempest-VolumesListAdminTestJSON-497129550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f80538f-eea3-4255-892d-aa7ad7b24489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-714c7cb3-b8eb-419f-9c5a-5b565ac287f8 tempest-VolumesListAdminTestJSON-497129550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f80538f-eea3-4255-892d-aa7ad7b24489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-714c7cb3-b8eb-419f-9c5a-5b565ac287f8 tempest-VolumesListAdminTestJSON-497129550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b172060f-bf1a-4f7e-a2cd-d2ce3622dcff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-714c7cb3-b8eb-419f-9c5a-5b565ac287f8 tempest-VolumesListAdminTestJSON-497129550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b172060f-bf1a-4f7e-a2cd-d2ce3622dcff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f0b84bb-ff45-4ffd-b737-4d347cb19a84', 'volume_name': 'volume-9f0b84bb-ff45-4ffd-b737-4d347cb19a84', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-714c7cb3-b8eb-419f-9c5a-5b565ac287f8 tempest-VolumesListAdminTestJSON-497129550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c83436-3b22-4c2d-97c6-f478094f1e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-714c7cb3-b8eb-419f-9c5a-5b565ac287f8 tempest-VolumesListAdminTestJSON-497129550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c83436-3b22-4c2d-97c6-f478094f1e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-714c7cb3-b8eb-419f-9c5a-5b565ac287f8 tempest-VolumesListAdminTestJSON-497129550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c453bfa5-c12b-4d85-bb30-64246388874f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:11 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-714c7cb3-b8eb-419f-9c5a-5b565ac287f8 tempest-VolumesListAdminTestJSON-497129550 None] Volume 9f0b84bb-ff45-4ffd-b737-4d347cb19a84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f0b84bb-ff45-4ffd-b737-4d347cb19a84', 'volume_size': 1}
Nov 05 19:14:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-714c7cb3-b8eb-419f-9c5a-5b565ac287f8 tempest-VolumesListAdminTestJSON-497129550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:14:11 devstack sudo[96386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95
Nov 05 19:14:11 devstack sudo[96386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:11 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-c417cb9f-7480-43a6-8721-5edf3c9a5afb tempest-VolumesSnapshotTestJSON-1250160096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:14:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c417cb9f-7480-43a6-8721-5edf3c9a5afb tempest-VolumesSnapshotTestJSON-1250160096 None] Flow 'volume_create_manager' (635bee5d-04b7-4552-9c59-6e578eb985fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:14:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c417cb9f-7480-43a6-8721-5edf3c9a5afb tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2953c6a5-4efa-43f0-8576-a329501f0dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c417cb9f-7480-43a6-8721-5edf3c9a5afb tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2953c6a5-4efa-43f0-8576-a329501f0dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2054305796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80b770ca-7afb-4f5e-809a-1ec9742aa22c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2f776d18f5e4d06accc37697484a770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:14:12Z,use_quota=True,user_id='c4be2d0faca24936a7799988f3d60760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c417cb9f-7480-43a6-8721-5edf3c9a5afb tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f156be-f750-4ef5-9b4d-e312da42aefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c417cb9f-7480-43a6-8721-5edf3c9a5afb tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f156be-f750-4ef5-9b4d-e312da42aefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c417cb9f-7480-43a6-8721-5edf3c9a5afb tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aabb27c8-46c2-4665-89e4-1c9714f32685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c417cb9f-7480-43a6-8721-5edf3c9a5afb tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aabb27c8-46c2-4665-89e4-1c9714f32685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80b770ca-7afb-4f5e-809a-1ec9742aa22c', 'volume_name': 'volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c417cb9f-7480-43a6-8721-5edf3c9a5afb tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8cfa25d-7259-4c1e-b5f7-993bb250ae82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c417cb9f-7480-43a6-8721-5edf3c9a5afb tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8cfa25d-7259-4c1e-b5f7-993bb250ae82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c417cb9f-7480-43a6-8721-5edf3c9a5afb tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (276da262-3c64-4bec-a397-d19cd28e635c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:11 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-c417cb9f-7480-43a6-8721-5edf3c9a5afb tempest-VolumesSnapshotTestJSON-1250160096 None] Volume 80b770ca-7afb-4f5e-809a-1ec9742aa22c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c', 'volume_size': 1}
Nov 05 19:14:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c417cb9f-7480-43a6-8721-5edf3c9a5afb tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:14:11 devstack sudo[96386]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c63ba549-948a-4ad4-a853-2e228fcc2011 tempest-SnapshotsActionsTest-1023533080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95" returned: 0 in 0.465s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-c63ba549-948a-4ad4-a853-2e228fcc2011 tempest-SnapshotsActionsTest-1023533080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:14:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c63ba549-948a-4ad4-a853-2e228fcc2011 tempest-SnapshotsActionsTest-1023533080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.32131a94-8f05-4fc5-8d57-2b948dd9affa 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:12 devstack sudo[96391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.32131a94-8f05-4fc5-8d57-2b948dd9affa 1G
Nov 05 19:14:12 devstack sudo[96391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:12 devstack sudo[96391]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c63ba549-948a-4ad4-a853-2e228fcc2011 tempest-SnapshotsActionsTest-1023533080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.32131a94-8f05-4fc5-8d57-2b948dd9affa 1G" returned: 0 in 0.471s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c63ba549-948a-4ad4-a853-2e228fcc2011 tempest-SnapshotsActionsTest-1023533080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.32131a94-8f05-4fc5-8d57-2b948dd9affa {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:12 devstack sudo[96397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.32131a94-8f05-4fc5-8d57-2b948dd9affa
Nov 05 19:14:12 devstack sudo[96397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:12 devstack sudo[96397]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c63ba549-948a-4ad4-a853-2e228fcc2011 tempest-SnapshotsActionsTest-1023533080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.32131a94-8f05-4fc5-8d57-2b948dd9affa" returned: 0 in 0.335s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:12 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-c63ba549-948a-4ad4-a853-2e228fcc2011 tempest-SnapshotsActionsTest-1023533080 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.32131a94-8f05-4fc5-8d57-2b948dd9affa is being set with open permissions: ugo+rw
Nov 05 19:14:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c63ba549-948a-4ad4-a853-2e228fcc2011 tempest-SnapshotsActionsTest-1023533080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.32131a94-8f05-4fc5-8d57-2b948dd9affa {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:12 devstack sudo[96402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.32131a94-8f05-4fc5-8d57-2b948dd9affa
Nov 05 19:14:12 devstack sudo[96402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:13 devstack sudo[96402]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c63ba549-948a-4ad4-a853-2e228fcc2011 tempest-SnapshotsActionsTest-1023533080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.32131a94-8f05-4fc5-8d57-2b948dd9affa" returned: 0 in 0.273s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c63ba549-948a-4ad4-a853-2e228fcc2011 tempest-SnapshotsActionsTest-1023533080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.802s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:14:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-714c7cb3-b8eb-419f-9c5a-5b565ac287f8 tempest-VolumesListAdminTestJSON-497129550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.440s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:14:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-714c7cb3-b8eb-419f-9c5a-5b565ac287f8 tempest-VolumesListAdminTestJSON-497129550 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f0b84bb-ff45-4ffd-b737-4d347cb19a84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e92dcf93c674840b79bee07b58930b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:14:11Z,use_quota=True,user_id='3d0858c74199452fb18ac09d68ca15e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:14:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-714c7cb3-b8eb-419f-9c5a-5b565ac287f8 tempest-VolumesListAdminTestJSON-497129550 None] Creating volume 9f0b84bb-ff45-4ffd-b737-4d347cb19a84 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:14:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-714c7cb3-b8eb-419f-9c5a-5b565ac287f8 tempest-VolumesListAdminTestJSON-497129550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:14:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-714c7cb3-b8eb-419f-9c5a-5b565ac287f8 tempest-VolumesListAdminTestJSON-497129550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:14:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-714c7cb3-b8eb-419f-9c5a-5b565ac287f8 tempest-VolumesListAdminTestJSON-497129550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:14:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-714c7cb3-b8eb-419f-9c5a-5b565ac287f8 tempest-VolumesListAdminTestJSON-497129550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:14:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-714c7cb3-b8eb-419f-9c5a-5b565ac287f8 tempest-VolumesListAdminTestJSON-497129550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:14:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-714c7cb3-b8eb-419f-9c5a-5b565ac287f8 tempest-VolumesListAdminTestJSON-497129550 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:14:13 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-714c7cb3-b8eb-419f-9c5a-5b565ac287f8 tempest-VolumesListAdminTestJSON-497129550 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:14:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-714c7cb3-b8eb-419f-9c5a-5b565ac287f8 tempest-VolumesListAdminTestJSON-497129550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9f0b84bb-ff45-4ffd-b737-4d347cb19a84 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:13 devstack sudo[96431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9f0b84bb-ff45-4ffd-b737-4d347cb19a84 1073741824
Nov 05 19:14:13 devstack sudo[96431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:13 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-728c18a3-2178-4627-986d-c71e6b551671 req-5ef78fe8-4bbc-4eb1-9b1d-cc22bebb196a tempest-AttachVolumeNegativeTest-1202125091 None] Terminate volume connection completed successfully.
Nov 05 19:14:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-728c18a3-2178-4627-986d-c71e6b551671 req-5ef78fe8-4bbc-4eb1-9b1d-cc22bebb196a tempest-AttachVolumeNegativeTest-1202125091 None] Deleting attachment b4dc7264-fa48-4c21-9319-6e40fde83bda. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 19:14:13 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-c63ba549-948a-4ad4-a853-2e228fcc2011 tempest-SnapshotsActionsTest-1023533080 None] Create snapshot completed successfully
Nov 05 19:14:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cddd6341-6ee8-4f7f-91d4-9f083b9646cb tempest-SnapshotsActionsTest-2090918635 None] Acquiring lock "cinder-32131a94-8f05-4fc5-8d57-2b948dd9affa-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cddd6341-6ee8-4f7f-91d4-9f083b9646cb tempest-SnapshotsActionsTest-2090918635 None] Lock "cinder-32131a94-8f05-4fc5-8d57-2b948dd9affa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cddd6341-6ee8-4f7f-91d4-9f083b9646cb tempest-SnapshotsActionsTest-2090918635 None] Acquiring lock "cinder-quobyte-0ea23a53-8ebf-495d-91ca-dd13f63e9516" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cddd6341-6ee8-4f7f-91d4-9f083b9646cb tempest-SnapshotsActionsTest-2090918635 None] Lock "cinder-quobyte-0ea23a53-8ebf-495d-91ca-dd13f63e9516" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cddd6341-6ee8-4f7f-91d4-9f083b9646cb tempest-SnapshotsActionsTest-2090918635 None] Acquiring lock "cinder-quobyte-32131a94-8f05-4fc5-8d57-2b948dd9affa" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cddd6341-6ee8-4f7f-91d4-9f083b9646cb tempest-SnapshotsActionsTest-2090918635 None] Lock "cinder-quobyte-32131a94-8f05-4fc5-8d57-2b948dd9affa" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-cddd6341-6ee8-4f7f-91d4-9f083b9646cb tempest-SnapshotsActionsTest-2090918635 None] Deleting offline snapshot 32131a94-8f05-4fc5-8d57-2b948dd9affa of volume 0ea23a53-8ebf-495d-91ca-dd13f63e9516 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:14:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-cddd6341-6ee8-4f7f-91d4-9f083b9646cb tempest-SnapshotsActionsTest-2090918635 None] snapshot_file for this snap is: volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.32131a94-8f05-4fc5-8d57-2b948dd9affa {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:14:13 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc84362-1535-40bb-9839-d8b723d224e6]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:14:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cddd6341-6ee8-4f7f-91d4-9f083b9646cb tempest-SnapshotsActionsTest-2090918635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.32131a94-8f05-4fc5-8d57-2b948dd9affa {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:13 devstack sudo[96436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.32131a94-8f05-4fc5-8d57-2b948dd9affa
Nov 05 19:14:13 devstack sudo[96436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:13 devstack sudo[96431]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-714c7cb3-b8eb-419f-9c5a-5b565ac287f8 tempest-VolumesListAdminTestJSON-497129550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9f0b84bb-ff45-4ffd-b737-4d347cb19a84 1073741824" returned: 0 in 0.533s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-714c7cb3-b8eb-419f-9c5a-5b565ac287f8 tempest-VolumesListAdminTestJSON-497129550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9f0b84bb-ff45-4ffd-b737-4d347cb19a84 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:13 devstack sudo[96438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9f0b84bb-ff45-4ffd-b737-4d347cb19a84
Nov 05 19:14:13 devstack sudo[96438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:13 devstack sudo[96436]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cddd6341-6ee8-4f7f-91d4-9f083b9646cb tempest-SnapshotsActionsTest-2090918635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.32131a94-8f05-4fc5-8d57-2b948dd9affa" returned: 0 in 0.424s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-cddd6341-6ee8-4f7f-91d4-9f083b9646cb tempest-SnapshotsActionsTest-2090918635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:14:14 devstack sudo[96438]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-714c7cb3-b8eb-419f-9c5a-5b565ac287f8 tempest-VolumesListAdminTestJSON-497129550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9f0b84bb-ff45-4ffd-b737-4d347cb19a84" returned: 0 in 0.278s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-714c7cb3-b8eb-419f-9c5a-5b565ac287f8 tempest-VolumesListAdminTestJSON-497129550 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:14:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-714c7cb3-b8eb-419f-9c5a-5b565ac287f8 tempest-VolumesListAdminTestJSON-497129550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:14:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c417cb9f-7480-43a6-8721-5edf3c9a5afb tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.207s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:14:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c417cb9f-7480-43a6-8721-5edf3c9a5afb tempest-VolumesSnapshotTestJSON-1250160096 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2054305796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80b770ca-7afb-4f5e-809a-1ec9742aa22c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2f776d18f5e4d06accc37697484a770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:14:12Z,use_quota=True,user_id='c4be2d0faca24936a7799988f3d60760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:14:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-c417cb9f-7480-43a6-8721-5edf3c9a5afb tempest-VolumesSnapshotTestJSON-1250160096 None] Creating volume 80b770ca-7afb-4f5e-809a-1ec9742aa22c {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:14:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c417cb9f-7480-43a6-8721-5edf3c9a5afb tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:14:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c417cb9f-7480-43a6-8721-5edf3c9a5afb tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:14:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c417cb9f-7480-43a6-8721-5edf3c9a5afb tempest-VolumesSnapshotTestJSON-1250160096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:14:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c417cb9f-7480-43a6-8721-5edf3c9a5afb tempest-VolumesSnapshotTestJSON-1250160096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:14:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c417cb9f-7480-43a6-8721-5edf3c9a5afb tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:14:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c417cb9f-7480-43a6-8721-5edf3c9a5afb tempest-VolumesSnapshotTestJSON-1250160096 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:14:14 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-c417cb9f-7480-43a6-8721-5edf3c9a5afb tempest-VolumesSnapshotTestJSON-1250160096 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:14:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c417cb9f-7480-43a6-8721-5edf3c9a5afb tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:14 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9189cdd1-4fe1-49d6-a2c3-9da075a9bd49]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:14:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cddd6341-6ee8-4f7f-91d4-9f083b9646cb tempest-SnapshotsActionsTest-2090918635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:14 devstack sudo[96444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c 1073741824
Nov 05 19:14:14 devstack sudo[96444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-714c7cb3-b8eb-419f-9c5a-5b565ac287f8 tempest-VolumesListAdminTestJSON-497129550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c453bfa5-c12b-4d85-bb30-64246388874f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f0b84bb-ff45-4ffd-b737-4d347cb19a84', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-714c7cb3-b8eb-419f-9c5a-5b565ac287f8 tempest-VolumesListAdminTestJSON-497129550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bea3a55-c44b-4006-885b-18fdedf2bc22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:14 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-714c7cb3-b8eb-419f-9c5a-5b565ac287f8 tempest-VolumesListAdminTestJSON-497129550 None] Volume volume-9f0b84bb-ff45-4ffd-b737-4d347cb19a84 (9f0b84bb-ff45-4ffd-b737-4d347cb19a84): created successfully
Nov 05 19:14:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-714c7cb3-b8eb-419f-9c5a-5b565ac287f8 tempest-VolumesListAdminTestJSON-497129550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bea3a55-c44b-4006-885b-18fdedf2bc22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-714c7cb3-b8eb-419f-9c5a-5b565ac287f8 tempest-VolumesListAdminTestJSON-497129550 None] Flow 'volume_create_manager' (2f06bebf-09ca-495a-a4e1-bcd69e76e849) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:14:14 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-714c7cb3-b8eb-419f-9c5a-5b565ac287f8 tempest-VolumesListAdminTestJSON-497129550 None] Created volume successfully.
Nov 05 19:14:14 devstack sudo[96445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95
Nov 05 19:14:14 devstack sudo[96445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e9a1f22a-b1e7-4216-98af-fa65eb23c7aa tempest-VolumesListAdminTestJSON-497129550 None] Acquiring lock "cinder-9f0b84bb-ff45-4ffd-b737-4d347cb19a84-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e9a1f22a-b1e7-4216-98af-fa65eb23c7aa tempest-VolumesListAdminTestJSON-497129550 None] Lock "cinder-9f0b84bb-ff45-4ffd-b737-4d347cb19a84-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:14 devstack sudo[96445]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e9a1f22a-b1e7-4216-98af-fa65eb23c7aa tempest-VolumesListAdminTestJSON-497129550 None] Acquiring lock "cinder-quobyte-9f0b84bb-ff45-4ffd-b737-4d347cb19a84" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cddd6341-6ee8-4f7f-91d4-9f083b9646cb tempest-SnapshotsActionsTest-2090918635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95" returned: 0 in 0.715s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-cddd6341-6ee8-4f7f-91d4-9f083b9646cb tempest-SnapshotsActionsTest-2090918635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:14:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cddd6341-6ee8-4f7f-91d4-9f083b9646cb tempest-SnapshotsActionsTest-2090918635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.32131a94-8f05-4fc5-8d57-2b948dd9affa {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:14 devstack sudo[96467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.32131a94-8f05-4fc5-8d57-2b948dd9affa
Nov 05 19:14:14 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e9a1f22a-b1e7-4216-98af-fa65eb23c7aa tempest-VolumesListAdminTestJSON-497129550 None] Lock "cinder-quobyte-9f0b84bb-ff45-4ffd-b737-4d347cb19a84" acquired by "delete_volume" :: waited 0.130s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:14 devstack sudo[96444]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c417cb9f-7480-43a6-8721-5edf3c9a5afb tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c 1073741824" returned: 0 in 0.894s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:14 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[013f8ed8-4ca1-4e26-b282-2a33c08354d1]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:14:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e9a1f22a-b1e7-4216-98af-fa65eb23c7aa tempest-VolumesListAdminTestJSON-497129550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9f0b84bb-ff45-4ffd-b737-4d347cb19a84 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-97c4221b-d3ed-463d-a55e-4070722bac8b tempest-VolumesListAdminTestJSON-251344915 None] Acquiring lock "cinder-313e502c-9ef2-4786-bbd5-64c8794c915d-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-97c4221b-d3ed-463d-a55e-4070722bac8b tempest-VolumesListAdminTestJSON-251344915 None] Lock "cinder-313e502c-9ef2-4786-bbd5-64c8794c915d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c417cb9f-7480-43a6-8721-5edf3c9a5afb tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:15 devstack sudo[96476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c
Nov 05 19:14:15 devstack sudo[96474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9f0b84bb-ff45-4ffd-b737-4d347cb19a84
Nov 05 19:14:15 devstack sudo[96476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:15 devstack sudo[96474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-97c4221b-d3ed-463d-a55e-4070722bac8b tempest-VolumesListAdminTestJSON-251344915 None] Acquiring lock "cinder-quobyte-313e502c-9ef2-4786-bbd5-64c8794c915d" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-97c4221b-d3ed-463d-a55e-4070722bac8b tempest-VolumesListAdminTestJSON-251344915 None] Lock "cinder-quobyte-313e502c-9ef2-4786-bbd5-64c8794c915d" acquired by "delete_volume" :: waited 0.026s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:15 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c5e970-7f2c-4446-8f8f-1ec2fabaaab0]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:14:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-97c4221b-d3ed-463d-a55e-4070722bac8b tempest-VolumesListAdminTestJSON-251344915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-313e502c-9ef2-4786-bbd5-64c8794c915d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:15 devstack sudo[96480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-313e502c-9ef2-4786-bbd5-64c8794c915d
Nov 05 19:14:15 devstack sudo[96480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:15 devstack sudo[96476]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c417cb9f-7480-43a6-8721-5edf3c9a5afb tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c" returned: 0 in 0.406s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:15 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c417cb9f-7480-43a6-8721-5edf3c9a5afb tempest-VolumesSnapshotTestJSON-1250160096 None] <== create_volume: return (1421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:14:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c417cb9f-7480-43a6-8721-5edf3c9a5afb tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.424s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:14:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c417cb9f-7480-43a6-8721-5edf3c9a5afb tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (276da262-3c64-4bec-a397-d19cd28e635c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c417cb9f-7480-43a6-8721-5edf3c9a5afb tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fc08679-150f-491a-bc2b-a121a31e6015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:15 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-c417cb9f-7480-43a6-8721-5edf3c9a5afb tempest-VolumesSnapshotTestJSON-1250160096 None] Volume volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c (80b770ca-7afb-4f5e-809a-1ec9742aa22c): created successfully
Nov 05 19:14:15 devstack sudo[96474]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c417cb9f-7480-43a6-8721-5edf3c9a5afb tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fc08679-150f-491a-bc2b-a121a31e6015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c417cb9f-7480-43a6-8721-5edf3c9a5afb tempest-VolumesSnapshotTestJSON-1250160096 None] Flow 'volume_create_manager' (635bee5d-04b7-4552-9c59-6e578eb985fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:14:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e9a1f22a-b1e7-4216-98af-fa65eb23c7aa tempest-VolumesListAdminTestJSON-497129550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9f0b84bb-ff45-4ffd-b737-4d347cb19a84" returned: 0 in 0.560s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e9a1f22a-b1e7-4216-98af-fa65eb23c7aa tempest-VolumesListAdminTestJSON-497129550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9f0b84bb-ff45-4ffd-b737-4d347cb19a84 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:15 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cddd6341-6ee8-4f7f-91d4-9f083b9646cb tempest-SnapshotsActionsTest-2090918635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.32131a94-8f05-4fc5-8d57-2b948dd9affa" returned: 0 in 0.752s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cddd6341-6ee8-4f7f-91d4-9f083b9646cb tempest-SnapshotsActionsTest-2090918635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.32131a94-8f05-4fc5-8d57-2b948dd9affa {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:15 devstack sudo[96492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9f0b84bb-ff45-4ffd-b737-4d347cb19a84
Nov 05 19:14:15 devstack sudo[96492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:15 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-c417cb9f-7480-43a6-8721-5edf3c9a5afb tempest-VolumesSnapshotTestJSON-1250160096 None] Created volume successfully.
Nov 05 19:14:15 devstack sudo[96494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.32131a94-8f05-4fc5-8d57-2b948dd9affa
Nov 05 19:14:15 devstack sudo[96494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:15 devstack sudo[96480]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-97c4221b-d3ed-463d-a55e-4070722bac8b tempest-VolumesListAdminTestJSON-251344915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-313e502c-9ef2-4786-bbd5-64c8794c915d" returned: 0 in 0.619s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-97c4221b-d3ed-463d-a55e-4070722bac8b tempest-VolumesListAdminTestJSON-251344915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-313e502c-9ef2-4786-bbd5-64c8794c915d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:15 devstack sudo[96500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-313e502c-9ef2-4786-bbd5-64c8794c915d
Nov 05 19:14:15 devstack sudo[96500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:15 devstack sudo[96494]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cddd6341-6ee8-4f7f-91d4-9f083b9646cb tempest-SnapshotsActionsTest-2090918635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.32131a94-8f05-4fc5-8d57-2b948dd9affa" returned: 0 in 0.436s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:15 devstack sudo[96492]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e9a1f22a-b1e7-4216-98af-fa65eb23c7aa tempest-VolumesListAdminTestJSON-497129550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9f0b84bb-ff45-4ffd-b737-4d347cb19a84" returned: 0 in 0.520s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cddd6341-6ee8-4f7f-91d4-9f083b9646cb tempest-SnapshotsActionsTest-2090918635 None] Lock "cinder-quobyte-32131a94-8f05-4fc5-8d57-2b948dd9affa" released by "_delete_snapshot" :: held 2.548s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e9a1f22a-b1e7-4216-98af-fa65eb23c7aa tempest-VolumesListAdminTestJSON-497129550 None] Lock "cinder-quobyte-9f0b84bb-ff45-4ffd-b737-4d347cb19a84" released by "delete_volume" :: held 1.197s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cddd6341-6ee8-4f7f-91d4-9f083b9646cb tempest-SnapshotsActionsTest-2090918635 None] Lock "cinder-quobyte-0ea23a53-8ebf-495d-91ca-dd13f63e9516" released by "delete_snapshot" :: held 2.596s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:16 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-e9a1f22a-b1e7-4216-98af-fa65eb23c7aa tempest-VolumesListAdminTestJSON-497129550 None] Created reservations ['605a7f74-9368-4b4f-bff8-193fe2202a6b', 'c1ebdc51-a658-4618-a7a5-ca564401c752', '44890b7a-2449-4670-911c-a85e82b1434d', 'e1f1ecfc-8848-4b92-93b2-72473f9e54f9'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:14:16 devstack sudo[96500]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-97c4221b-d3ed-463d-a55e-4070722bac8b tempest-VolumesListAdminTestJSON-251344915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-313e502c-9ef2-4786-bbd5-64c8794c915d" returned: 0 in 0.489s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:16 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-cddd6341-6ee8-4f7f-91d4-9f083b9646cb tempest-SnapshotsActionsTest-2090918635 None] Created reservations ['3cdfe9b6-2711-408b-bc1a-e926ee64fc54', 'fff425b4-f43a-4449-bfe2-114b2bf41d0c', '59a8d006-b68c-4d6f-8d65-93e0c7f8b9b6', '6407da0b-2c07-412b-bf96-ab5940e68b48'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:14:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-97c4221b-d3ed-463d-a55e-4070722bac8b tempest-VolumesListAdminTestJSON-251344915 None] Lock "cinder-quobyte-313e502c-9ef2-4786-bbd5-64c8794c915d" released by "delete_volume" :: held 1.204s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e9a1f22a-b1e7-4216-98af-fa65eb23c7aa tempest-VolumesListAdminTestJSON-497129550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:14:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e9a1f22a-b1e7-4216-98af-fa65eb23c7aa tempest-VolumesListAdminTestJSON-497129550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:14:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e9a1f22a-b1e7-4216-98af-fa65eb23c7aa tempest-VolumesListAdminTestJSON-497129550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:14:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e9a1f22a-b1e7-4216-98af-fa65eb23c7aa tempest-VolumesListAdminTestJSON-497129550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:14:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e9a1f22a-b1e7-4216-98af-fa65eb23c7aa tempest-VolumesListAdminTestJSON-497129550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:14:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e9a1f22a-b1e7-4216-98af-fa65eb23c7aa tempest-VolumesListAdminTestJSON-497129550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:16 devstack sudo[96510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:14:16 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e95e9e47-d697-4154-b6e9-db8c470857ad tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:14:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e95e9e47-d697-4154-b6e9-db8c470857ad tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:14:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-e95e9e47-d697-4154-b6e9-db8c470857ad tempest-VolumesSnapshotTestJSON-1250160096 None] Creating offline snapshot 380ee38e-ce70-4005-aac6-7e9aabcb4821 of volume 80b770ca-7afb-4f5e-809a-1ec9742aa22c {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:14:16 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d67ba7-140f-422f-bcd8-7d802568dcc4]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:14:16 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-cddd6341-6ee8-4f7f-91d4-9f083b9646cb tempest-SnapshotsActionsTest-2090918635 None] Delete snapshot completed successfully.
Nov 05 19:14:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e95e9e47-d697-4154-b6e9-db8c470857ad tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cddd6341-6ee8-4f7f-91d4-9f083b9646cb tempest-SnapshotsActionsTest-2090918635 None] Lock "cinder-32131a94-8f05-4fc5-8d57-2b948dd9affa-delete_snapshot" released by "delete_snapshot" :: held 3.210s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:16 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-97c4221b-d3ed-463d-a55e-4070722bac8b tempest-VolumesListAdminTestJSON-251344915 None] Created reservations ['3fff4c65-fb89-49d4-b519-9442808720af', '638da9cd-5ca5-4dee-9771-b9d88994cacd', '1aafefed-072b-40f4-bc38-1d6c333dc323', '983e702f-73a1-410c-86ff-67d26cdb9681'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:14:16 devstack sudo[96512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c
Nov 05 19:14:16 devstack sudo[96512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-97c4221b-d3ed-463d-a55e-4070722bac8b tempest-VolumesListAdminTestJSON-251344915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:14:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-97c4221b-d3ed-463d-a55e-4070722bac8b tempest-VolumesListAdminTestJSON-251344915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:14:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-97c4221b-d3ed-463d-a55e-4070722bac8b tempest-VolumesListAdminTestJSON-251344915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:14:16 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-97c4221b-d3ed-463d-a55e-4070722bac8b tempest-VolumesListAdminTestJSON-251344915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:14:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-97c4221b-d3ed-463d-a55e-4070722bac8b tempest-VolumesListAdminTestJSON-251344915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:14:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-97c4221b-d3ed-463d-a55e-4070722bac8b tempest-VolumesListAdminTestJSON-251344915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e9a1f22a-b1e7-4216-98af-fa65eb23c7aa tempest-VolumesListAdminTestJSON-497129550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.396s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:16 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-e9a1f22a-b1e7-4216-98af-fa65eb23c7aa tempest-VolumesListAdminTestJSON-497129550 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:14:16 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-e9a1f22a-b1e7-4216-98af-fa65eb23c7aa tempest-VolumesListAdminTestJSON-497129550 None] Deleted volume successfully.
Nov 05 19:14:16 devstack sudo[96516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:14:16 devstack sudo[96516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e9a1f22a-b1e7-4216-98af-fa65eb23c7aa tempest-VolumesListAdminTestJSON-497129550 None] Lock "cinder-9f0b84bb-ff45-4ffd-b737-4d347cb19a84-delete_volume" released by "delete_volume" :: held 2.352s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:17 devstack sudo[96512]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e95e9e47-d697-4154-b6e9-db8c470857ad tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c" returned: 0 in 0.480s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e95e9e47-d697-4154-b6e9-db8c470857ad tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c.380ee38e-ce70-4005-aac6-7e9aabcb4821 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:17 devstack sudo[96522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c.380ee38e-ce70-4005-aac6-7e9aabcb4821 1G
Nov 05 19:14:17 devstack sudo[96522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-58a8a1d3-7c95-4700-81ce-d3396a07cc24 tempest-SnapshotsActionsTest-1023533080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:14:17 devstack sudo[96516]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-97c4221b-d3ed-463d-a55e-4070722bac8b tempest-VolumesListAdminTestJSON-251344915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.340s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:17 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-97c4221b-d3ed-463d-a55e-4070722bac8b tempest-VolumesListAdminTestJSON-251344915 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:14:17 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-97c4221b-d3ed-463d-a55e-4070722bac8b tempest-VolumesListAdminTestJSON-251344915 None] Deleted volume successfully.
Nov 05 19:14:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-97c4221b-d3ed-463d-a55e-4070722bac8b tempest-VolumesListAdminTestJSON-251344915 None] Lock "cinder-313e502c-9ef2-4786-bbd5-64c8794c915d-delete_volume" released by "delete_volume" :: held 2.218s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dbc121af-5804-4a4d-bf71-11af2b7ff4c5 tempest-VolumesListAdminTestJSON-251344915 None] Acquiring lock "cinder-0bd0538c-aade-4c87-9c03-f6fbc309121b-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dbc121af-5804-4a4d-bf71-11af2b7ff4c5 tempest-VolumesListAdminTestJSON-251344915 None] Lock "cinder-0bd0538c-aade-4c87-9c03-f6fbc309121b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dbc121af-5804-4a4d-bf71-11af2b7ff4c5 tempest-VolumesListAdminTestJSON-251344915 None] Acquiring lock "cinder-quobyte-0bd0538c-aade-4c87-9c03-f6fbc309121b" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dbc121af-5804-4a4d-bf71-11af2b7ff4c5 tempest-VolumesListAdminTestJSON-251344915 None] Lock "cinder-quobyte-0bd0538c-aade-4c87-9c03-f6fbc309121b" acquired by "delete_volume" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:17 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[de348529-542f-44ac-a6bc-8b73e63973c4]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:14:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dbc121af-5804-4a4d-bf71-11af2b7ff4c5 tempest-VolumesListAdminTestJSON-251344915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0bd0538c-aade-4c87-9c03-f6fbc309121b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:17 devstack sudo[96529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0bd0538c-aade-4c87-9c03-f6fbc309121b
Nov 05 19:14:17 devstack sudo[96529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:17 devstack sudo[96522]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e95e9e47-d697-4154-b6e9-db8c470857ad tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c.380ee38e-ce70-4005-aac6-7e9aabcb4821 1G" returned: 0 in 0.594s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e95e9e47-d697-4154-b6e9-db8c470857ad tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c.380ee38e-ce70-4005-aac6-7e9aabcb4821 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:17 devstack sudo[96531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c.380ee38e-ce70-4005-aac6-7e9aabcb4821
Nov 05 19:14:17 devstack sudo[96531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:17 devstack sudo[96529]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dbc121af-5804-4a4d-bf71-11af2b7ff4c5 tempest-VolumesListAdminTestJSON-251344915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0bd0538c-aade-4c87-9c03-f6fbc309121b" returned: 0 in 0.406s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dbc121af-5804-4a4d-bf71-11af2b7ff4c5 tempest-VolumesListAdminTestJSON-251344915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0bd0538c-aade-4c87-9c03-f6fbc309121b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:17 devstack sudo[96538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0bd0538c-aade-4c87-9c03-f6fbc309121b
Nov 05 19:14:17 devstack sudo[96538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:18 devstack sudo[96531]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e95e9e47-d697-4154-b6e9-db8c470857ad tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c.380ee38e-ce70-4005-aac6-7e9aabcb4821" returned: 0 in 0.315s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:18 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-e95e9e47-d697-4154-b6e9-db8c470857ad tempest-VolumesSnapshotTestJSON-1250160096 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c.380ee38e-ce70-4005-aac6-7e9aabcb4821 is being set with open permissions: ugo+rw
Nov 05 19:14:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e95e9e47-d697-4154-b6e9-db8c470857ad tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c.380ee38e-ce70-4005-aac6-7e9aabcb4821 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:18 devstack sudo[96542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c.380ee38e-ce70-4005-aac6-7e9aabcb4821
Nov 05 19:14:18 devstack sudo[96542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:18 devstack sudo[96538]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dbc121af-5804-4a4d-bf71-11af2b7ff4c5 tempest-VolumesListAdminTestJSON-251344915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0bd0538c-aade-4c87-9c03-f6fbc309121b" returned: 0 in 0.269s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dbc121af-5804-4a4d-bf71-11af2b7ff4c5 tempest-VolumesListAdminTestJSON-251344915 None] Lock "cinder-quobyte-0bd0538c-aade-4c87-9c03-f6fbc309121b" released by "delete_volume" :: held 0.723s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:18 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-dbc121af-5804-4a4d-bf71-11af2b7ff4c5 tempest-VolumesListAdminTestJSON-251344915 None] Created reservations ['dc056b81-3d13-4b04-b743-70cb84925e37', '5a9d0479-3dc0-4d7a-ad42-f3f6ab467f5f', '15131450-a2a0-4662-81e1-bda2f435d6ff', '63b22e8b-5858-4def-8c55-925420c3b916'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:14:18 devstack sudo[96542]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e95e9e47-d697-4154-b6e9-db8c470857ad tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c.380ee38e-ce70-4005-aac6-7e9aabcb4821" returned: 0 in 0.254s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e95e9e47-d697-4154-b6e9-db8c470857ad tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:18 devstack sudo[96546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c.info
Nov 05 19:14:18 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dbc121af-5804-4a4d-bf71-11af2b7ff4c5 tempest-VolumesListAdminTestJSON-251344915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:14:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dbc121af-5804-4a4d-bf71-11af2b7ff4c5 tempest-VolumesListAdminTestJSON-251344915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:14:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dbc121af-5804-4a4d-bf71-11af2b7ff4c5 tempest-VolumesListAdminTestJSON-251344915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:14:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dbc121af-5804-4a4d-bf71-11af2b7ff4c5 tempest-VolumesListAdminTestJSON-251344915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:14:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dbc121af-5804-4a4d-bf71-11af2b7ff4c5 tempest-VolumesListAdminTestJSON-251344915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:14:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dbc121af-5804-4a4d-bf71-11af2b7ff4c5 tempest-VolumesListAdminTestJSON-251344915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-570058af-af3b-4aeb-9dba-447d414e8b4f tempest-AttachVolumeNegativeTest-1202125091 None] Acquiring lock "cinder-85dda47b-fd4a-4cb1-a009-1ef8bb639e31-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:18 devstack sudo[96548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:14:18 devstack sudo[96548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-570058af-af3b-4aeb-9dba-447d414e8b4f tempest-AttachVolumeNegativeTest-1202125091 None] Lock "cinder-85dda47b-fd4a-4cb1-a009-1ef8bb639e31-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-570058af-af3b-4aeb-9dba-447d414e8b4f tempest-AttachVolumeNegativeTest-1202125091 None] Acquiring lock "cinder-quobyte-85dda47b-fd4a-4cb1-a009-1ef8bb639e31" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-570058af-af3b-4aeb-9dba-447d414e8b4f tempest-AttachVolumeNegativeTest-1202125091 None] Lock "cinder-quobyte-85dda47b-fd4a-4cb1-a009-1ef8bb639e31" acquired by "delete_volume" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:18 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0051dfce-a41c-4103-989f-743851ad8f83]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:14:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-570058af-af3b-4aeb-9dba-447d414e8b4f tempest-AttachVolumeNegativeTest-1202125091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-85dda47b-fd4a-4cb1-a009-1ef8bb639e31 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:18 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e95e9e47-d697-4154-b6e9-db8c470857ad tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c.info" returned: 0 in 0.313s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:18 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-e95e9e47-d697-4154-b6e9-db8c470857ad tempest-VolumesSnapshotTestJSON-1250160096 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c.info is being set with open permissions: ugo+rw
Nov 05 19:14:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e95e9e47-d697-4154-b6e9-db8c470857ad tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:18 devstack sudo[96553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c.info
Nov 05 19:14:18 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:18 devstack sudo[96548]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:18 devstack sudo[96550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-85dda47b-fd4a-4cb1-a009-1ef8bb639e31
Nov 05 19:14:18 devstack sudo[96550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dbc121af-5804-4a4d-bf71-11af2b7ff4c5 tempest-VolumesListAdminTestJSON-251344915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.303s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:18 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-dbc121af-5804-4a4d-bf71-11af2b7ff4c5 tempest-VolumesListAdminTestJSON-251344915 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:14:18 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-dbc121af-5804-4a4d-bf71-11af2b7ff4c5 tempest-VolumesListAdminTestJSON-251344915 None] Deleted volume successfully.
Nov 05 19:14:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1e0d3543-5f37-49e5-8712-f1078f313f1d tempest-VolumesListAdminTestJSON-251344915 None] Acquiring lock "cinder-47c34950-f305-4cf3-b918-240c93a00478-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1e0d3543-5f37-49e5-8712-f1078f313f1d tempest-VolumesListAdminTestJSON-251344915 None] Lock "cinder-47c34950-f305-4cf3-b918-240c93a00478-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dbc121af-5804-4a4d-bf71-11af2b7ff4c5 tempest-VolumesListAdminTestJSON-251344915 None] Lock "cinder-0bd0538c-aade-4c87-9c03-f6fbc309121b-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1e0d3543-5f37-49e5-8712-f1078f313f1d tempest-VolumesListAdminTestJSON-251344915 None] Acquiring lock "cinder-quobyte-47c34950-f305-4cf3-b918-240c93a00478" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1e0d3543-5f37-49e5-8712-f1078f313f1d tempest-VolumesListAdminTestJSON-251344915 None] Lock "cinder-quobyte-47c34950-f305-4cf3-b918-240c93a00478" acquired by "delete_volume" :: waited 0.023s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:18 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e1a313-ca22-4738-9b8f-df04a63be03a]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:14:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1e0d3543-5f37-49e5-8712-f1078f313f1d tempest-VolumesListAdminTestJSON-251344915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-47c34950-f305-4cf3-b918-240c93a00478 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:18 devstack sudo[96550]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-570058af-af3b-4aeb-9dba-447d414e8b4f tempest-AttachVolumeNegativeTest-1202125091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-85dda47b-fd4a-4cb1-a009-1ef8bb639e31" returned: 0 in 0.451s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-570058af-af3b-4aeb-9dba-447d414e8b4f tempest-AttachVolumeNegativeTest-1202125091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-85dda47b-fd4a-4cb1-a009-1ef8bb639e31 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:18 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e95e9e47-d697-4154-b6e9-db8c470857ad tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c.info" returned: 0 in 0.361s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:19 devstack sudo[96556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-47c34950-f305-4cf3-b918-240c93a00478
Nov 05 19:14:19 devstack sudo[96556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:19 devstack sudo[96561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-85dda47b-fd4a-4cb1-a009-1ef8bb639e31
Nov 05 19:14:19 devstack sudo[96561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e95e9e47-d697-4154-b6e9-db8c470857ad tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.453s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:14:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-58a8a1d3-7c95-4700-81ce-d3396a07cc24 tempest-SnapshotsActionsTest-1023533080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.836s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:14:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-58a8a1d3-7c95-4700-81ce-d3396a07cc24 tempest-SnapshotsActionsTest-1023533080 None] Creating offline snapshot 823c0194-d19d-4531-b9ae-a349e2abc8a8 of volume 0ea23a53-8ebf-495d-91ca-dd13f63e9516 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:14:19 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-e95e9e47-d697-4154-b6e9-db8c470857ad tempest-VolumesSnapshotTestJSON-1250160096 None] Create snapshot completed successfully
Nov 05 19:14:19 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ed2f65-89a8-4ce1-b940-3a1adf0eb7b6]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:14:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-58a8a1d3-7c95-4700-81ce-d3396a07cc24 tempest-SnapshotsActionsTest-1023533080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:19 devstack sudo[96561]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-570058af-af3b-4aeb-9dba-447d414e8b4f tempest-AttachVolumeNegativeTest-1202125091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-85dda47b-fd4a-4cb1-a009-1ef8bb639e31" returned: 0 in 0.283s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:19 devstack sudo[96564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95
Nov 05 19:14:19 devstack sudo[96564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-570058af-af3b-4aeb-9dba-447d414e8b4f tempest-AttachVolumeNegativeTest-1202125091 None] Lock "cinder-quobyte-85dda47b-fd4a-4cb1-a009-1ef8bb639e31" released by "delete_volume" :: held 0.800s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:19 devstack sudo[96556]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1e0d3543-5f37-49e5-8712-f1078f313f1d tempest-VolumesListAdminTestJSON-251344915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-47c34950-f305-4cf3-b918-240c93a00478" returned: 0 in 0.428s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1e0d3543-5f37-49e5-8712-f1078f313f1d tempest-VolumesListAdminTestJSON-251344915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-47c34950-f305-4cf3-b918-240c93a00478 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:19 devstack sudo[96570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-47c34950-f305-4cf3-b918-240c93a00478
Nov 05 19:14:19 devstack sudo[96570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:19 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-570058af-af3b-4aeb-9dba-447d414e8b4f tempest-AttachVolumeNegativeTest-1202125091 None] Created reservations ['1aba1260-149f-47a0-a75b-53f9553641bc', '9109b8d1-9c6a-4439-bcbf-dea15099bae2', '604ca0d2-e369-46e5-941a-7d70acf6470b', '706fae53-0b50-4157-96e3-0348a9befb0d'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:14:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-570058af-af3b-4aeb-9dba-447d414e8b4f tempest-AttachVolumeNegativeTest-1202125091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:14:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-570058af-af3b-4aeb-9dba-447d414e8b4f tempest-AttachVolumeNegativeTest-1202125091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:14:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-570058af-af3b-4aeb-9dba-447d414e8b4f tempest-AttachVolumeNegativeTest-1202125091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:14:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-570058af-af3b-4aeb-9dba-447d414e8b4f tempest-AttachVolumeNegativeTest-1202125091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:14:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-570058af-af3b-4aeb-9dba-447d414e8b4f tempest-AttachVolumeNegativeTest-1202125091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:14:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-570058af-af3b-4aeb-9dba-447d414e8b4f tempest-AttachVolumeNegativeTest-1202125091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:19 devstack sudo[96572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:14:19 devstack sudo[96572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:19 devstack sudo[96564]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-58a8a1d3-7c95-4700-81ce-d3396a07cc24 tempest-SnapshotsActionsTest-1023533080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95" returned: 0 in 0.496s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-58a8a1d3-7c95-4700-81ce-d3396a07cc24 tempest-SnapshotsActionsTest-1023533080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:14:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-58a8a1d3-7c95-4700-81ce-d3396a07cc24 tempest-SnapshotsActionsTest-1023533080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.823c0194-d19d-4531-b9ae-a349e2abc8a8 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:19 devstack sudo[96570]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1e0d3543-5f37-49e5-8712-f1078f313f1d tempest-VolumesListAdminTestJSON-251344915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-47c34950-f305-4cf3-b918-240c93a00478" returned: 0 in 0.369s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:19 devstack sudo[96579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.823c0194-d19d-4531-b9ae-a349e2abc8a8 1G
Nov 05 19:14:19 devstack sudo[96579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1e0d3543-5f37-49e5-8712-f1078f313f1d tempest-VolumesListAdminTestJSON-251344915 None] Lock "cinder-quobyte-47c34950-f305-4cf3-b918-240c93a00478" released by "delete_volume" :: held 0.865s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cb3d2e96-58df-40b5-a04b-cb63af943087 tempest-AttachVolumeNegativeTest-1202125091 None] Acquiring lock "cinder-f4e40677-b9ab-45ce-b0a4-b3ccc3787407-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:19 devstack sudo[96572]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-570058af-af3b-4aeb-9dba-447d414e8b4f tempest-AttachVolumeNegativeTest-1202125091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.404s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:19 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-570058af-af3b-4aeb-9dba-447d414e8b4f tempest-AttachVolumeNegativeTest-1202125091 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:14:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cb3d2e96-58df-40b5-a04b-cb63af943087 tempest-AttachVolumeNegativeTest-1202125091 None] Lock "cinder-f4e40677-b9ab-45ce-b0a4-b3ccc3787407-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:19 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-570058af-af3b-4aeb-9dba-447d414e8b4f tempest-AttachVolumeNegativeTest-1202125091 None] Deleted volume successfully.
Nov 05 19:14:19 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-1e0d3543-5f37-49e5-8712-f1078f313f1d tempest-VolumesListAdminTestJSON-251344915 None] Created reservations ['463a2fc9-61cb-4169-ab28-2c0168cc3be0', '16199495-45c2-4a13-8b5c-0f06c76f657d', '6cd86449-dd06-4c38-a648-c7130b1e90a6', 'd6176f2d-e05f-4f6e-b52d-0debf59b1e37'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:14:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-570058af-af3b-4aeb-9dba-447d414e8b4f tempest-AttachVolumeNegativeTest-1202125091 None] Lock "cinder-85dda47b-fd4a-4cb1-a009-1ef8bb639e31-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cb3d2e96-58df-40b5-a04b-cb63af943087 tempest-AttachVolumeNegativeTest-1202125091 None] Acquiring lock "cinder-quobyte-f4e40677-b9ab-45ce-b0a4-b3ccc3787407" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cb3d2e96-58df-40b5-a04b-cb63af943087 tempest-AttachVolumeNegativeTest-1202125091 None] Lock "cinder-quobyte-f4e40677-b9ab-45ce-b0a4-b3ccc3787407" acquired by "delete_volume" :: waited 0.032s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:19 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb5dff9-91d3-4638-a3d1-8c2064ff8981]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:14:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cb3d2e96-58df-40b5-a04b-cb63af943087 tempest-AttachVolumeNegativeTest-1202125091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f4e40677-b9ab-45ce-b0a4-b3ccc3787407 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1e0d3543-5f37-49e5-8712-f1078f313f1d tempest-VolumesListAdminTestJSON-251344915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:14:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1e0d3543-5f37-49e5-8712-f1078f313f1d tempest-VolumesListAdminTestJSON-251344915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:14:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1e0d3543-5f37-49e5-8712-f1078f313f1d tempest-VolumesListAdminTestJSON-251344915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:14:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1e0d3543-5f37-49e5-8712-f1078f313f1d tempest-VolumesListAdminTestJSON-251344915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:14:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1e0d3543-5f37-49e5-8712-f1078f313f1d tempest-VolumesListAdminTestJSON-251344915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:14:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1e0d3543-5f37-49e5-8712-f1078f313f1d tempest-VolumesListAdminTestJSON-251344915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:20 devstack sudo[96586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:14:20 devstack sudo[96586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:20 devstack sudo[96584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f4e40677-b9ab-45ce-b0a4-b3ccc3787407
Nov 05 19:14:20 devstack sudo[96584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:20 devstack sudo[96579]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-58a8a1d3-7c95-4700-81ce-d3396a07cc24 tempest-SnapshotsActionsTest-1023533080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.823c0194-d19d-4531-b9ae-a349e2abc8a8 1G" returned: 0 in 0.690s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-58a8a1d3-7c95-4700-81ce-d3396a07cc24 tempest-SnapshotsActionsTest-1023533080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.823c0194-d19d-4531-b9ae-a349e2abc8a8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:20 devstack sudo[96589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.823c0194-d19d-4531-b9ae-a349e2abc8a8
Nov 05 19:14:20 devstack sudo[96589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:20 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:14:20 devstack sudo[96586]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1e0d3543-5f37-49e5-8712-f1078f313f1d tempest-VolumesListAdminTestJSON-251344915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.383s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:20 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-1e0d3543-5f37-49e5-8712-f1078f313f1d tempest-VolumesListAdminTestJSON-251344915 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:14:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Flow 'volume_create_manager' (fa0bf80e-47e2-4707-a00c-f96cfaa0b553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:14:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b86204-ed91-43d6-b4c9-38ce2bee98dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:20 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-1e0d3543-5f37-49e5-8712-f1078f313f1d tempest-VolumesListAdminTestJSON-251344915 None] Deleted volume successfully.
Nov 05 19:14:20 devstack sudo[96584]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b86204-ed91-43d6-b4c9-38ce2bee98dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-772870251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08bf1f5d-bcee-4cb1-925a-fe102445567a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2f776d18f5e4d06accc37697484a770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=380ee38e-ce70-4005-aac6-7e9aabcb4821,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:14:20Z,use_quota=True,user_id='c4be2d0faca24936a7799988f3d60760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6e02bc2-4792-4cb6-a889-e5bb7539f6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6e02bc2-4792-4cb6-a889-e5bb7539f6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (092c6572-d5d1-4a96-a7a5-68708702764f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (092c6572-d5d1-4a96-a7a5-68708702764f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '08bf1f5d-bcee-4cb1-925a-fe102445567a', 'volume_name': 'volume-08bf1f5d-bcee-4cb1-925a-fe102445567a', 'volume_size': 1, 'snapshot_id': '380ee38e-ce70-4005-aac6-7e9aabcb4821'}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6d8b4b5-6af7-428e-b4ce-362085044279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6d8b4b5-6af7-428e-b4ce-362085044279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58e8e9b2-10e2-4266-a489-778b5511f41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:20 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Volume 08bf1f5d-bcee-4cb1-925a-fe102445567a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-08bf1f5d-bcee-4cb1-925a-fe102445567a', 'volume_size': 1, 'snapshot_id': '380ee38e-ce70-4005-aac6-7e9aabcb4821'}
Nov 05 19:14:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cb3d2e96-58df-40b5-a04b-cb63af943087 tempest-AttachVolumeNegativeTest-1202125091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f4e40677-b9ab-45ce-b0a4-b3ccc3787407" returned: 0 in 0.520s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cb3d2e96-58df-40b5-a04b-cb63af943087 tempest-AttachVolumeNegativeTest-1202125091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f4e40677-b9ab-45ce-b0a4-b3ccc3787407 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:14:20 devstack sudo[96595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f4e40677-b9ab-45ce-b0a4-b3ccc3787407
Nov 05 19:14:20 devstack sudo[96595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:20 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1e0d3543-5f37-49e5-8712-f1078f313f1d tempest-VolumesListAdminTestJSON-251344915 None] Lock "cinder-47c34950-f305-4cf3-b918-240c93a00478-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:20 devstack sudo[96589]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-58a8a1d3-7c95-4700-81ce-d3396a07cc24 tempest-SnapshotsActionsTest-1023533080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.823c0194-d19d-4531-b9ae-a349e2abc8a8" returned: 0 in 0.325s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:20 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-58a8a1d3-7c95-4700-81ce-d3396a07cc24 tempest-SnapshotsActionsTest-1023533080 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.823c0194-d19d-4531-b9ae-a349e2abc8a8 is being set with open permissions: ugo+rw
Nov 05 19:14:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-58a8a1d3-7c95-4700-81ce-d3396a07cc24 tempest-SnapshotsActionsTest-1023533080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.823c0194-d19d-4531-b9ae-a349e2abc8a8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:20 devstack sudo[96600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.823c0194-d19d-4531-b9ae-a349e2abc8a8
Nov 05 19:14:20 devstack sudo[96600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:20 devstack sudo[96595]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cb3d2e96-58df-40b5-a04b-cb63af943087 tempest-AttachVolumeNegativeTest-1202125091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f4e40677-b9ab-45ce-b0a4-b3ccc3787407" returned: 0 in 0.261s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:20 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cb3d2e96-58df-40b5-a04b-cb63af943087 tempest-AttachVolumeNegativeTest-1202125091 None] Lock "cinder-quobyte-f4e40677-b9ab-45ce-b0a4-b3ccc3787407" released by "delete_volume" :: held 0.831s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:20 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:UPDATE=130,cinder:SELECT=148,cinder:INSERT=39,cinder:DELETE=10 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:14:20 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-cb3d2e96-58df-40b5-a04b-cb63af943087 tempest-AttachVolumeNegativeTest-1202125091 None] Created reservations ['d291f54d-de83-4e5a-a115-2aedeffb07a2', '0182216f-33a5-401e-b588-07bb045df236', '7fc459b8-e8b3-4c18-9757-508db96567c2', '1454a6e4-6440-4e3e-9387-ec54eee7297b'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:14:20 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=130,cinder:UPDATE=159,cinder:INSERT=36,cinder:DELETE=14 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:14:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cb3d2e96-58df-40b5-a04b-cb63af943087 tempest-AttachVolumeNegativeTest-1202125091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:14:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cb3d2e96-58df-40b5-a04b-cb63af943087 tempest-AttachVolumeNegativeTest-1202125091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:14:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-cb3d2e96-58df-40b5-a04b-cb63af943087 tempest-AttachVolumeNegativeTest-1202125091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:14:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-cb3d2e96-58df-40b5-a04b-cb63af943087 tempest-AttachVolumeNegativeTest-1202125091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:14:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cb3d2e96-58df-40b5-a04b-cb63af943087 tempest-AttachVolumeNegativeTest-1202125091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:14:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cb3d2e96-58df-40b5-a04b-cb63af943087 tempest-AttachVolumeNegativeTest-1202125091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:20 devstack sudo[96600]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-58a8a1d3-7c95-4700-81ce-d3396a07cc24 tempest-SnapshotsActionsTest-1023533080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.823c0194-d19d-4531-b9ae-a349e2abc8a8" returned: 0 in 0.259s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:20 devstack sudo[96604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:14:20 devstack sudo[96604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-58a8a1d3-7c95-4700-81ce-d3396a07cc24 tempest-SnapshotsActionsTest-1023533080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.950s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:14:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.435s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:14:20 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "cinder-quobyte-380ee38e-ce70-4005-aac6-7e9aabcb4821-08bf1f5d-bcee-4cb1-925a-fe102445567a" by "_create_volume_from_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-quobyte-380ee38e-ce70-4005-aac6-7e9aabcb4821-08bf1f5d-bcee-4cb1-925a-fe102445567a" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Creating volume 08bf1f5d-bcee-4cb1-925a-fe102445567a from snapshot 380ee38e-ce70-4005-aac6-7e9aabcb4821 {{(pid=87184) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "cinder-quobyte-08bf1f5d-bcee-4cb1-925a-fe102445567a" by "_copy_volume_from_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-quobyte-08bf1f5d-bcee-4cb1-925a-fe102445567a" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] snapshot: 380ee38e-ce70-4005-aac6-7e9aabcb4821, volume: 08bf1f5d-bcee-4cb1-925a-fe102445567a,  {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 19:14:21 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-58a8a1d3-7c95-4700-81ce-d3396a07cc24 tempest-SnapshotsActionsTest-1023533080 None] Create snapshot completed successfully
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c1694f-d0c2-4a1f-8954-303f7d0c4974]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c.380ee38e-ce70-4005-aac6-7e9aabcb4821 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:21 devstack sudo[96604]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cb3d2e96-58df-40b5-a04b-cb63af943087 tempest-AttachVolumeNegativeTest-1202125091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.296s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-cb3d2e96-58df-40b5-a04b-cb63af943087 tempest-AttachVolumeNegativeTest-1202125091 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:14:21 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-cb3d2e96-58df-40b5-a04b-cb63af943087 tempest-AttachVolumeNegativeTest-1202125091 None] Deleted volume successfully.
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cb3d2e96-58df-40b5-a04b-cb63af943087 tempest-AttachVolumeNegativeTest-1202125091 None] Lock "cinder-f4e40677-b9ab-45ce-b0a4-b3ccc3787407-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:21 devstack sudo[96606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c.380ee38e-ce70-4005-aac6-7e9aabcb4821
Nov 05 19:14:21 devstack sudo[96606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-62f371a6-8351-4960-8de9-a53c590b9bca tempest-AttachVolumeNegativeTest-1202125091 None] Acquiring lock "cinder-f6ee83b9-d5a3-4b43-889d-9ca2e7f5b769-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-62f371a6-8351-4960-8de9-a53c590b9bca tempest-AttachVolumeNegativeTest-1202125091 None] Lock "cinder-f6ee83b9-d5a3-4b43-889d-9ca2e7f5b769-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-62f371a6-8351-4960-8de9-a53c590b9bca tempest-AttachVolumeNegativeTest-1202125091 None] Acquiring lock "cinder-quobyte-f6ee83b9-d5a3-4b43-889d-9ca2e7f5b769" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-62f371a6-8351-4960-8de9-a53c590b9bca tempest-AttachVolumeNegativeTest-1202125091 None] Lock "cinder-quobyte-f6ee83b9-d5a3-4b43-889d-9ca2e7f5b769" acquired by "delete_volume" :: waited 0.030s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ba3e2c-b96c-44f9-bd6c-e5dc46f3e24e]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-62f371a6-8351-4960-8de9-a53c590b9bca tempest-AttachVolumeNegativeTest-1202125091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f6ee83b9-d5a3-4b43-889d-9ca2e7f5b769 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-830ab9c3-26f1-46dc-82b3-562e3a00f49f tempest-SnapshotsActionsTest-2090918635 None] Acquiring lock "cinder-823c0194-d19d-4531-b9ae-a349e2abc8a8-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-830ab9c3-26f1-46dc-82b3-562e3a00f49f tempest-SnapshotsActionsTest-2090918635 None] Lock "cinder-823c0194-d19d-4531-b9ae-a349e2abc8a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-830ab9c3-26f1-46dc-82b3-562e3a00f49f tempest-SnapshotsActionsTest-2090918635 None] Acquiring lock "cinder-quobyte-0ea23a53-8ebf-495d-91ca-dd13f63e9516" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-830ab9c3-26f1-46dc-82b3-562e3a00f49f tempest-SnapshotsActionsTest-2090918635 None] Lock "cinder-quobyte-0ea23a53-8ebf-495d-91ca-dd13f63e9516" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-830ab9c3-26f1-46dc-82b3-562e3a00f49f tempest-SnapshotsActionsTest-2090918635 None] Acquiring lock "cinder-quobyte-823c0194-d19d-4531-b9ae-a349e2abc8a8" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-830ab9c3-26f1-46dc-82b3-562e3a00f49f tempest-SnapshotsActionsTest-2090918635 None] Lock "cinder-quobyte-823c0194-d19d-4531-b9ae-a349e2abc8a8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-830ab9c3-26f1-46dc-82b3-562e3a00f49f tempest-SnapshotsActionsTest-2090918635 None] Deleting offline snapshot 823c0194-d19d-4531-b9ae-a349e2abc8a8 of volume 0ea23a53-8ebf-495d-91ca-dd13f63e9516 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:14:21 devstack sudo[96606]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-830ab9c3-26f1-46dc-82b3-562e3a00f49f tempest-SnapshotsActionsTest-2090918635 None] snapshot_file for this snap is: volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.823c0194-d19d-4531-b9ae-a349e2abc8a8 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c.380ee38e-ce70-4005-aac6-7e9aabcb4821" returned: 0 in 0.564s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:14:21 devstack sudo[96611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f6ee83b9-d5a3-4b43-889d-9ca2e7f5b769
Nov 05 19:14:21 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c70e459-740d-46ab-aa80-936dfa850484]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-830ab9c3-26f1-46dc-82b3-562e3a00f49f tempest-SnapshotsActionsTest-2090918635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.823c0194-d19d-4531-b9ae-a349e2abc8a8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea165a3-9cc7-41c0-924b-dd6f02478d13]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:21 devstack sudo[96615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.823c0194-d19d-4531-b9ae-a349e2abc8a8
Nov 05 19:14:21 devstack sudo[96615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:21 devstack sudo[96616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c
Nov 05 19:14:21 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:21 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-62f371a6-8351-4960-8de9-a53c590b9bca tempest-AttachVolumeNegativeTest-1202125091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f6ee83b9-d5a3-4b43-889d-9ca2e7f5b769" returned: 0 in 0.440s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-62f371a6-8351-4960-8de9-a53c590b9bca tempest-AttachVolumeNegativeTest-1202125091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f6ee83b9-d5a3-4b43-889d-9ca2e7f5b769 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:22 devstack sudo[96622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f6ee83b9-d5a3-4b43-889d-9ca2e7f5b769
Nov 05 19:14:22 devstack sudo[96622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:22 devstack sudo[96615]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-830ab9c3-26f1-46dc-82b3-562e3a00f49f tempest-SnapshotsActionsTest-2090918635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.823c0194-d19d-4531-b9ae-a349e2abc8a8" returned: 0 in 0.428s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-830ab9c3-26f1-46dc-82b3-562e3a00f49f tempest-SnapshotsActionsTest-2090918635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:14:22 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a56968e-3cdf-43b6-ac85-87442b9e184a]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:14:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-830ab9c3-26f1-46dc-82b3-562e3a00f49f tempest-SnapshotsActionsTest-2090918635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:22 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c" returned: 0 in 0.471s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 19:14:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Creating direct copy from snapshot {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 19:14:22 devstack cinder-volume[87184]: DEBUG cinder.utils [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Path /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-08bf1f5d-bcee-4cb1-925a-fe102445567a not found in is_blk_device check {{(pid=87184) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 19:14:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-08bf1f5d-bcee-4cb1-925a-fe102445567a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:22 devstack sudo[96631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-08bf1f5d-bcee-4cb1-925a-fe102445567a
Nov 05 19:14:22 devstack sudo[96631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:22 devstack sudo[96630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95
Nov 05 19:14:22 devstack sudo[96622]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:22 devstack sudo[96630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-62f371a6-8351-4960-8de9-a53c590b9bca tempest-AttachVolumeNegativeTest-1202125091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f6ee83b9-d5a3-4b43-889d-9ca2e7f5b769" returned: 0 in 0.314s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:22 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-62f371a6-8351-4960-8de9-a53c590b9bca tempest-AttachVolumeNegativeTest-1202125091 None] Lock "cinder-quobyte-f6ee83b9-d5a3-4b43-889d-9ca2e7f5b769" released by "delete_volume" :: held 0.815s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:22 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-62f371a6-8351-4960-8de9-a53c590b9bca tempest-AttachVolumeNegativeTest-1202125091 None] Created reservations ['7a98a17e-e7f3-4e47-85ed-acf30d4e6c8f', '396e3307-4edd-424d-892c-d7d11a5e7efe', '91d48b18-a3a5-4caa-a930-0bcec052e196', 'ae4aa8a0-46b7-44ed-96ce-20d27a7d97e0'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:14:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-62f371a6-8351-4960-8de9-a53c590b9bca tempest-AttachVolumeNegativeTest-1202125091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:14:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-62f371a6-8351-4960-8de9-a53c590b9bca tempest-AttachVolumeNegativeTest-1202125091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:14:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-62f371a6-8351-4960-8de9-a53c590b9bca tempest-AttachVolumeNegativeTest-1202125091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:14:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-62f371a6-8351-4960-8de9-a53c590b9bca tempest-AttachVolumeNegativeTest-1202125091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:14:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-62f371a6-8351-4960-8de9-a53c590b9bca tempest-AttachVolumeNegativeTest-1202125091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:14:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-62f371a6-8351-4960-8de9-a53c590b9bca tempest-AttachVolumeNegativeTest-1202125091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:22 devstack sudo[96638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:14:22 devstack sudo[96638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:22 devstack sudo[96630]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-830ab9c3-26f1-46dc-82b3-562e3a00f49f tempest-SnapshotsActionsTest-2090918635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95" returned: 0 in 0.537s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-830ab9c3-26f1-46dc-82b3-562e3a00f49f tempest-SnapshotsActionsTest-2090918635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:14:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-830ab9c3-26f1-46dc-82b3-562e3a00f49f tempest-SnapshotsActionsTest-2090918635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.823c0194-d19d-4531-b9ae-a349e2abc8a8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:22 devstack sudo[96643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.823c0194-d19d-4531-b9ae-a349e2abc8a8
Nov 05 19:14:22 devstack sudo[96643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:22 devstack sudo[96638]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-62f371a6-8351-4960-8de9-a53c590b9bca tempest-AttachVolumeNegativeTest-1202125091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.357s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:22 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-62f371a6-8351-4960-8de9-a53c590b9bca tempest-AttachVolumeNegativeTest-1202125091 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:14:22 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-62f371a6-8351-4960-8de9-a53c590b9bca tempest-AttachVolumeNegativeTest-1202125091 None] Deleted volume successfully.
Nov 05 19:14:22 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-62f371a6-8351-4960-8de9-a53c590b9bca tempest-AttachVolumeNegativeTest-1202125091 None] Lock "cinder-f6ee83b9-d5a3-4b43-889d-9ca2e7f5b769-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:23 devstack sudo[96643]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-830ab9c3-26f1-46dc-82b3-562e3a00f49f tempest-SnapshotsActionsTest-2090918635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.823c0194-d19d-4531-b9ae-a349e2abc8a8" returned: 0 in 1.049s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-830ab9c3-26f1-46dc-82b3-562e3a00f49f tempest-SnapshotsActionsTest-2090918635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.823c0194-d19d-4531-b9ae-a349e2abc8a8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:23 devstack sudo[96656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.823c0194-d19d-4531-b9ae-a349e2abc8a8
Nov 05 19:14:23 devstack sudo[96656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:24 devstack sudo[96656]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-830ab9c3-26f1-46dc-82b3-562e3a00f49f tempest-SnapshotsActionsTest-2090918635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.823c0194-d19d-4531-b9ae-a349e2abc8a8" returned: 0 in 0.808s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-830ab9c3-26f1-46dc-82b3-562e3a00f49f tempest-SnapshotsActionsTest-2090918635 None] Lock "cinder-quobyte-823c0194-d19d-4531-b9ae-a349e2abc8a8" released by "_delete_snapshot" :: held 3.045s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-830ab9c3-26f1-46dc-82b3-562e3a00f49f tempest-SnapshotsActionsTest-2090918635 None] Lock "cinder-quobyte-0ea23a53-8ebf-495d-91ca-dd13f63e9516" released by "delete_snapshot" :: held 3.074s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:24 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-830ab9c3-26f1-46dc-82b3-562e3a00f49f tempest-SnapshotsActionsTest-2090918635 None] Created reservations ['f2524be9-68b3-41e2-b27b-6c95a03f63b4', 'cc6c323c-aa39-419b-9e43-bf2fffa221f9', 'f1e4408a-60b9-456d-bebf-be5073441769', 'ffc87f9d-438d-44f8-b57e-c3243947914a'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:14:25 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-830ab9c3-26f1-46dc-82b3-562e3a00f49f tempest-SnapshotsActionsTest-2090918635 None] Delete snapshot completed successfully.
Nov 05 19:14:25 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-830ab9c3-26f1-46dc-82b3-562e3a00f49f tempest-SnapshotsActionsTest-2090918635 None] Lock "cinder-823c0194-d19d-4531-b9ae-a349e2abc8a8-delete_snapshot" released by "delete_snapshot" :: held 3.434s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c51e51b4-f176-4c73-b664-c03af8c895b0 tempest-SnapshotsActionsTest-1023533080 None] Acquiring lock "cinder-5f4957d2-3474-4031-a147-63f515179e95-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c51e51b4-f176-4c73-b664-c03af8c895b0 tempest-SnapshotsActionsTest-1023533080 None] Lock "cinder-5f4957d2-3474-4031-a147-63f515179e95-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c51e51b4-f176-4c73-b664-c03af8c895b0 tempest-SnapshotsActionsTest-1023533080 None] Acquiring lock "cinder-quobyte-0ea23a53-8ebf-495d-91ca-dd13f63e9516" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c51e51b4-f176-4c73-b664-c03af8c895b0 tempest-SnapshotsActionsTest-1023533080 None] Lock "cinder-quobyte-0ea23a53-8ebf-495d-91ca-dd13f63e9516" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c51e51b4-f176-4c73-b664-c03af8c895b0 tempest-SnapshotsActionsTest-1023533080 None] Acquiring lock "cinder-quobyte-5f4957d2-3474-4031-a147-63f515179e95" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c51e51b4-f176-4c73-b664-c03af8c895b0 tempest-SnapshotsActionsTest-1023533080 None] Lock "cinder-quobyte-5f4957d2-3474-4031-a147-63f515179e95" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-c51e51b4-f176-4c73-b664-c03af8c895b0 tempest-SnapshotsActionsTest-1023533080 None] Deleting offline snapshot 5f4957d2-3474-4031-a147-63f515179e95 of volume 0ea23a53-8ebf-495d-91ca-dd13f63e9516 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:14:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-c51e51b4-f176-4c73-b664-c03af8c895b0 tempest-SnapshotsActionsTest-1023533080 None] snapshot_file for this snap is: volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:14:27 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4d696d-dab3-4997-8ec9-c9f49800e10e]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:14:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c51e51b4-f176-4c73-b664-c03af8c895b0 tempest-SnapshotsActionsTest-1023533080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:27 devstack sudo[96661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95
Nov 05 19:14:27 devstack sudo[96661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:28 devstack sudo[96661]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c51e51b4-f176-4c73-b664-c03af8c895b0 tempest-SnapshotsActionsTest-1023533080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95" returned: 0 in 0.988s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-c51e51b4-f176-4c73-b664-c03af8c895b0 tempest-SnapshotsActionsTest-1023533080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:14:28 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a030ecc-2915-4262-949a-8f808a071199]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:14:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c51e51b4-f176-4c73-b664-c03af8c895b0 tempest-SnapshotsActionsTest-1023533080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:28 devstack sudo[96667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516
Nov 05 19:14:28 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:29 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c51e51b4-f176-4c73-b664-c03af8c895b0 tempest-SnapshotsActionsTest-1023533080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516" returned: 0 in 0.667s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c51e51b4-f176-4c73-b664-c03af8c895b0 tempest-SnapshotsActionsTest-1023533080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:29 devstack sudo[96673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95
Nov 05 19:14:29 devstack sudo[96673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:30 devstack sudo[96673]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c51e51b4-f176-4c73-b664-c03af8c895b0 tempest-SnapshotsActionsTest-1023533080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95" returned: 0 in 0.886s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c51e51b4-f176-4c73-b664-c03af8c895b0 tempest-SnapshotsActionsTest-1023533080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:30 devstack sudo[96680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95
Nov 05 19:14:30 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:30 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c51e51b4-f176-4c73-b664-c03af8c895b0 tempest-SnapshotsActionsTest-1023533080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516.5f4957d2-3474-4031-a147-63f515179e95" returned: 0 in 0.543s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c51e51b4-f176-4c73-b664-c03af8c895b0 tempest-SnapshotsActionsTest-1023533080 None] Lock "cinder-quobyte-5f4957d2-3474-4031-a147-63f515179e95" released by "_delete_snapshot" :: held 3.427s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c51e51b4-f176-4c73-b664-c03af8c895b0 tempest-SnapshotsActionsTest-1023533080 None] Lock "cinder-quobyte-0ea23a53-8ebf-495d-91ca-dd13f63e9516" released by "delete_snapshot" :: held 3.477s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:30 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-c51e51b4-f176-4c73-b664-c03af8c895b0 tempest-SnapshotsActionsTest-1023533080 None] Created reservations ['e0f5d751-772c-43c0-b1c7-877fa2cff140', 'd59cb3c9-9a9c-42a0-a018-07e7dfa3435c', '4d94fc1c-d607-42a2-b910-9de24008f100', '0af038b2-5de2-45cd-bff2-149485d4ebe3'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:14:30 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-c51e51b4-f176-4c73-b664-c03af8c895b0 tempest-SnapshotsActionsTest-1023533080 None] Delete snapshot completed successfully.
Nov 05 19:14:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c51e51b4-f176-4c73-b664-c03af8c895b0 tempest-SnapshotsActionsTest-1023533080 None] Lock "cinder-5f4957d2-3474-4031-a147-63f515179e95-delete_snapshot" released by "delete_snapshot" :: held 3.729s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-08bf1f5d-bcee-4cb1-925a-fe102445567a" returned: 0 in 9.408s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:31 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Image conversion details: src /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c, size 1024.00 MB, duration 9.41 sec, destination /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-08bf1f5d-bcee-4cb1-925a-fe102445567a {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 19:14:31 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Converted 1024.00 MB image at 108.83 MB/s
Nov 05 19:14:31 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-08bf1f5d-bcee-4cb1-925a-fe102445567a is being set with open permissions: ugo+rw
Nov 05 19:14:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-08bf1f5d-bcee-4cb1-925a-fe102445567a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:31 devstack sudo[96683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-08bf1f5d-bcee-4cb1-925a-fe102445567a
Nov 05 19:14:31 devstack sudo[96683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-65860d4c-9898-4659-883c-1aa0ffe467b7 tempest-SnapshotsActionsTest-1023533080 None] Acquiring lock "cinder-0ea23a53-8ebf-495d-91ca-dd13f63e9516-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-65860d4c-9898-4659-883c-1aa0ffe467b7 tempest-SnapshotsActionsTest-1023533080 None] Lock "cinder-0ea23a53-8ebf-495d-91ca-dd13f63e9516-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-65860d4c-9898-4659-883c-1aa0ffe467b7 tempest-SnapshotsActionsTest-1023533080 None] Acquiring lock "cinder-quobyte-0ea23a53-8ebf-495d-91ca-dd13f63e9516" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-65860d4c-9898-4659-883c-1aa0ffe467b7 tempest-SnapshotsActionsTest-1023533080 None] Lock "cinder-quobyte-0ea23a53-8ebf-495d-91ca-dd13f63e9516" acquired by "delete_volume" :: waited 0.023s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:31 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7add9726-ba53-4060-98e4-c494078356cb]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:14:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-65860d4c-9898-4659-883c-1aa0ffe467b7 tempest-SnapshotsActionsTest-1023533080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:32 devstack sudo[96683]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-08bf1f5d-bcee-4cb1-925a-fe102445567a" returned: 0 in 0.457s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:32 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-quobyte-08bf1f5d-bcee-4cb1-925a-fe102445567a" released by "_copy_volume_from_snapshot" :: held 11.046s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:32 devstack sudo[96686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516
Nov 05 19:14:32 devstack sudo[96686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:32 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-quobyte-380ee38e-ce70-4005-aac6-7e9aabcb4821-08bf1f5d-bcee-4cb1-925a-fe102445567a" released by "_create_volume_from_snapshot" :: held 11.137s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.166s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:14:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58e8e9b2-10e2-4266-a489-778b5511f41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08bf1f5d-bcee-4cb1-925a-fe102445567a', 'volume_size': 1, 'snapshot_id': '380ee38e-ce70-4005-aac6-7e9aabcb4821'}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (155e2665-45f3-4d13-a272-6a39f8922ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:32 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Volume volume-08bf1f5d-bcee-4cb1-925a-fe102445567a (08bf1f5d-bcee-4cb1-925a-fe102445567a): created successfully
Nov 05 19:14:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (155e2665-45f3-4d13-a272-6a39f8922ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Flow 'volume_create_manager' (fa0bf80e-47e2-4707-a00c-f96cfaa0b553) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:14:32 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-833907be-eb41-4b5d-8549-0342f87d97bd tempest-VolumesSnapshotTestJSON-1250160096 None] Created volume successfully.
Nov 05 19:14:32 devstack sudo[96686]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-65860d4c-9898-4659-883c-1aa0ffe467b7 tempest-SnapshotsActionsTest-1023533080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516" returned: 0 in 0.440s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-65860d4c-9898-4659-883c-1aa0ffe467b7 tempest-SnapshotsActionsTest-1023533080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:32 devstack sudo[96692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516
Nov 05 19:14:32 devstack sudo[96692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:32 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a74ff436-ff84-40c3-b0c5-07c25c60ac62 tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "cinder-08bf1f5d-bcee-4cb1-925a-fe102445567a-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:32 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a74ff436-ff84-40c3-b0c5-07c25c60ac62 tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-08bf1f5d-bcee-4cb1-925a-fe102445567a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:32 devstack sudo[96692]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-65860d4c-9898-4659-883c-1aa0ffe467b7 tempest-SnapshotsActionsTest-1023533080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ea23a53-8ebf-495d-91ca-dd13f63e9516" returned: 0 in 0.383s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:32 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-65860d4c-9898-4659-883c-1aa0ffe467b7 tempest-SnapshotsActionsTest-1023533080 None] Lock "cinder-quobyte-0ea23a53-8ebf-495d-91ca-dd13f63e9516" released by "delete_volume" :: held 0.934s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:32 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a74ff436-ff84-40c3-b0c5-07c25c60ac62 tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "cinder-quobyte-08bf1f5d-bcee-4cb1-925a-fe102445567a" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:32 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a74ff436-ff84-40c3-b0c5-07c25c60ac62 tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-quobyte-08bf1f5d-bcee-4cb1-925a-fe102445567a" acquired by "delete_volume" :: waited 0.025s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:32 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a63758-1e2c-4e4c-a33a-795fd626872a]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:14:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a74ff436-ff84-40c3-b0c5-07c25c60ac62 tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-08bf1f5d-bcee-4cb1-925a-fe102445567a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:32 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-65860d4c-9898-4659-883c-1aa0ffe467b7 tempest-SnapshotsActionsTest-1023533080 None] Created reservations ['0750cf59-886d-4a86-82df-3f5ccd84801b', '3e5ba5d0-9fd4-44c1-83e0-61106571fe54', '1544ffda-01c5-432f-a30d-c5ea35972cb3', '10845e68-1846-4592-b276-e07047807e0d'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:14:33 devstack sudo[96695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-08bf1f5d-bcee-4cb1-925a-fe102445567a
Nov 05 19:14:33 devstack sudo[96695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-65860d4c-9898-4659-883c-1aa0ffe467b7 tempest-SnapshotsActionsTest-1023533080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:14:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-65860d4c-9898-4659-883c-1aa0ffe467b7 tempest-SnapshotsActionsTest-1023533080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:14:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-65860d4c-9898-4659-883c-1aa0ffe467b7 tempest-SnapshotsActionsTest-1023533080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:14:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-65860d4c-9898-4659-883c-1aa0ffe467b7 tempest-SnapshotsActionsTest-1023533080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:14:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-65860d4c-9898-4659-883c-1aa0ffe467b7 tempest-SnapshotsActionsTest-1023533080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:14:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-65860d4c-9898-4659-883c-1aa0ffe467b7 tempest-SnapshotsActionsTest-1023533080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:33 devstack sudo[96698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:14:33 devstack sudo[96698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:33 devstack sudo[96695]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a74ff436-ff84-40c3-b0c5-07c25c60ac62 tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-08bf1f5d-bcee-4cb1-925a-fe102445567a" returned: 0 in 0.475s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a74ff436-ff84-40c3-b0c5-07c25c60ac62 tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-08bf1f5d-bcee-4cb1-925a-fe102445567a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:33 devstack sudo[96698]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-65860d4c-9898-4659-883c-1aa0ffe467b7 tempest-SnapshotsActionsTest-1023533080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.292s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:33 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-65860d4c-9898-4659-883c-1aa0ffe467b7 tempest-SnapshotsActionsTest-1023533080 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:14:33 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-65860d4c-9898-4659-883c-1aa0ffe467b7 tempest-SnapshotsActionsTest-1023533080 None] Deleted volume successfully.
Nov 05 19:14:33 devstack sudo[96704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-08bf1f5d-bcee-4cb1-925a-fe102445567a
Nov 05 19:14:33 devstack sudo[96704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-65860d4c-9898-4659-883c-1aa0ffe467b7 tempest-SnapshotsActionsTest-1023533080 None] Lock "cinder-0ea23a53-8ebf-495d-91ca-dd13f63e9516-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:33 devstack sudo[96704]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a74ff436-ff84-40c3-b0c5-07c25c60ac62 tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-08bf1f5d-bcee-4cb1-925a-fe102445567a" returned: 0 in 0.295s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a74ff436-ff84-40c3-b0c5-07c25c60ac62 tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-quobyte-08bf1f5d-bcee-4cb1-925a-fe102445567a" released by "delete_volume" :: held 0.847s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:33 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-a74ff436-ff84-40c3-b0c5-07c25c60ac62 tempest-VolumesSnapshotTestJSON-1250160096 None] Created reservations ['e74e90be-0a72-4b84-b571-9c1b1cc402e4', 'b20f7e10-2a93-46b9-b067-cb15c3e650ab', '2755d69c-0e18-495b-843c-0f532404686d', '2bae18af-f7f8-4f1b-a6b9-dfc739767ca6'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:14:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a74ff436-ff84-40c3-b0c5-07c25c60ac62 tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:14:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a74ff436-ff84-40c3-b0c5-07c25c60ac62 tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:14:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a74ff436-ff84-40c3-b0c5-07c25c60ac62 tempest-VolumesSnapshotTestJSON-1250160096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:14:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a74ff436-ff84-40c3-b0c5-07c25c60ac62 tempest-VolumesSnapshotTestJSON-1250160096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:14:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a74ff436-ff84-40c3-b0c5-07c25c60ac62 tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:14:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a74ff436-ff84-40c3-b0c5-07c25c60ac62 tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:33 devstack sudo[96707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:14:33 devstack sudo[96707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d67b2c02-5428-4ef5-96de-39998261671a tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "cinder-380ee38e-ce70-4005-aac6-7e9aabcb4821-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d67b2c02-5428-4ef5-96de-39998261671a tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-380ee38e-ce70-4005-aac6-7e9aabcb4821-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d67b2c02-5428-4ef5-96de-39998261671a tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "cinder-quobyte-80b770ca-7afb-4f5e-809a-1ec9742aa22c" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d67b2c02-5428-4ef5-96de-39998261671a tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-quobyte-80b770ca-7afb-4f5e-809a-1ec9742aa22c" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d67b2c02-5428-4ef5-96de-39998261671a tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "cinder-quobyte-380ee38e-ce70-4005-aac6-7e9aabcb4821" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d67b2c02-5428-4ef5-96de-39998261671a tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-quobyte-380ee38e-ce70-4005-aac6-7e9aabcb4821" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-d67b2c02-5428-4ef5-96de-39998261671a tempest-VolumesSnapshotTestJSON-1250160096 None] Deleting offline snapshot 380ee38e-ce70-4005-aac6-7e9aabcb4821 of volume 80b770ca-7afb-4f5e-809a-1ec9742aa22c {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:14:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-d67b2c02-5428-4ef5-96de-39998261671a tempest-VolumesSnapshotTestJSON-1250160096 None] snapshot_file for this snap is: volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c.380ee38e-ce70-4005-aac6-7e9aabcb4821 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:14:34 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a9af48-9fee-4eed-bc70-d8d4de2cca61]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:14:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d67b2c02-5428-4ef5-96de-39998261671a tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c.380ee38e-ce70-4005-aac6-7e9aabcb4821 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:34 devstack sudo[96707]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a74ff436-ff84-40c3-b0c5-07c25c60ac62 tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.354s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:34 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-a74ff436-ff84-40c3-b0c5-07c25c60ac62 tempest-VolumesSnapshotTestJSON-1250160096 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:14:34 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-a74ff436-ff84-40c3-b0c5-07c25c60ac62 tempest-VolumesSnapshotTestJSON-1250160096 None] Deleted volume successfully.
Nov 05 19:14:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a74ff436-ff84-40c3-b0c5-07c25c60ac62 tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-08bf1f5d-bcee-4cb1-925a-fe102445567a-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:34 devstack sudo[96710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c.380ee38e-ce70-4005-aac6-7e9aabcb4821
Nov 05 19:14:34 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:34 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d67b2c02-5428-4ef5-96de-39998261671a tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c.380ee38e-ce70-4005-aac6-7e9aabcb4821" returned: 0 in 0.399s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-d67b2c02-5428-4ef5-96de-39998261671a tempest-VolumesSnapshotTestJSON-1250160096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:14:34 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0bfdbe-1f2d-4a4a-b8e0-27f5026763df]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:14:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d67b2c02-5428-4ef5-96de-39998261671a tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:34 devstack sudo[96715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c
Nov 05 19:14:34 devstack sudo[96715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:35 devstack sudo[96715]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d67b2c02-5428-4ef5-96de-39998261671a tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c" returned: 0 in 0.598s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d67b2c02-5428-4ef5-96de-39998261671a tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c.380ee38e-ce70-4005-aac6-7e9aabcb4821 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:35 devstack sudo[96720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c.380ee38e-ce70-4005-aac6-7e9aabcb4821
Nov 05 19:14:35 devstack sudo[96720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:35 devstack sudo[96720]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d67b2c02-5428-4ef5-96de-39998261671a tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c.380ee38e-ce70-4005-aac6-7e9aabcb4821" returned: 0 in 0.400s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d67b2c02-5428-4ef5-96de-39998261671a tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c.380ee38e-ce70-4005-aac6-7e9aabcb4821 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:35 devstack sudo[96726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c.380ee38e-ce70-4005-aac6-7e9aabcb4821
Nov 05 19:14:35 devstack sudo[96726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:35 devstack sudo[96726]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d67b2c02-5428-4ef5-96de-39998261671a tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c.380ee38e-ce70-4005-aac6-7e9aabcb4821" returned: 0 in 0.309s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d67b2c02-5428-4ef5-96de-39998261671a tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-quobyte-380ee38e-ce70-4005-aac6-7e9aabcb4821" released by "_delete_snapshot" :: held 1.894s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d67b2c02-5428-4ef5-96de-39998261671a tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-quobyte-80b770ca-7afb-4f5e-809a-1ec9742aa22c" released by "delete_snapshot" :: held 1.934s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:36 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-d67b2c02-5428-4ef5-96de-39998261671a tempest-VolumesSnapshotTestJSON-1250160096 None] Created reservations ['bcd1db0b-16cc-4253-a649-c02ecc0f3f36', '94db9ac3-6093-4de0-80db-432d38473467', '803699bf-875f-4b5c-b16d-792dd77efaf5', 'b01c9ed7-7e68-4daf-b49a-9924830060ac'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:14:36 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-d67b2c02-5428-4ef5-96de-39998261671a tempest-VolumesSnapshotTestJSON-1250160096 None] Delete snapshot completed successfully.
Nov 05 19:14:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d67b2c02-5428-4ef5-96de-39998261671a tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-380ee38e-ce70-4005-aac6-7e9aabcb4821-delete_snapshot" released by "delete_snapshot" :: held 2.157s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6e453d08-198a-414d-b374-160d2b33df94 tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "cinder-80b770ca-7afb-4f5e-809a-1ec9742aa22c-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6e453d08-198a-414d-b374-160d2b33df94 tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-80b770ca-7afb-4f5e-809a-1ec9742aa22c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6e453d08-198a-414d-b374-160d2b33df94 tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "cinder-quobyte-80b770ca-7afb-4f5e-809a-1ec9742aa22c" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6e453d08-198a-414d-b374-160d2b33df94 tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-quobyte-80b770ca-7afb-4f5e-809a-1ec9742aa22c" acquired by "delete_volume" :: waited 0.036s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:36 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fe02cf-7da7-4a47-bdc6-fef051dab71f]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:14:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6e453d08-198a-414d-b374-160d2b33df94 tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:36 devstack sudo[96731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c
Nov 05 19:14:36 devstack sudo[96731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-eef3d34a-e5af-449b-bef6-e97ee5a707d5 tempest-BackendsCapabilitiesAdminTestsJSON-1923146737 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4295387268066, 'free_capacity_gb': 1773.4295387268066, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87184) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 05 19:14:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2ab62a06-1b12-48ee-8cf6-f6232b891970 tempest-BackendsCapabilitiesAdminTestsJSON-1923146737 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4295387268066, 'free_capacity_gb': 1773.4295387268066, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87184) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 05 19:14:37 devstack sudo[96731]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6e453d08-198a-414d-b374-160d2b33df94 tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c" returned: 0 in 0.667s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6e453d08-198a-414d-b374-160d2b33df94 tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:37 devstack sudo[96739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c
Nov 05 19:14:37 devstack sudo[96739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:37 devstack sudo[96739]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6e453d08-198a-414d-b374-160d2b33df94 tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-80b770ca-7afb-4f5e-809a-1ec9742aa22c" returned: 0 in 0.365s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6e453d08-198a-414d-b374-160d2b33df94 tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-quobyte-80b770ca-7afb-4f5e-809a-1ec9742aa22c" released by "delete_volume" :: held 1.148s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:37 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-6e453d08-198a-414d-b374-160d2b33df94 tempest-VolumesSnapshotTestJSON-1250160096 None] Created reservations ['55380fed-d478-4be5-a027-73f632ecc94c', 'e32383cf-34f2-4335-885a-f41997f9f341', '9cb55f3f-f846-490b-adc7-73db7ec16b3b', '8b9f4951-f5b2-4d4d-af7d-9a7244f37654'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:14:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6e453d08-198a-414d-b374-160d2b33df94 tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:14:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6e453d08-198a-414d-b374-160d2b33df94 tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:14:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6e453d08-198a-414d-b374-160d2b33df94 tempest-VolumesSnapshotTestJSON-1250160096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:14:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6e453d08-198a-414d-b374-160d2b33df94 tempest-VolumesSnapshotTestJSON-1250160096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:14:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6e453d08-198a-414d-b374-160d2b33df94 tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:14:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6e453d08-198a-414d-b374-160d2b33df94 tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:37 devstack sudo[96742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:14:37 devstack sudo[96742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:38 devstack sudo[96742]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6e453d08-198a-414d-b374-160d2b33df94 tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.348s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:38 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-6e453d08-198a-414d-b374-160d2b33df94 tempest-VolumesSnapshotTestJSON-1250160096 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:14:38 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-6e453d08-198a-414d-b374-160d2b33df94 tempest-VolumesSnapshotTestJSON-1250160096 None] Deleted volume successfully.
Nov 05 19:14:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6e453d08-198a-414d-b374-160d2b33df94 tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-80b770ca-7afb-4f5e-809a-1ec9742aa22c-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a1a80abf-9b13-44e2-90cd-b26e2fdd7cfa tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "cinder-fcaab0c0-adb7-4e69-848f-4915bc93410b-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a1a80abf-9b13-44e2-90cd-b26e2fdd7cfa tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-fcaab0c0-adb7-4e69-848f-4915bc93410b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a1a80abf-9b13-44e2-90cd-b26e2fdd7cfa tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "cinder-quobyte-fcaab0c0-adb7-4e69-848f-4915bc93410b" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a1a80abf-9b13-44e2-90cd-b26e2fdd7cfa tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-quobyte-fcaab0c0-adb7-4e69-848f-4915bc93410b" acquired by "delete_volume" :: waited 0.027s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:38 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2123a4b2-e23a-4ee4-86e5-45d3d3cbdb34]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:14:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a1a80abf-9b13-44e2-90cd-b26e2fdd7cfa tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:39 devstack sudo[96751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b
Nov 05 19:14:39 devstack sudo[96751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:39 devstack sudo[96751]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a1a80abf-9b13-44e2-90cd-b26e2fdd7cfa tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b" returned: 0 in 0.415s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a1a80abf-9b13-44e2-90cd-b26e2fdd7cfa tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:39 devstack sudo[96757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b
Nov 05 19:14:39 devstack sudo[96757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:39 devstack sudo[96757]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a1a80abf-9b13-44e2-90cd-b26e2fdd7cfa tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fcaab0c0-adb7-4e69-848f-4915bc93410b" returned: 0 in 0.386s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a1a80abf-9b13-44e2-90cd-b26e2fdd7cfa tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-quobyte-fcaab0c0-adb7-4e69-848f-4915bc93410b" released by "delete_volume" :: held 0.883s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:39 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-a1a80abf-9b13-44e2-90cd-b26e2fdd7cfa tempest-VolumesSnapshotTestJSON-1250160096 None] Created reservations ['848f08da-3863-42a5-b853-cc4efd1cf592', '74f6eb50-8cf3-418c-903b-f8629b08f3bb', '097aa407-6de3-4397-9b41-e3a6bdc9e883', 'a17fdc17-6ae0-4a34-ab1d-eb1d406a2445'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:14:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a1a80abf-9b13-44e2-90cd-b26e2fdd7cfa tempest-VolumesSnapshotTestJSON-1250160096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:14:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a1a80abf-9b13-44e2-90cd-b26e2fdd7cfa tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:14:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a1a80abf-9b13-44e2-90cd-b26e2fdd7cfa tempest-VolumesSnapshotTestJSON-1250160096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:14:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a1a80abf-9b13-44e2-90cd-b26e2fdd7cfa tempest-VolumesSnapshotTestJSON-1250160096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:14:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a1a80abf-9b13-44e2-90cd-b26e2fdd7cfa tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:14:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a1a80abf-9b13-44e2-90cd-b26e2fdd7cfa tempest-VolumesSnapshotTestJSON-1250160096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:39 devstack sudo[96760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:14:39 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:40 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a1a80abf-9b13-44e2-90cd-b26e2fdd7cfa tempest-VolumesSnapshotTestJSON-1250160096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.353s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:40 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-a1a80abf-9b13-44e2-90cd-b26e2fdd7cfa tempest-VolumesSnapshotTestJSON-1250160096 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:14:40 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-a1a80abf-9b13-44e2-90cd-b26e2fdd7cfa tempest-VolumesSnapshotTestJSON-1250160096 None] Deleted volume successfully.
Nov 05 19:14:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a1a80abf-9b13-44e2-90cd-b26e2fdd7cfa tempest-VolumesSnapshotTestJSON-1250160096 None] Lock "cinder-fcaab0c0-adb7-4e69-848f-4915bc93410b-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:41 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-66e0667c-7346-4e31-8a7a-580a2642efb2 tempest-VolumesMetadataTest-1237252273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:14:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-66e0667c-7346-4e31-8a7a-580a2642efb2 tempest-VolumesMetadataTest-1237252273 None] Flow 'volume_create_manager' (8b5e48ea-3314-4210-b8bb-3af9c9de1b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:14:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-66e0667c-7346-4e31-8a7a-580a2642efb2 tempest-VolumesMetadataTest-1237252273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dc79b1e-9f2c-4ec8-a72b-0049c7b7746b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-66e0667c-7346-4e31-8a7a-580a2642efb2 tempest-VolumesMetadataTest-1237252273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dc79b1e-9f2c-4ec8-a72b-0049c7b7746b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1860200488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3477073-308f-4014-8c05-6d6896ca628e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64c3a0414ec246ca95273237f69901b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:14:41Z,use_quota=True,user_id='d8b90fc0831748d19e8d0300cf34a436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-66e0667c-7346-4e31-8a7a-580a2642efb2 tempest-VolumesMetadataTest-1237252273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02344178-9791-40e5-9979-69f6a2128918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-66e0667c-7346-4e31-8a7a-580a2642efb2 tempest-VolumesMetadataTest-1237252273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02344178-9791-40e5-9979-69f6a2128918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-66e0667c-7346-4e31-8a7a-580a2642efb2 tempest-VolumesMetadataTest-1237252273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2af6b0e7-46d0-4c54-80f0-df0fa4aa5f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-66e0667c-7346-4e31-8a7a-580a2642efb2 tempest-VolumesMetadataTest-1237252273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2af6b0e7-46d0-4c54-80f0-df0fa4aa5f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3477073-308f-4014-8c05-6d6896ca628e', 'volume_name': 'volume-a3477073-308f-4014-8c05-6d6896ca628e', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-66e0667c-7346-4e31-8a7a-580a2642efb2 tempest-VolumesMetadataTest-1237252273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b9dd0b6-9cc1-4691-97a2-f3f01b01c759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-66e0667c-7346-4e31-8a7a-580a2642efb2 tempest-VolumesMetadataTest-1237252273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b9dd0b6-9cc1-4691-97a2-f3f01b01c759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-66e0667c-7346-4e31-8a7a-580a2642efb2 tempest-VolumesMetadataTest-1237252273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7580d0a9-3622-4fa5-b7c0-5995fc918141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:41 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-66e0667c-7346-4e31-8a7a-580a2642efb2 tempest-VolumesMetadataTest-1237252273 None] Volume a3477073-308f-4014-8c05-6d6896ca628e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3477073-308f-4014-8c05-6d6896ca628e', 'volume_size': 1}
Nov 05 19:14:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-66e0667c-7346-4e31-8a7a-580a2642efb2 tempest-VolumesMetadataTest-1237252273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:14:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-66e0667c-7346-4e31-8a7a-580a2642efb2 tempest-VolumesMetadataTest-1237252273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:14:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-66e0667c-7346-4e31-8a7a-580a2642efb2 tempest-VolumesMetadataTest-1237252273 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1860200488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3477073-308f-4014-8c05-6d6896ca628e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64c3a0414ec246ca95273237f69901b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:14:41Z,use_quota=True,user_id='d8b90fc0831748d19e8d0300cf34a436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:14:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-66e0667c-7346-4e31-8a7a-580a2642efb2 tempest-VolumesMetadataTest-1237252273 None] Creating volume a3477073-308f-4014-8c05-6d6896ca628e {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:14:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-66e0667c-7346-4e31-8a7a-580a2642efb2 tempest-VolumesMetadataTest-1237252273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:14:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-66e0667c-7346-4e31-8a7a-580a2642efb2 tempest-VolumesMetadataTest-1237252273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:14:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-66e0667c-7346-4e31-8a7a-580a2642efb2 tempest-VolumesMetadataTest-1237252273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:14:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-66e0667c-7346-4e31-8a7a-580a2642efb2 tempest-VolumesMetadataTest-1237252273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:14:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-66e0667c-7346-4e31-8a7a-580a2642efb2 tempest-VolumesMetadataTest-1237252273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:14:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-66e0667c-7346-4e31-8a7a-580a2642efb2 tempest-VolumesMetadataTest-1237252273 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:14:41 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-66e0667c-7346-4e31-8a7a-580a2642efb2 tempest-VolumesMetadataTest-1237252273 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:14:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-66e0667c-7346-4e31-8a7a-580a2642efb2 tempest-VolumesMetadataTest-1237252273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a3477073-308f-4014-8c05-6d6896ca628e 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:41 devstack sudo[96763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a3477073-308f-4014-8c05-6d6896ca628e 1073741824
Nov 05 19:14:41 devstack sudo[96763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:41 devstack sudo[96763]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-66e0667c-7346-4e31-8a7a-580a2642efb2 tempest-VolumesMetadataTest-1237252273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a3477073-308f-4014-8c05-6d6896ca628e 1073741824" returned: 0 in 0.630s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-66e0667c-7346-4e31-8a7a-580a2642efb2 tempest-VolumesMetadataTest-1237252273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a3477073-308f-4014-8c05-6d6896ca628e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:42 devstack sudo[96770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a3477073-308f-4014-8c05-6d6896ca628e
Nov 05 19:14:42 devstack sudo[96770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:42 devstack sudo[96770]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-66e0667c-7346-4e31-8a7a-580a2642efb2 tempest-VolumesMetadataTest-1237252273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a3477073-308f-4014-8c05-6d6896ca628e" returned: 0 in 0.344s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-66e0667c-7346-4e31-8a7a-580a2642efb2 tempest-VolumesMetadataTest-1237252273 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:14:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-66e0667c-7346-4e31-8a7a-580a2642efb2 tempest-VolumesMetadataTest-1237252273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:14:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-66e0667c-7346-4e31-8a7a-580a2642efb2 tempest-VolumesMetadataTest-1237252273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7580d0a9-3622-4fa5-b7c0-5995fc918141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3477073-308f-4014-8c05-6d6896ca628e', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-66e0667c-7346-4e31-8a7a-580a2642efb2 tempest-VolumesMetadataTest-1237252273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18a46831-4fe7-4049-baa0-f724906dc465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:42 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-66e0667c-7346-4e31-8a7a-580a2642efb2 tempest-VolumesMetadataTest-1237252273 None] Volume volume-a3477073-308f-4014-8c05-6d6896ca628e (a3477073-308f-4014-8c05-6d6896ca628e): created successfully
Nov 05 19:14:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-66e0667c-7346-4e31-8a7a-580a2642efb2 tempest-VolumesMetadataTest-1237252273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18a46831-4fe7-4049-baa0-f724906dc465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-66e0667c-7346-4e31-8a7a-580a2642efb2 tempest-VolumesMetadataTest-1237252273 None] Flow 'volume_create_manager' (8b5e48ea-3314-4210-b8bb-3af9c9de1b9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:14:42 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-66e0667c-7346-4e31-8a7a-580a2642efb2 tempest-VolumesMetadataTest-1237252273 None] Created volume successfully.
Nov 05 19:14:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1003e809-c7ea-4766-ad73-86efdb85e65b tempest-VolumesMetadataTest-1237252273 None] Acquiring lock "cinder-a3477073-308f-4014-8c05-6d6896ca628e-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1003e809-c7ea-4766-ad73-86efdb85e65b tempest-VolumesMetadataTest-1237252273 None] Lock "cinder-a3477073-308f-4014-8c05-6d6896ca628e-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1003e809-c7ea-4766-ad73-86efdb85e65b tempest-VolumesMetadataTest-1237252273 None] Acquiring lock "cinder-quobyte-a3477073-308f-4014-8c05-6d6896ca628e" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1003e809-c7ea-4766-ad73-86efdb85e65b tempest-VolumesMetadataTest-1237252273 None] Lock "cinder-quobyte-a3477073-308f-4014-8c05-6d6896ca628e" acquired by "delete_volume" :: waited 0.014s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:44 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[efeef559-8486-4034-8898-e5b5fad12547]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:14:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1003e809-c7ea-4766-ad73-86efdb85e65b tempest-VolumesMetadataTest-1237252273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a3477073-308f-4014-8c05-6d6896ca628e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:44 devstack sudo[96807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a3477073-308f-4014-8c05-6d6896ca628e
Nov 05 19:14:44 devstack sudo[96807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:45 devstack sudo[96807]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1003e809-c7ea-4766-ad73-86efdb85e65b tempest-VolumesMetadataTest-1237252273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a3477073-308f-4014-8c05-6d6896ca628e" returned: 0 in 0.576s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1003e809-c7ea-4766-ad73-86efdb85e65b tempest-VolumesMetadataTest-1237252273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a3477073-308f-4014-8c05-6d6896ca628e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:45 devstack sudo[96815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a3477073-308f-4014-8c05-6d6896ca628e
Nov 05 19:14:45 devstack sudo[96815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:45 devstack sudo[96815]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1003e809-c7ea-4766-ad73-86efdb85e65b tempest-VolumesMetadataTest-1237252273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a3477073-308f-4014-8c05-6d6896ca628e" returned: 0 in 0.358s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1003e809-c7ea-4766-ad73-86efdb85e65b tempest-VolumesMetadataTest-1237252273 None] Lock "cinder-quobyte-a3477073-308f-4014-8c05-6d6896ca628e" released by "delete_volume" :: held 1.006s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:45 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-1003e809-c7ea-4766-ad73-86efdb85e65b tempest-VolumesMetadataTest-1237252273 None] Created reservations ['9a574030-7fd4-400c-8f51-cfe7d96a5bb9', '4d2a0ded-9a62-4cf8-9f72-2bdd364f1c89', '1a645bce-c067-4b04-877d-615e8335028b', 'ee6591a5-5170-4e25-8f8d-142c39decfbd'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:14:45 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-a5225d38-3931-493c-820f-b5a5406fee20 tempest-GroupsV314Test-1260960322 None] Group tempest-GroupsV314Test-Group-695154410: creating
Nov 05 19:14:45 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-a5225d38-3931-493c-820f-b5a5406fee20 tempest-GroupsV314Test-1260960322 None] Group tempest-GroupsV314Test-Group-695154410: created successfully
Nov 05 19:14:45 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-a5225d38-3931-493c-820f-b5a5406fee20 tempest-GroupsV314Test-1260960322 None] Create group completed successfully.
Nov 05 19:14:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1003e809-c7ea-4766-ad73-86efdb85e65b tempest-VolumesMetadataTest-1237252273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:14:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1003e809-c7ea-4766-ad73-86efdb85e65b tempest-VolumesMetadataTest-1237252273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:14:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1003e809-c7ea-4766-ad73-86efdb85e65b tempest-VolumesMetadataTest-1237252273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:14:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1003e809-c7ea-4766-ad73-86efdb85e65b tempest-VolumesMetadataTest-1237252273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:14:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1003e809-c7ea-4766-ad73-86efdb85e65b tempest-VolumesMetadataTest-1237252273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:14:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1003e809-c7ea-4766-ad73-86efdb85e65b tempest-VolumesMetadataTest-1237252273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:45 devstack sudo[96819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:14:45 devstack sudo[96819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:46 devstack sudo[96819]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1003e809-c7ea-4766-ad73-86efdb85e65b tempest-VolumesMetadataTest-1237252273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.250s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:46 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-1003e809-c7ea-4766-ad73-86efdb85e65b tempest-VolumesMetadataTest-1237252273 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:14:46 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-1003e809-c7ea-4766-ad73-86efdb85e65b tempest-VolumesMetadataTest-1237252273 None] Deleted volume successfully.
Nov 05 19:14:46 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1003e809-c7ea-4766-ad73-86efdb85e65b tempest-VolumesMetadataTest-1237252273 None] Lock "cinder-a3477073-308f-4014-8c05-6d6896ca628e-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:14:47 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aadb53e-10f3-46b0-b5b7-65c1ef34233b tempest-GroupsV314Test-1260960322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:14:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3aadb53e-10f3-46b0-b5b7-65c1ef34233b tempest-GroupsV314Test-1260960322 None] Flow 'volume_create_manager' (610d63ab-9ffd-4d61-b0c3-e9a143b3d593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:14:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3aadb53e-10f3-46b0-b5b7-65c1ef34233b tempest-GroupsV314Test-1260960322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb901923-d546-4d1b-b14d-3b8ddf5b40e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3aadb53e-10f3-46b0-b5b7-65c1ef34233b tempest-GroupsV314Test-1260960322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb901923-d546-4d1b-b14d-3b8ddf5b40e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-767275224',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3d692ee5-4cda-4c47-a033-ba333682e763,host='devstack@QuobyteHD#QuobyteHD',id=9ea5b708-3ec5-459d-a438-7453decb4a28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eeeaf3f0acd4d1387f365495d787587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:14:47Z,use_quota=True,user_id='5a75168a85794d08a0198602c83d5384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(95a23a1a-d0b6-4e40-9c04-4435b830e9eb),volume_type_id=95a23a1a-d0b6-4e40-9c04-4435b830e9eb)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3aadb53e-10f3-46b0-b5b7-65c1ef34233b tempest-GroupsV314Test-1260960322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2539491-2b2d-4a11-bccc-e58903480d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3aadb53e-10f3-46b0-b5b7-65c1ef34233b tempest-GroupsV314Test-1260960322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2539491-2b2d-4a11-bccc-e58903480d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3aadb53e-10f3-46b0-b5b7-65c1ef34233b tempest-GroupsV314Test-1260960322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56ae204c-5457-4cd8-bba4-2fad2d906fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3aadb53e-10f3-46b0-b5b7-65c1ef34233b tempest-GroupsV314Test-1260960322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56ae204c-5457-4cd8-bba4-2fad2d906fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ea5b708-3ec5-459d-a438-7453decb4a28', 'volume_name': 'volume-9ea5b708-3ec5-459d-a438-7453decb4a28', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3aadb53e-10f3-46b0-b5b7-65c1ef34233b tempest-GroupsV314Test-1260960322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aae0ad65-edc6-4386-b1ea-15c500000822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3aadb53e-10f3-46b0-b5b7-65c1ef34233b tempest-GroupsV314Test-1260960322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aae0ad65-edc6-4386-b1ea-15c500000822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3aadb53e-10f3-46b0-b5b7-65c1ef34233b tempest-GroupsV314Test-1260960322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (387e911b-2d40-446a-9540-90145215d317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:47 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-3aadb53e-10f3-46b0-b5b7-65c1ef34233b tempest-GroupsV314Test-1260960322 None] Volume 9ea5b708-3ec5-459d-a438-7453decb4a28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ea5b708-3ec5-459d-a438-7453decb4a28', 'volume_size': 1}
Nov 05 19:14:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3aadb53e-10f3-46b0-b5b7-65c1ef34233b tempest-GroupsV314Test-1260960322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:14:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3aadb53e-10f3-46b0-b5b7-65c1ef34233b tempest-GroupsV314Test-1260960322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:14:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3aadb53e-10f3-46b0-b5b7-65c1ef34233b tempest-GroupsV314Test-1260960322 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=3d692ee5-4cda-4c47-a033-ba333682e763,created_at=2026-11-05T18:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-767275224',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3d692ee5-4cda-4c47-a033-ba333682e763,host='devstack@QuobyteHD#QuobyteHD',id=9ea5b708-3ec5-459d-a438-7453decb4a28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eeeaf3f0acd4d1387f365495d787587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:14:47Z,use_quota=True,user_id='5a75168a85794d08a0198602c83d5384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(95a23a1a-d0b6-4e40-9c04-4435b830e9eb),volume_type_id=95a23a1a-d0b6-4e40-9c04-4435b830e9eb)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:14:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-3aadb53e-10f3-46b0-b5b7-65c1ef34233b tempest-GroupsV314Test-1260960322 None] Creating volume 9ea5b708-3ec5-459d-a438-7453decb4a28 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:14:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3aadb53e-10f3-46b0-b5b7-65c1ef34233b tempest-GroupsV314Test-1260960322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:14:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3aadb53e-10f3-46b0-b5b7-65c1ef34233b tempest-GroupsV314Test-1260960322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:14:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3aadb53e-10f3-46b0-b5b7-65c1ef34233b tempest-GroupsV314Test-1260960322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:14:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3aadb53e-10f3-46b0-b5b7-65c1ef34233b tempest-GroupsV314Test-1260960322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:14:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3aadb53e-10f3-46b0-b5b7-65c1ef34233b tempest-GroupsV314Test-1260960322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:14:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3aadb53e-10f3-46b0-b5b7-65c1ef34233b tempest-GroupsV314Test-1260960322 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:14:47 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-3aadb53e-10f3-46b0-b5b7-65c1ef34233b tempest-GroupsV314Test-1260960322 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:14:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3aadb53e-10f3-46b0-b5b7-65c1ef34233b tempest-GroupsV314Test-1260960322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:47 devstack sudo[96823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28 1073741824
Nov 05 19:14:47 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:48 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3aadb53e-10f3-46b0-b5b7-65c1ef34233b tempest-GroupsV314Test-1260960322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28 1073741824" returned: 0 in 0.601s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3aadb53e-10f3-46b0-b5b7-65c1ef34233b tempest-GroupsV314Test-1260960322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:48 devstack sudo[96829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28
Nov 05 19:14:48 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:48 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3aadb53e-10f3-46b0-b5b7-65c1ef34233b tempest-GroupsV314Test-1260960322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28" returned: 0 in 0.291s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3aadb53e-10f3-46b0-b5b7-65c1ef34233b tempest-GroupsV314Test-1260960322 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:14:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3aadb53e-10f3-46b0-b5b7-65c1ef34233b tempest-GroupsV314Test-1260960322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:14:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3aadb53e-10f3-46b0-b5b7-65c1ef34233b tempest-GroupsV314Test-1260960322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (387e911b-2d40-446a-9540-90145215d317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ea5b708-3ec5-459d-a438-7453decb4a28', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3aadb53e-10f3-46b0-b5b7-65c1ef34233b tempest-GroupsV314Test-1260960322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a86d2bbe-fd9d-4721-94fa-9483ef6cdf53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:14:48 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-3aadb53e-10f3-46b0-b5b7-65c1ef34233b tempest-GroupsV314Test-1260960322 None] Volume volume-9ea5b708-3ec5-459d-a438-7453decb4a28 (9ea5b708-3ec5-459d-a438-7453decb4a28): created successfully
Nov 05 19:14:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3aadb53e-10f3-46b0-b5b7-65c1ef34233b tempest-GroupsV314Test-1260960322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a86d2bbe-fd9d-4721-94fa-9483ef6cdf53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:14:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3aadb53e-10f3-46b0-b5b7-65c1ef34233b tempest-GroupsV314Test-1260960322 None] Flow 'volume_create_manager' (610d63ab-9ffd-4d61-b0c3-e9a143b3d593) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:14:48 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-3aadb53e-10f3-46b0-b5b7-65c1ef34233b tempest-GroupsV314Test-1260960322 None] Created volume successfully.
Nov 05 19:14:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:14:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:14:50 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] Cloning volume 9ea5b708-3ec5-459d-a438-7453decb4a28 to volume e5ebe44e-6d8b-483e-b28d-ed67b5de731d
Nov 05 19:14:51 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] Creating offline snapshot e741cd05-65b4-4adc-b725-aac6310e9347 of volume 9ea5b708-3ec5-459d-a438-7453decb4a28 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:14:51 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4254f7-01cb-427c-828f-5c60982151ba]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:14:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:51 devstack sudo[96832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28
Nov 05 19:14:51 devstack sudo[96832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:51 devstack sudo[96832]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28" returned: 0 in 0.462s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28.e741cd05-65b4-4adc-b725-aac6310e9347 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:51 devstack sudo[96837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28.e741cd05-65b4-4adc-b725-aac6310e9347 1G
Nov 05 19:14:51 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:52 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28.e741cd05-65b4-4adc-b725-aac6310e9347 1G" returned: 0 in 0.528s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ea5b708-3ec5-459d-a438-7453decb4a28 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28.e741cd05-65b4-4adc-b725-aac6310e9347 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:52 devstack sudo[96843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ea5b708-3ec5-459d-a438-7453decb4a28 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28.e741cd05-65b4-4adc-b725-aac6310e9347
Nov 05 19:14:52 devstack sudo[96843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:52 devstack sudo[96843]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ea5b708-3ec5-459d-a438-7453decb4a28 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28.e741cd05-65b4-4adc-b725-aac6310e9347" returned: 0 in 0.378s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:52 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28.e741cd05-65b4-4adc-b725-aac6310e9347 is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 19:14:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28.e741cd05-65b4-4adc-b725-aac6310e9347 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:52 devstack sudo[96849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28.e741cd05-65b4-4adc-b725-aac6310e9347
Nov 05 19:14:52 devstack sudo[96849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:52 devstack sudo[96849]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28.e741cd05-65b4-4adc-b725-aac6310e9347" returned: 0 in 0.298s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:52 devstack sudo[96852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28.info
Nov 05 19:14:52 devstack sudo[96852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:53 devstack sudo[96852]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28.info" returned: 0 in 0.324s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:53 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 19:14:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:53 devstack sudo[96855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28.info
Nov 05 19:14:53 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:53 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28.info" returned: 0 in 0.423s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] Acquiring lock "cinder-quobyte-e5ebe44e-6d8b-483e-b28d-ed67b5de731d" by "_copy_volume_from_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:14:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] Lock "cinder-quobyte-e5ebe44e-6d8b-483e-b28d-ed67b5de731d" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:14:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] snapshot: e741cd05-65b4-4adc-b725-aac6310e9347, volume: e5ebe44e-6d8b-483e-b28d-ed67b5de731d,  {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 19:14:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:14:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:14:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:14:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:14:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:14:53 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4240b721-819c-404c-bc4d-d668cd06cb6d]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:14:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28.e741cd05-65b4-4adc-b725-aac6310e9347 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:53 devstack sudo[96858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28.e741cd05-65b4-4adc-b725-aac6310e9347
Nov 05 19:14:53 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:54 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28.e741cd05-65b4-4adc-b725-aac6310e9347" returned: 0 in 0.413s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ea5b708-3ec5-459d-a438-7453decb4a28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:14:54 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7189dfc2-6218-4f96-9f0e-1186a8f63b2d]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:14:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:54 devstack sudo[96863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28
Nov 05 19:14:54 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:14:54 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root
Nov 05 19:14:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28" returned: 0 in 0.525s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:14:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28 {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 19:14:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] Creating direct copy from snapshot {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 19:14:54 devstack cinder-volume[87184]: DEBUG cinder.utils [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] Path /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e5ebe44e-6d8b-483e-b28d-ed67b5de731d not found in is_blk_device check {{(pid=87184) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 19:14:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e5ebe44e-6d8b-483e-b28d-ed67b5de731d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:14:54 devstack sudo[96868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e5ebe44e-6d8b-483e-b28d-ed67b5de731d
Nov 05 19:14:54 devstack sudo[96868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:15:02 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:UPDATE=80,cinder:SELECT=59,cinder:DELETE=6,cinder:INSERT=20 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:15:02 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:UPDATE=84,cinder:SELECT=64,cinder:INSERT=21,cinder:DELETE=5 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:15:03 devstack sudo[96868]: pam_unix(sudo:session): session closed for user root
Nov 05 19:15:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e5ebe44e-6d8b-483e-b28d-ed67b5de731d" returned: 0 in 8.654s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:15:03 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] Image conversion details: src /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28, size 1024.00 MB, duration 8.66 sec, destination /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e5ebe44e-6d8b-483e-b28d-ed67b5de731d {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 19:15:03 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] Converted 1024.00 MB image at 118.31 MB/s
Nov 05 19:15:03 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e5ebe44e-6d8b-483e-b28d-ed67b5de731d is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 19:15:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e5ebe44e-6d8b-483e-b28d-ed67b5de731d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:15:03 devstack sudo[96886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e5ebe44e-6d8b-483e-b28d-ed67b5de731d
Nov 05 19:15:03 devstack sudo[96886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:15:03 devstack sudo[96886]: pam_unix(sudo:session): session closed for user root
Nov 05 19:15:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e5ebe44e-6d8b-483e-b28d-ed67b5de731d" returned: 0 in 0.432s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:15:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] Lock "cinder-quobyte-e5ebe44e-6d8b-483e-b28d-ed67b5de731d" released by "_copy_volume_from_snapshot" :: held 10.126s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:15:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] Acquiring lock "cinder-quobyte-e741cd05-65b4-4adc-b725-aac6310e9347" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:15:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] Lock "cinder-quobyte-e741cd05-65b4-4adc-b725-aac6310e9347" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:15:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] Deleting offline snapshot e741cd05-65b4-4adc-b725-aac6310e9347 of volume 9ea5b708-3ec5-459d-a438-7453decb4a28 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:15:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] snapshot_file for this snap is: volume-9ea5b708-3ec5-459d-a438-7453decb4a28.e741cd05-65b4-4adc-b725-aac6310e9347 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:15:03 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd04d3b-68b6-433c-8466-b2d35d1671f8]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:15:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28.e741cd05-65b4-4adc-b725-aac6310e9347 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:15:03 devstack sudo[96889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28.e741cd05-65b4-4adc-b725-aac6310e9347
Nov 05 19:15:03 devstack sudo[96889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:15:04 devstack sudo[96889]: pam_unix(sudo:session): session closed for user root
Nov 05 19:15:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28.e741cd05-65b4-4adc-b725-aac6310e9347" returned: 0 in 0.452s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:15:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ea5b708-3ec5-459d-a438-7453decb4a28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:15:04 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[af60e16e-5c73-4ef9-95c1-545adcac45b2]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:15:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:15:04 devstack sudo[96894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28
Nov 05 19:15:04 devstack sudo[96894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:15:05 devstack sudo[96894]: pam_unix(sudo:session): session closed for user root
Nov 05 19:15:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28" returned: 0 in 0.723s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:15:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28.e741cd05-65b4-4adc-b725-aac6310e9347 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:15:05 devstack sudo[96899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28.e741cd05-65b4-4adc-b725-aac6310e9347
Nov 05 19:15:05 devstack sudo[96899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:15:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:15:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:15:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:15:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:15:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:15:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:15:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:15:05 devstack sudo[96904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:15:05 devstack sudo[96904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:15:05 devstack sudo[96899]: pam_unix(sudo:session): session closed for user root
Nov 05 19:15:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28.e741cd05-65b4-4adc-b725-aac6310e9347" returned: 0 in 0.473s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:15:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28.e741cd05-65b4-4adc-b725-aac6310e9347 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:15:05 devstack sudo[96906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28.e741cd05-65b4-4adc-b725-aac6310e9347
Nov 05 19:15:05 devstack sudo[96906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:15:05 devstack sudo[96904]: pam_unix(sudo:session): session closed for user root
Nov 05 19:15:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.362s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:15:05 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:15:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:15:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread count: 28 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 19:15:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread info: [<_MainThread(MainThread, started 126882883072128)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126882770872512)>, <Thread(Thread-3 (stat_writer), started daemon 126882769837376)>, <Thread(Rabbit-heartbeat, started daemon 126882768896256)>, <Thread(Thread-5 (_runner), started daemon 126882768980928)>, <Thread(Thread-7 (_runner), started daemon 126882767016448)>, <Thread(fd_logger, started daemon 126882764561216)>, <Thread(privsep_reader, started daemon 126882764568576)>, <Thread(tpool_thread_0, started daemon 126882759292608)>, <Thread(tpool_thread_1, started daemon 126882750899904)>, <Thread(tpool_thread_2, started daemon 126882742507200)>, <Thread(tpool_thread_3, started daemon 126882734114496)>, <Thread(tpool_thread_4, started daemon 126882725721792)>, <Thread(tpool_thread_5, started daemon 126882717329088)>, <Thread(tpool_thread_6, started daemon 126882708920000)>, <Thread(tpool_thread_7, started daemon 126882700510912)>, <Thread(tpool_thread_8, started daemon 126882692101824)>, <Thread(tpool_thread_9, started daemon 126882683692736)>, <Thread(tpool_thread_10, started daemon 126882675283648)>, <Thread(tpool_thread_11, started daemon 126882666874560)>, <Thread(tpool_thread_12, started daemon 126882658465472)>, <Thread(tpool_thread_13, started daemon 126882650056384)>, <Thread(tpool_thread_14, started daemon 126882641647296)>, <Thread(tpool_thread_15, started daemon 126882633238208)>, <Thread(tpool_thread_16, started daemon 126882624829120)>, <Thread(tpool_thread_17, started daemon 126882616420032)>, <Thread(tpool_thread_18, started daemon 126882608010944)>, <Thread(tpool_thread_19, started daemon 126882599601856)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 19:15:05 devstack sudo[96906]: pam_unix(sudo:session): session closed for user root
Nov 05 19:15:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28.e741cd05-65b4-4adc-b725-aac6310e9347" returned: 0 in 0.410s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:15:05 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] Lock "cinder-quobyte-e741cd05-65b4-4adc-b725-aac6310e9347" released by "_delete_snapshot" :: held 2.203s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:15:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.030s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:15:06 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-dc5478f0-171d-424f-af99-7da37a15a550 tempest-GroupsV314Test-1260960322 None] Create group from source-group-3d692ee5-4cda-4c47-a033-ba333682e763 completed successfully.
Nov 05 19:15:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-42b2f545-6269-4cfd-922a-eecc1db71766 tempest-GroupsV314Test-1260960322 None] Acquiring lock "cinder-quobyte-e5ebe44e-6d8b-483e-b28d-ed67b5de731d" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:15:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-42b2f545-6269-4cfd-922a-eecc1db71766 tempest-GroupsV314Test-1260960322 None] Lock "cinder-quobyte-e5ebe44e-6d8b-483e-b28d-ed67b5de731d" acquired by "delete_volume" :: waited 0.043s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:15:07 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[527eb91c-1b92-4cbc-8d4d-6926fc85ec15]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:15:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-42b2f545-6269-4cfd-922a-eecc1db71766 tempest-GroupsV314Test-1260960322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e5ebe44e-6d8b-483e-b28d-ed67b5de731d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:15:08 devstack sudo[96911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e5ebe44e-6d8b-483e-b28d-ed67b5de731d
Nov 05 19:15:08 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:15:08 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root
Nov 05 19:15:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-42b2f545-6269-4cfd-922a-eecc1db71766 tempest-GroupsV314Test-1260960322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e5ebe44e-6d8b-483e-b28d-ed67b5de731d" returned: 0 in 0.530s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:15:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-42b2f545-6269-4cfd-922a-eecc1db71766 tempest-GroupsV314Test-1260960322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e5ebe44e-6d8b-483e-b28d-ed67b5de731d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:15:08 devstack sudo[96916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e5ebe44e-6d8b-483e-b28d-ed67b5de731d
Nov 05 19:15:08 devstack sudo[96916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:15:08 devstack sudo[96916]: pam_unix(sudo:session): session closed for user root
Nov 05 19:15:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-42b2f545-6269-4cfd-922a-eecc1db71766 tempest-GroupsV314Test-1260960322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e5ebe44e-6d8b-483e-b28d-ed67b5de731d" returned: 0 in 0.453s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:15:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-42b2f545-6269-4cfd-922a-eecc1db71766 tempest-GroupsV314Test-1260960322 None] Lock "cinder-quobyte-e5ebe44e-6d8b-483e-b28d-ed67b5de731d" released by "delete_volume" :: held 1.056s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:15:09 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-42b2f545-6269-4cfd-922a-eecc1db71766 tempest-GroupsV314Test-1260960322 None] Created reservations ['d90e0b60-7b93-4c94-b75f-0c7320c430d6'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:15:09 devstack cinder-volume[87184]: WARNING cinder.quota [None req-42b2f545-6269-4cfd-922a-eecc1db71766 tempest-GroupsV314Test-1260960322 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1635990854 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1635990854, it is now deprecated. Please use the default quota class for default quota.
Nov 05 19:15:09 devstack cinder-volume[87184]: WARNING cinder.quota [None req-42b2f545-6269-4cfd-922a-eecc1db71766 tempest-GroupsV314Test-1260960322 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1635990854 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1635990854, it is now deprecated. Please use the default quota class for default quota.
Nov 05 19:15:09 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-42b2f545-6269-4cfd-922a-eecc1db71766 tempest-GroupsV314Test-1260960322 None] Created reservations ['9bd9a292-886b-4a19-ad99-42d99e0f02da', '57a4dbf1-f337-4a31-a257-2bc59ee25103', 'c6e13bc6-c8a1-4247-9657-352cccbc2f02', '3358a004-bc79-452c-95db-6b5336f8bb12'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:15:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-42b2f545-6269-4cfd-922a-eecc1db71766 tempest-GroupsV314Test-1260960322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:15:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-42b2f545-6269-4cfd-922a-eecc1db71766 tempest-GroupsV314Test-1260960322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:15:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-42b2f545-6269-4cfd-922a-eecc1db71766 tempest-GroupsV314Test-1260960322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:15:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-42b2f545-6269-4cfd-922a-eecc1db71766 tempest-GroupsV314Test-1260960322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:15:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-42b2f545-6269-4cfd-922a-eecc1db71766 tempest-GroupsV314Test-1260960322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:15:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-42b2f545-6269-4cfd-922a-eecc1db71766 tempest-GroupsV314Test-1260960322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:15:09 devstack sudo[96919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:15:09 devstack sudo[96919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:15:09 devstack sudo[96919]: pam_unix(sudo:session): session closed for user root
Nov 05 19:15:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-42b2f545-6269-4cfd-922a-eecc1db71766 tempest-GroupsV314Test-1260960322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.386s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:15:09 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-42b2f545-6269-4cfd-922a-eecc1db71766 tempest-GroupsV314Test-1260960322 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:15:09 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-42b2f545-6269-4cfd-922a-eecc1db71766 tempest-GroupsV314Test-1260960322 None] Delete group completed successfully.
Nov 05 19:15:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7b3d6698-c43d-42a2-995a-b626d8170c66 tempest-GroupsV314Test-1260960322 None] Acquiring lock "cinder-quobyte-9ea5b708-3ec5-459d-a438-7453decb4a28" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:15:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7b3d6698-c43d-42a2-995a-b626d8170c66 tempest-GroupsV314Test-1260960322 None] Lock "cinder-quobyte-9ea5b708-3ec5-459d-a438-7453decb4a28" acquired by "delete_volume" :: waited 0.036s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:15:09 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c32041-bc5f-4a2b-a1a7-de45146004ca]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:15:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7b3d6698-c43d-42a2-995a-b626d8170c66 tempest-GroupsV314Test-1260960322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:15:10 devstack sudo[96923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28
Nov 05 19:15:10 devstack sudo[96923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:15:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7b3d6698-c43d-42a2-995a-b626d8170c66 tempest-GroupsV314Test-1260960322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28" returned: 0 in 0.510s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:15:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7b3d6698-c43d-42a2-995a-b626d8170c66 tempest-GroupsV314Test-1260960322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:15:10 devstack sudo[96923]: pam_unix(sudo:session): session closed for user root
Nov 05 19:15:10 devstack sudo[96930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28
Nov 05 19:15:10 devstack sudo[96930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:15:10 devstack sudo[96930]: pam_unix(sudo:session): session closed for user root
Nov 05 19:15:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7b3d6698-c43d-42a2-995a-b626d8170c66 tempest-GroupsV314Test-1260960322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9ea5b708-3ec5-459d-a438-7453decb4a28" returned: 0 in 0.358s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:15:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7b3d6698-c43d-42a2-995a-b626d8170c66 tempest-GroupsV314Test-1260960322 None] Lock "cinder-quobyte-9ea5b708-3ec5-459d-a438-7453decb4a28" released by "delete_volume" :: held 0.995s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:15:11 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-7b3d6698-c43d-42a2-995a-b626d8170c66 tempest-GroupsV314Test-1260960322 None] Created reservations ['204e5ff2-bcb8-4028-8dc3-0c5a7badf4c5'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:15:11 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-7b3d6698-c43d-42a2-995a-b626d8170c66 tempest-GroupsV314Test-1260960322 None] Created reservations ['d9664ea0-ea80-41a9-b611-13fc84930f80', 'd3ab7d54-d513-4966-9c07-20a410af6c04', '65489f6d-2085-4d0c-8390-61e8c7d0135d', '647ad5e2-2fa4-4c41-bb17-5f5eb767ac63'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:15:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7b3d6698-c43d-42a2-995a-b626d8170c66 tempest-GroupsV314Test-1260960322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:15:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7b3d6698-c43d-42a2-995a-b626d8170c66 tempest-GroupsV314Test-1260960322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:15:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7b3d6698-c43d-42a2-995a-b626d8170c66 tempest-GroupsV314Test-1260960322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:15:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7b3d6698-c43d-42a2-995a-b626d8170c66 tempest-GroupsV314Test-1260960322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:15:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7b3d6698-c43d-42a2-995a-b626d8170c66 tempest-GroupsV314Test-1260960322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:15:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7b3d6698-c43d-42a2-995a-b626d8170c66 tempest-GroupsV314Test-1260960322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:15:11 devstack sudo[96933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:15:11 devstack sudo[96933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:15:11 devstack sudo[96933]: pam_unix(sudo:session): session closed for user root
Nov 05 19:15:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7b3d6698-c43d-42a2-995a-b626d8170c66 tempest-GroupsV314Test-1260960322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.298s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:15:11 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-7b3d6698-c43d-42a2-995a-b626d8170c66 tempest-GroupsV314Test-1260960322 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:15:11 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-7b3d6698-c43d-42a2-995a-b626d8170c66 tempest-GroupsV314Test-1260960322 None] Delete group completed successfully.
Nov 05 19:15:21 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:UPDATE=24,cinder:SELECT=23,cinder:INSERT=4 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:15:21 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:UPDATE=25,cinder:SELECT=13,cinder:INSERT=6 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:15:25 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-faeaa317-419a-4e90-a390-98d997710427 tempest-GroupsV320Test-919570953 None] Group tempest-GroupsV320Test-Group-202621286: creating
Nov 05 19:15:25 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-faeaa317-419a-4e90-a390-98d997710427 tempest-GroupsV320Test-919570953 None] Group tempest-GroupsV320Test-Group-202621286: created successfully
Nov 05 19:15:25 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-faeaa317-419a-4e90-a390-98d997710427 tempest-GroupsV320Test-919570953 None] Create group completed successfully.
Nov 05 19:15:27 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-96dcfe35-e849-4edf-bd7f-9527040a3f3b tempest-GroupsV320Test-919570953 None] Created reservations ['e3a82bd1-701d-4825-b950-a23f6ea16cb1'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:15:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-96dcfe35-e849-4edf-bd7f-9527040a3f3b tempest-GroupsV320Test-919570953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:15:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-96dcfe35-e849-4edf-bd7f-9527040a3f3b tempest-GroupsV320Test-919570953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:15:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-96dcfe35-e849-4edf-bd7f-9527040a3f3b tempest-GroupsV320Test-919570953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:15:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-96dcfe35-e849-4edf-bd7f-9527040a3f3b tempest-GroupsV320Test-919570953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:15:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-96dcfe35-e849-4edf-bd7f-9527040a3f3b tempest-GroupsV320Test-919570953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:15:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-96dcfe35-e849-4edf-bd7f-9527040a3f3b tempest-GroupsV320Test-919570953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:15:27 devstack sudo[96939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:15:27 devstack sudo[96939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:15:28 devstack sudo[96939]: pam_unix(sudo:session): session closed for user root
Nov 05 19:15:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-96dcfe35-e849-4edf-bd7f-9527040a3f3b tempest-GroupsV320Test-919570953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.317s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:15:28 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-96dcfe35-e849-4edf-bd7f-9527040a3f3b tempest-GroupsV320Test-919570953 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:15:28 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-96dcfe35-e849-4edf-bd7f-9527040a3f3b tempest-GroupsV320Test-919570953 None] Delete group completed successfully.
Nov 05 19:15:45 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:15:45 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:15:52 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-75d4b2b0-5e02-43ce-adc9-32ff193a155d tempest-TestMinimumBasicScenario-121717189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:15:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-75d4b2b0-5e02-43ce-adc9-32ff193a155d tempest-TestMinimumBasicScenario-121717189 None] Flow 'volume_create_manager' (1a272326-b8d8-441d-a494-2feee661b30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:15:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-75d4b2b0-5e02-43ce-adc9-32ff193a155d tempest-TestMinimumBasicScenario-121717189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (594afde4-691c-4b9d-b5fd-e68065289671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:15:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-75d4b2b0-5e02-43ce-adc9-32ff193a155d tempest-TestMinimumBasicScenario-121717189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (594afde4-691c-4b9d-b5fd-e68065289671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1130143342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=525b8d40-a819-4551-ad70-64047a190402,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='512332a06ecd4c2da5ee0bd9a6c8980b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:15:53Z,use_quota=True,user_id='d3127cb556204c8ab1e6dd24b09c2520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:15:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-75d4b2b0-5e02-43ce-adc9-32ff193a155d tempest-TestMinimumBasicScenario-121717189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14951be5-0664-41c6-8cb3-fe7b670fcd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:15:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-75d4b2b0-5e02-43ce-adc9-32ff193a155d tempest-TestMinimumBasicScenario-121717189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14951be5-0664-41c6-8cb3-fe7b670fcd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:15:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-75d4b2b0-5e02-43ce-adc9-32ff193a155d tempest-TestMinimumBasicScenario-121717189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d255ced5-3b4e-491d-9907-8c0a2e8ae6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:15:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-75d4b2b0-5e02-43ce-adc9-32ff193a155d tempest-TestMinimumBasicScenario-121717189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d255ced5-3b4e-491d-9907-8c0a2e8ae6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '525b8d40-a819-4551-ad70-64047a190402', 'volume_name': 'volume-525b8d40-a819-4551-ad70-64047a190402', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:15:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-75d4b2b0-5e02-43ce-adc9-32ff193a155d tempest-TestMinimumBasicScenario-121717189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20f25ce2-6a36-427a-afe5-aed235f65a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:15:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-75d4b2b0-5e02-43ce-adc9-32ff193a155d tempest-TestMinimumBasicScenario-121717189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20f25ce2-6a36-427a-afe5-aed235f65a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:15:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-75d4b2b0-5e02-43ce-adc9-32ff193a155d tempest-TestMinimumBasicScenario-121717189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c4769ca-e40e-42ae-bbc6-5f017d9dfbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:15:52 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-75d4b2b0-5e02-43ce-adc9-32ff193a155d tempest-TestMinimumBasicScenario-121717189 None] Volume 525b8d40-a819-4551-ad70-64047a190402: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-525b8d40-a819-4551-ad70-64047a190402', 'volume_size': 1}
Nov 05 19:15:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-75d4b2b0-5e02-43ce-adc9-32ff193a155d tempest-TestMinimumBasicScenario-121717189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:15:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-75d4b2b0-5e02-43ce-adc9-32ff193a155d tempest-TestMinimumBasicScenario-121717189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:15:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-75d4b2b0-5e02-43ce-adc9-32ff193a155d tempest-TestMinimumBasicScenario-121717189 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1130143342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=525b8d40-a819-4551-ad70-64047a190402,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='512332a06ecd4c2da5ee0bd9a6c8980b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:15:53Z,use_quota=True,user_id='d3127cb556204c8ab1e6dd24b09c2520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:15:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-75d4b2b0-5e02-43ce-adc9-32ff193a155d tempest-TestMinimumBasicScenario-121717189 None] Creating volume 525b8d40-a819-4551-ad70-64047a190402 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:15:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-75d4b2b0-5e02-43ce-adc9-32ff193a155d tempest-TestMinimumBasicScenario-121717189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:15:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-75d4b2b0-5e02-43ce-adc9-32ff193a155d tempest-TestMinimumBasicScenario-121717189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:15:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-75d4b2b0-5e02-43ce-adc9-32ff193a155d tempest-TestMinimumBasicScenario-121717189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:15:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-75d4b2b0-5e02-43ce-adc9-32ff193a155d tempest-TestMinimumBasicScenario-121717189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:15:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-75d4b2b0-5e02-43ce-adc9-32ff193a155d tempest-TestMinimumBasicScenario-121717189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:15:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-75d4b2b0-5e02-43ce-adc9-32ff193a155d tempest-TestMinimumBasicScenario-121717189 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:15:52 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-75d4b2b0-5e02-43ce-adc9-32ff193a155d tempest-TestMinimumBasicScenario-121717189 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:15:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-75d4b2b0-5e02-43ce-adc9-32ff193a155d tempest-TestMinimumBasicScenario-121717189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-525b8d40-a819-4551-ad70-64047a190402 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:15:52 devstack sudo[97217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-525b8d40-a819-4551-ad70-64047a190402 1073741824
Nov 05 19:15:52 devstack sudo[97217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:15:53 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-a82b1a26-f965-4432-b613-65fe23571527 tempest-VolumeQuotasAdminTestJSON-865885386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:15:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a82b1a26-f965-4432-b613-65fe23571527 tempest-VolumeQuotasAdminTestJSON-865885386 None] Flow 'volume_create_manager' (e180c7e2-2940-4544-9cdc-d331daa9a908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:15:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a82b1a26-f965-4432-b613-65fe23571527 tempest-VolumeQuotasAdminTestJSON-865885386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c83656cc-1afe-4e21-bc87-4720e65d5a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:15:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a82b1a26-f965-4432-b613-65fe23571527 tempest-VolumeQuotasAdminTestJSON-865885386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c83656cc-1afe-4e21-bc87-4720e65d5a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-708381349',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=010390e8-dd05-447c-b4da-3cae361ffa7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75136a9d96654ef999a510886e7fcd1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:15:53Z,use_quota=True,user_id='807e0cb2bda241c29795e6b373a2495a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:15:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a82b1a26-f965-4432-b613-65fe23571527 tempest-VolumeQuotasAdminTestJSON-865885386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2e82a69-aeaf-4504-8368-1dff9ea25bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:15:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a82b1a26-f965-4432-b613-65fe23571527 tempest-VolumeQuotasAdminTestJSON-865885386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2e82a69-aeaf-4504-8368-1dff9ea25bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:15:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a82b1a26-f965-4432-b613-65fe23571527 tempest-VolumeQuotasAdminTestJSON-865885386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (016347be-d3cc-4ac0-9a0f-b9134c150752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:15:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a82b1a26-f965-4432-b613-65fe23571527 tempest-VolumeQuotasAdminTestJSON-865885386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (016347be-d3cc-4ac0-9a0f-b9134c150752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '010390e8-dd05-447c-b4da-3cae361ffa7d', 'volume_name': 'volume-010390e8-dd05-447c-b4da-3cae361ffa7d', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:15:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a82b1a26-f965-4432-b613-65fe23571527 tempest-VolumeQuotasAdminTestJSON-865885386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea2e1259-a5fa-4f04-81f0-cef8c6455bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:15:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a82b1a26-f965-4432-b613-65fe23571527 tempest-VolumeQuotasAdminTestJSON-865885386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea2e1259-a5fa-4f04-81f0-cef8c6455bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:15:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a82b1a26-f965-4432-b613-65fe23571527 tempest-VolumeQuotasAdminTestJSON-865885386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a106642b-6599-462a-88f5-740bb959a715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:15:53 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-a82b1a26-f965-4432-b613-65fe23571527 tempest-VolumeQuotasAdminTestJSON-865885386 None] Volume 010390e8-dd05-447c-b4da-3cae361ffa7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-010390e8-dd05-447c-b4da-3cae361ffa7d', 'volume_size': 1}
Nov 05 19:15:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a82b1a26-f965-4432-b613-65fe23571527 tempest-VolumeQuotasAdminTestJSON-865885386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:15:53 devstack sudo[97217]: pam_unix(sudo:session): session closed for user root
Nov 05 19:15:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-75d4b2b0-5e02-43ce-adc9-32ff193a155d tempest-TestMinimumBasicScenario-121717189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-525b8d40-a819-4551-ad70-64047a190402 1073741824" returned: 0 in 0.736s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:15:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-75d4b2b0-5e02-43ce-adc9-32ff193a155d tempest-TestMinimumBasicScenario-121717189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-525b8d40-a819-4551-ad70-64047a190402 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:15:53 devstack sudo[97223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-525b8d40-a819-4551-ad70-64047a190402
Nov 05 19:15:53 devstack sudo[97223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:15:53 devstack sudo[97223]: pam_unix(sudo:session): session closed for user root
Nov 05 19:15:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-75d4b2b0-5e02-43ce-adc9-32ff193a155d tempest-TestMinimumBasicScenario-121717189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-525b8d40-a819-4551-ad70-64047a190402" returned: 0 in 0.251s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:15:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-75d4b2b0-5e02-43ce-adc9-32ff193a155d tempest-TestMinimumBasicScenario-121717189 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:15:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-75d4b2b0-5e02-43ce-adc9-32ff193a155d tempest-TestMinimumBasicScenario-121717189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:15:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a82b1a26-f965-4432-b613-65fe23571527 tempest-VolumeQuotasAdminTestJSON-865885386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.654s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:15:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a82b1a26-f965-4432-b613-65fe23571527 tempest-VolumeQuotasAdminTestJSON-865885386 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-708381349',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=010390e8-dd05-447c-b4da-3cae361ffa7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75136a9d96654ef999a510886e7fcd1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:15:53Z,use_quota=True,user_id='807e0cb2bda241c29795e6b373a2495a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:15:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-a82b1a26-f965-4432-b613-65fe23571527 tempest-VolumeQuotasAdminTestJSON-865885386 None] Creating volume 010390e8-dd05-447c-b4da-3cae361ffa7d {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:15:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a82b1a26-f965-4432-b613-65fe23571527 tempest-VolumeQuotasAdminTestJSON-865885386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:15:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a82b1a26-f965-4432-b613-65fe23571527 tempest-VolumeQuotasAdminTestJSON-865885386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:15:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a82b1a26-f965-4432-b613-65fe23571527 tempest-VolumeQuotasAdminTestJSON-865885386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:15:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a82b1a26-f965-4432-b613-65fe23571527 tempest-VolumeQuotasAdminTestJSON-865885386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:15:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a82b1a26-f965-4432-b613-65fe23571527 tempest-VolumeQuotasAdminTestJSON-865885386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:15:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a82b1a26-f965-4432-b613-65fe23571527 tempest-VolumeQuotasAdminTestJSON-865885386 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:15:54 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-a82b1a26-f965-4432-b613-65fe23571527 tempest-VolumeQuotasAdminTestJSON-865885386 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:15:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a82b1a26-f965-4432-b613-65fe23571527 tempest-VolumeQuotasAdminTestJSON-865885386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-010390e8-dd05-447c-b4da-3cae361ffa7d 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:15:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-75d4b2b0-5e02-43ce-adc9-32ff193a155d tempest-TestMinimumBasicScenario-121717189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c4769ca-e40e-42ae-bbc6-5f017d9dfbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-525b8d40-a819-4551-ad70-64047a190402', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:15:54 devstack sudo[97226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-010390e8-dd05-447c-b4da-3cae361ffa7d 1073741824
Nov 05 19:15:54 devstack sudo[97226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:15:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-75d4b2b0-5e02-43ce-adc9-32ff193a155d tempest-TestMinimumBasicScenario-121717189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c20b27c-ed17-4727-8f07-33d5b6a2ad24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:15:54 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-75d4b2b0-5e02-43ce-adc9-32ff193a155d tempest-TestMinimumBasicScenario-121717189 None] Volume volume-525b8d40-a819-4551-ad70-64047a190402 (525b8d40-a819-4551-ad70-64047a190402): created successfully
Nov 05 19:15:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-75d4b2b0-5e02-43ce-adc9-32ff193a155d tempest-TestMinimumBasicScenario-121717189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c20b27c-ed17-4727-8f07-33d5b6a2ad24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:15:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-75d4b2b0-5e02-43ce-adc9-32ff193a155d tempest-TestMinimumBasicScenario-121717189 None] Flow 'volume_create_manager' (1a272326-b8d8-441d-a494-2feee661b30a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:15:54 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-75d4b2b0-5e02-43ce-adc9-32ff193a155d tempest-TestMinimumBasicScenario-121717189 None] Created volume successfully.
Nov 05 19:15:54 devstack sudo[97226]: pam_unix(sudo:session): session closed for user root
Nov 05 19:15:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a82b1a26-f965-4432-b613-65fe23571527 tempest-VolumeQuotasAdminTestJSON-865885386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-010390e8-dd05-447c-b4da-3cae361ffa7d 1073741824" returned: 0 in 0.537s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:15:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a82b1a26-f965-4432-b613-65fe23571527 tempest-VolumeQuotasAdminTestJSON-865885386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-010390e8-dd05-447c-b4da-3cae361ffa7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:15:54 devstack sudo[97232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-010390e8-dd05-447c-b4da-3cae361ffa7d
Nov 05 19:15:54 devstack sudo[97232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:15:54 devstack sudo[97232]: pam_unix(sudo:session): session closed for user root
Nov 05 19:15:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a82b1a26-f965-4432-b613-65fe23571527 tempest-VolumeQuotasAdminTestJSON-865885386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-010390e8-dd05-447c-b4da-3cae361ffa7d" returned: 0 in 0.362s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:15:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a82b1a26-f965-4432-b613-65fe23571527 tempest-VolumeQuotasAdminTestJSON-865885386 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:15:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a82b1a26-f965-4432-b613-65fe23571527 tempest-VolumeQuotasAdminTestJSON-865885386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:15:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a82b1a26-f965-4432-b613-65fe23571527 tempest-VolumeQuotasAdminTestJSON-865885386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a106642b-6599-462a-88f5-740bb959a715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-010390e8-dd05-447c-b4da-3cae361ffa7d', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:15:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a82b1a26-f965-4432-b613-65fe23571527 tempest-VolumeQuotasAdminTestJSON-865885386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99be8491-75b2-4a96-9fe6-0dc2adb14108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:15:55 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-a82b1a26-f965-4432-b613-65fe23571527 tempest-VolumeQuotasAdminTestJSON-865885386 None] Volume volume-010390e8-dd05-447c-b4da-3cae361ffa7d (010390e8-dd05-447c-b4da-3cae361ffa7d): created successfully
Nov 05 19:15:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a82b1a26-f965-4432-b613-65fe23571527 tempest-VolumeQuotasAdminTestJSON-865885386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99be8491-75b2-4a96-9fe6-0dc2adb14108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:15:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a82b1a26-f965-4432-b613-65fe23571527 tempest-VolumeQuotasAdminTestJSON-865885386 None] Flow 'volume_create_manager' (e180c7e2-2940-4544-9cdc-d331daa9a908) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:15:55 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-a82b1a26-f965-4432-b613-65fe23571527 tempest-VolumeQuotasAdminTestJSON-865885386 None] Created volume successfully.
Nov 05 19:15:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-02b15592-ae01-4845-b87b-3a56eae2771c tempest-VolumeQuotasAdminTestJSON-865885386 None] Acquiring lock "cinder-010390e8-dd05-447c-b4da-3cae361ffa7d-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:15:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-02b15592-ae01-4845-b87b-3a56eae2771c tempest-VolumeQuotasAdminTestJSON-865885386 None] Lock "cinder-010390e8-dd05-447c-b4da-3cae361ffa7d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:15:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-02b15592-ae01-4845-b87b-3a56eae2771c tempest-VolumeQuotasAdminTestJSON-865885386 None] Acquiring lock "cinder-quobyte-010390e8-dd05-447c-b4da-3cae361ffa7d" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:15:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-02b15592-ae01-4845-b87b-3a56eae2771c tempest-VolumeQuotasAdminTestJSON-865885386 None] Lock "cinder-quobyte-010390e8-dd05-447c-b4da-3cae361ffa7d" acquired by "delete_volume" :: waited 0.028s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:15:55 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6849ea-8a31-4c19-bb17-aeaccc6f95ad]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:15:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-02b15592-ae01-4845-b87b-3a56eae2771c tempest-VolumeQuotasAdminTestJSON-865885386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-010390e8-dd05-447c-b4da-3cae361ffa7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:15:55 devstack sudo[97238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-010390e8-dd05-447c-b4da-3cae361ffa7d
Nov 05 19:15:55 devstack sudo[97238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:15:56 devstack sudo[97238]: pam_unix(sudo:session): session closed for user root
Nov 05 19:15:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-02b15592-ae01-4845-b87b-3a56eae2771c tempest-VolumeQuotasAdminTestJSON-865885386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-010390e8-dd05-447c-b4da-3cae361ffa7d" returned: 0 in 0.451s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:15:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-02b15592-ae01-4845-b87b-3a56eae2771c tempest-VolumeQuotasAdminTestJSON-865885386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-010390e8-dd05-447c-b4da-3cae361ffa7d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:15:56 devstack sudo[97243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-010390e8-dd05-447c-b4da-3cae361ffa7d
Nov 05 19:15:56 devstack sudo[97243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:15:56 devstack sudo[97243]: pam_unix(sudo:session): session closed for user root
Nov 05 19:15:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-02b15592-ae01-4845-b87b-3a56eae2771c tempest-VolumeQuotasAdminTestJSON-865885386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-010390e8-dd05-447c-b4da-3cae361ffa7d" returned: 0 in 0.517s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:15:56 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-02b15592-ae01-4845-b87b-3a56eae2771c tempest-VolumeQuotasAdminTestJSON-865885386 None] Lock "cinder-quobyte-010390e8-dd05-447c-b4da-3cae361ffa7d" released by "delete_volume" :: held 1.062s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:15:56 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-02b15592-ae01-4845-b87b-3a56eae2771c tempest-VolumeQuotasAdminTestJSON-865885386 None] Created reservations ['bd5b48ff-8551-4e74-8bae-02a9e45c54fd', 'f2050a79-ad0c-4c4a-abeb-10825263a87e', '9f79a85e-24ec-44de-8321-bcc597cfc731', '5604e3d8-bae4-4396-9ebd-0225da640ac2'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:15:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-7a7c9e24-d31e-4803-b00e-46523992b5ee req-7e0125b1-038e-4c7e-8162-df9ad6e5be4d tempest-TestMinimumBasicScenario-121717189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:15:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-7a7c9e24-d31e-4803-b00e-46523992b5ee req-7e0125b1-038e-4c7e-8162-df9ad6e5be4d tempest-TestMinimumBasicScenario-121717189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:15:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-7a7c9e24-d31e-4803-b00e-46523992b5ee req-7e0125b1-038e-4c7e-8162-df9ad6e5be4d tempest-TestMinimumBasicScenario-121717189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:15:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-02b15592-ae01-4845-b87b-3a56eae2771c tempest-VolumeQuotasAdminTestJSON-865885386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:15:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-02b15592-ae01-4845-b87b-3a56eae2771c tempest-VolumeQuotasAdminTestJSON-865885386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:15:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-02b15592-ae01-4845-b87b-3a56eae2771c tempest-VolumeQuotasAdminTestJSON-865885386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:15:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-02b15592-ae01-4845-b87b-3a56eae2771c tempest-VolumeQuotasAdminTestJSON-865885386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:15:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-02b15592-ae01-4845-b87b-3a56eae2771c tempest-VolumeQuotasAdminTestJSON-865885386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:15:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-02b15592-ae01-4845-b87b-3a56eae2771c tempest-VolumeQuotasAdminTestJSON-865885386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:15:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-7a7c9e24-d31e-4803-b00e-46523992b5ee req-7e0125b1-038e-4c7e-8162-df9ad6e5be4d tempest-TestMinimumBasicScenario-121717189 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec', 'name': 'volume-525b8d40-a819-4551-ad70-64047a190402', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2eb41f82-cea0-4054-8804-dd659ffe679e', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 19:15:57 devstack sudo[97256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:15:57 devstack sudo[97256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:15:57 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-7a7c9e24-d31e-4803-b00e-46523992b5ee req-7e0125b1-038e-4c7e-8162-df9ad6e5be4d tempest-TestMinimumBasicScenario-121717189 None] attachment_update completed successfully.
Nov 05 19:15:57 devstack sudo[97256]: pam_unix(sudo:session): session closed for user root
Nov 05 19:15:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-02b15592-ae01-4845-b87b-3a56eae2771c tempest-VolumeQuotasAdminTestJSON-865885386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.558s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:15:57 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-02b15592-ae01-4845-b87b-3a56eae2771c tempest-VolumeQuotasAdminTestJSON-865885386 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:15:57 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-02b15592-ae01-4845-b87b-3a56eae2771c tempest-VolumeQuotasAdminTestJSON-865885386 None] Deleted volume successfully.
Nov 05 19:15:57 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-02b15592-ae01-4845-b87b-3a56eae2771c tempest-VolumeQuotasAdminTestJSON-865885386 None] Lock "cinder-010390e8-dd05-447c-b4da-3cae361ffa7d-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:15:58 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-b45ea9b7-aabd-4c71-bf9d-6f5512750195 tempest-VolumeQuotasAdminTestJSON-865885386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:15:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b45ea9b7-aabd-4c71-bf9d-6f5512750195 tempest-VolumeQuotasAdminTestJSON-865885386 None] Flow 'volume_create_manager' (b967ceb4-45e9-4308-ba8d-6f7193146b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:15:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b45ea9b7-aabd-4c71-bf9d-6f5512750195 tempest-VolumeQuotasAdminTestJSON-865885386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (582fbddb-4520-400b-832d-ed1d985a214a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:15:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b45ea9b7-aabd-4c71-bf9d-6f5512750195 tempest-VolumeQuotasAdminTestJSON-865885386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (582fbddb-4520-400b-832d-ed1d985a214a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-392767378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16866555-4e24-41af-aaa0-b056d8496612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75136a9d96654ef999a510886e7fcd1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:15:59Z,use_quota=True,user_id='807e0cb2bda241c29795e6b373a2495a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:15:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b45ea9b7-aabd-4c71-bf9d-6f5512750195 tempest-VolumeQuotasAdminTestJSON-865885386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31906c0c-c95b-406e-b037-651cbfff47a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:15:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b45ea9b7-aabd-4c71-bf9d-6f5512750195 tempest-VolumeQuotasAdminTestJSON-865885386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31906c0c-c95b-406e-b037-651cbfff47a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:15:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b45ea9b7-aabd-4c71-bf9d-6f5512750195 tempest-VolumeQuotasAdminTestJSON-865885386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c22266b-b57b-412d-be6f-99f67e13c307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:15:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b45ea9b7-aabd-4c71-bf9d-6f5512750195 tempest-VolumeQuotasAdminTestJSON-865885386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c22266b-b57b-412d-be6f-99f67e13c307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16866555-4e24-41af-aaa0-b056d8496612', 'volume_name': 'volume-16866555-4e24-41af-aaa0-b056d8496612', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:15:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b45ea9b7-aabd-4c71-bf9d-6f5512750195 tempest-VolumeQuotasAdminTestJSON-865885386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a32f26f4-9324-45e4-b7e2-e6c6933dc0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:15:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b45ea9b7-aabd-4c71-bf9d-6f5512750195 tempest-VolumeQuotasAdminTestJSON-865885386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a32f26f4-9324-45e4-b7e2-e6c6933dc0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:15:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b45ea9b7-aabd-4c71-bf9d-6f5512750195 tempest-VolumeQuotasAdminTestJSON-865885386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a662881-5dcd-406a-93ef-eb11eb0506c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:15:58 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-b45ea9b7-aabd-4c71-bf9d-6f5512750195 tempest-VolumeQuotasAdminTestJSON-865885386 None] Volume 16866555-4e24-41af-aaa0-b056d8496612: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16866555-4e24-41af-aaa0-b056d8496612', 'volume_size': 1}
Nov 05 19:15:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b45ea9b7-aabd-4c71-bf9d-6f5512750195 tempest-VolumeQuotasAdminTestJSON-865885386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:15:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b45ea9b7-aabd-4c71-bf9d-6f5512750195 tempest-VolumeQuotasAdminTestJSON-865885386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:15:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b45ea9b7-aabd-4c71-bf9d-6f5512750195 tempest-VolumeQuotasAdminTestJSON-865885386 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-392767378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16866555-4e24-41af-aaa0-b056d8496612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75136a9d96654ef999a510886e7fcd1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:15:59Z,use_quota=True,user_id='807e0cb2bda241c29795e6b373a2495a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:15:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-b45ea9b7-aabd-4c71-bf9d-6f5512750195 tempest-VolumeQuotasAdminTestJSON-865885386 None] Creating volume 16866555-4e24-41af-aaa0-b056d8496612 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:15:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b45ea9b7-aabd-4c71-bf9d-6f5512750195 tempest-VolumeQuotasAdminTestJSON-865885386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:15:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b45ea9b7-aabd-4c71-bf9d-6f5512750195 tempest-VolumeQuotasAdminTestJSON-865885386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:15:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b45ea9b7-aabd-4c71-bf9d-6f5512750195 tempest-VolumeQuotasAdminTestJSON-865885386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:15:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b45ea9b7-aabd-4c71-bf9d-6f5512750195 tempest-VolumeQuotasAdminTestJSON-865885386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:15:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b45ea9b7-aabd-4c71-bf9d-6f5512750195 tempest-VolumeQuotasAdminTestJSON-865885386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:15:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b45ea9b7-aabd-4c71-bf9d-6f5512750195 tempest-VolumeQuotasAdminTestJSON-865885386 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:15:58 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-b45ea9b7-aabd-4c71-bf9d-6f5512750195 tempest-VolumeQuotasAdminTestJSON-865885386 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:15:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b45ea9b7-aabd-4c71-bf9d-6f5512750195 tempest-VolumeQuotasAdminTestJSON-865885386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-16866555-4e24-41af-aaa0-b056d8496612 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:15:59 devstack sudo[97675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-16866555-4e24-41af-aaa0-b056d8496612 1073741824
Nov 05 19:15:59 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:15:59 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root
Nov 05 19:15:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b45ea9b7-aabd-4c71-bf9d-6f5512750195 tempest-VolumeQuotasAdminTestJSON-865885386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-16866555-4e24-41af-aaa0-b056d8496612 1073741824" returned: 0 in 0.837s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:15:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b45ea9b7-aabd-4c71-bf9d-6f5512750195 tempest-VolumeQuotasAdminTestJSON-865885386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-16866555-4e24-41af-aaa0-b056d8496612 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:15:59 devstack sudo[97681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-16866555-4e24-41af-aaa0-b056d8496612
Nov 05 19:15:59 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:00 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b45ea9b7-aabd-4c71-bf9d-6f5512750195 tempest-VolumeQuotasAdminTestJSON-865885386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-16866555-4e24-41af-aaa0-b056d8496612" returned: 0 in 0.329s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b45ea9b7-aabd-4c71-bf9d-6f5512750195 tempest-VolumeQuotasAdminTestJSON-865885386 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:16:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b45ea9b7-aabd-4c71-bf9d-6f5512750195 tempest-VolumeQuotasAdminTestJSON-865885386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:16:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b45ea9b7-aabd-4c71-bf9d-6f5512750195 tempest-VolumeQuotasAdminTestJSON-865885386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a662881-5dcd-406a-93ef-eb11eb0506c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16866555-4e24-41af-aaa0-b056d8496612', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b45ea9b7-aabd-4c71-bf9d-6f5512750195 tempest-VolumeQuotasAdminTestJSON-865885386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b267932-40b9-401c-8f0f-e9ac2dc8ea6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:00 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-b45ea9b7-aabd-4c71-bf9d-6f5512750195 tempest-VolumeQuotasAdminTestJSON-865885386 None] Volume volume-16866555-4e24-41af-aaa0-b056d8496612 (16866555-4e24-41af-aaa0-b056d8496612): created successfully
Nov 05 19:16:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b45ea9b7-aabd-4c71-bf9d-6f5512750195 tempest-VolumeQuotasAdminTestJSON-865885386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b267932-40b9-401c-8f0f-e9ac2dc8ea6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b45ea9b7-aabd-4c71-bf9d-6f5512750195 tempest-VolumeQuotasAdminTestJSON-865885386 None] Flow 'volume_create_manager' (b967ceb4-45e9-4308-ba8d-6f7193146b33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:16:00 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b45ea9b7-aabd-4c71-bf9d-6f5512750195 tempest-VolumeQuotasAdminTestJSON-865885386 None] Created volume successfully.
Nov 05 19:16:02 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-a44df9a4-08c8-40c1-b93e-526f7f13847d tempest-VolumeQuotasAdminTestJSON-167642239 None] Transfer volume completed successfully.
Nov 05 19:16:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9482b73c-92d3-4fce-8f69-c84849be0c39 tempest-VolumeQuotasAdminTestJSON-1406669458 None] Acquiring lock "cinder-16866555-4e24-41af-aaa0-b056d8496612-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:16:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9482b73c-92d3-4fce-8f69-c84849be0c39 tempest-VolumeQuotasAdminTestJSON-1406669458 None] Lock "cinder-16866555-4e24-41af-aaa0-b056d8496612-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:16:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9482b73c-92d3-4fce-8f69-c84849be0c39 tempest-VolumeQuotasAdminTestJSON-1406669458 None] Acquiring lock "cinder-quobyte-16866555-4e24-41af-aaa0-b056d8496612" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:16:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9482b73c-92d3-4fce-8f69-c84849be0c39 tempest-VolumeQuotasAdminTestJSON-1406669458 None] Lock "cinder-quobyte-16866555-4e24-41af-aaa0-b056d8496612" acquired by "delete_volume" :: waited 0.047s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:16:02 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae99bcc-33eb-4648-817d-28b651a9db36]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:16:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9482b73c-92d3-4fce-8f69-c84849be0c39 tempest-VolumeQuotasAdminTestJSON-1406669458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-16866555-4e24-41af-aaa0-b056d8496612 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:03 devstack sudo[97709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-16866555-4e24-41af-aaa0-b056d8496612
Nov 05 19:16:03 devstack sudo[97709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:03 devstack sudo[97709]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9482b73c-92d3-4fce-8f69-c84849be0c39 tempest-VolumeQuotasAdminTestJSON-1406669458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-16866555-4e24-41af-aaa0-b056d8496612" returned: 0 in 0.562s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9482b73c-92d3-4fce-8f69-c84849be0c39 tempest-VolumeQuotasAdminTestJSON-1406669458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-16866555-4e24-41af-aaa0-b056d8496612 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:03 devstack sudo[97715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-16866555-4e24-41af-aaa0-b056d8496612
Nov 05 19:16:03 devstack sudo[97715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:03 devstack sudo[97715]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9482b73c-92d3-4fce-8f69-c84849be0c39 tempest-VolumeQuotasAdminTestJSON-1406669458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-16866555-4e24-41af-aaa0-b056d8496612" returned: 0 in 0.265s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9482b73c-92d3-4fce-8f69-c84849be0c39 tempest-VolumeQuotasAdminTestJSON-1406669458 None] Lock "cinder-quobyte-16866555-4e24-41af-aaa0-b056d8496612" released by "delete_volume" :: held 0.894s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:16:03 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-9482b73c-92d3-4fce-8f69-c84849be0c39 tempest-VolumeQuotasAdminTestJSON-1406669458 None] Created reservations ['772e0414-b155-4c26-b11f-6d889606023f', '10136d59-5009-4486-be47-b0ccc342c380', 'c880d712-b818-47f6-a27a-574816eabd59', '18fc99ea-d2a6-4d19-bb1c-ac56ec348915'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:16:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9482b73c-92d3-4fce-8f69-c84849be0c39 tempest-VolumeQuotasAdminTestJSON-1406669458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:16:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9482b73c-92d3-4fce-8f69-c84849be0c39 tempest-VolumeQuotasAdminTestJSON-1406669458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:16:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9482b73c-92d3-4fce-8f69-c84849be0c39 tempest-VolumeQuotasAdminTestJSON-1406669458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:16:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9482b73c-92d3-4fce-8f69-c84849be0c39 tempest-VolumeQuotasAdminTestJSON-1406669458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:16:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9482b73c-92d3-4fce-8f69-c84849be0c39 tempest-VolumeQuotasAdminTestJSON-1406669458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:16:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9482b73c-92d3-4fce-8f69-c84849be0c39 tempest-VolumeQuotasAdminTestJSON-1406669458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:04 devstack sudo[97718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:16:04 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:04 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9482b73c-92d3-4fce-8f69-c84849be0c39 tempest-VolumeQuotasAdminTestJSON-1406669458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.385s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:04 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-9482b73c-92d3-4fce-8f69-c84849be0c39 tempest-VolumeQuotasAdminTestJSON-1406669458 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:16:04 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-9482b73c-92d3-4fce-8f69-c84849be0c39 tempest-VolumeQuotasAdminTestJSON-1406669458 None] Deleted volume successfully.
Nov 05 19:16:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9482b73c-92d3-4fce-8f69-c84849be0c39 tempest-VolumeQuotasAdminTestJSON-1406669458 None] Lock "cinder-16866555-4e24-41af-aaa0-b056d8496612-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:16:05 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-370fa6cd-cb5b-4964-bcc6-2d5f4322bb8b tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:16:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-370fa6cd-cb5b-4964-bcc6-2d5f4322bb8b tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Flow 'volume_create_manager' (52a5c2c3-4433-45c4-9451-8d0463cba67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:16:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-370fa6cd-cb5b-4964-bcc6-2d5f4322bb8b tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (563b7969-f109-409c-aec1-8e114e32830b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:16:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:16:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:16:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:16:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:16:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:16:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:05 devstack sudo[97723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:16:05 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-370fa6cd-cb5b-4964-bcc6-2d5f4322bb8b tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (563b7969-f109-409c-aec1-8e114e32830b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1334987935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=483de898-5f8d-46ef-88df-ee43b1867ea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01e601f18c154e5a9282ef195615bfd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:16:05Z,use_quota=True,user_id='52ce0c2a2ae74e1b9658eb697d07ab02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-370fa6cd-cb5b-4964-bcc6-2d5f4322bb8b tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34496480-c11f-4eea-ad11-dc731f63e3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-370fa6cd-cb5b-4964-bcc6-2d5f4322bb8b tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34496480-c11f-4eea-ad11-dc731f63e3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-370fa6cd-cb5b-4964-bcc6-2d5f4322bb8b tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8058727a-9912-49d8-8a83-8db75f26614d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-370fa6cd-cb5b-4964-bcc6-2d5f4322bb8b tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8058727a-9912-49d8-8a83-8db75f26614d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '483de898-5f8d-46ef-88df-ee43b1867ea1', 'volume_name': 'volume-483de898-5f8d-46ef-88df-ee43b1867ea1', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-370fa6cd-cb5b-4964-bcc6-2d5f4322bb8b tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b221a0e-97d6-4edb-9ddd-47815f12bde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-370fa6cd-cb5b-4964-bcc6-2d5f4322bb8b tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b221a0e-97d6-4edb-9ddd-47815f12bde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-370fa6cd-cb5b-4964-bcc6-2d5f4322bb8b tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7155a0c-41b2-43ce-b5e0-b3c10ad0a21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:05 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-370fa6cd-cb5b-4964-bcc6-2d5f4322bb8b tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Volume 483de898-5f8d-46ef-88df-ee43b1867ea1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-483de898-5f8d-46ef-88df-ee43b1867ea1', 'volume_size': 1}
Nov 05 19:16:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-370fa6cd-cb5b-4964-bcc6-2d5f4322bb8b tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:16:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-370fa6cd-cb5b-4964-bcc6-2d5f4322bb8b tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:16:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-370fa6cd-cb5b-4964-bcc6-2d5f4322bb8b tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1334987935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=483de898-5f8d-46ef-88df-ee43b1867ea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01e601f18c154e5a9282ef195615bfd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:16:05Z,use_quota=True,user_id='52ce0c2a2ae74e1b9658eb697d07ab02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:16:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-370fa6cd-cb5b-4964-bcc6-2d5f4322bb8b tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Creating volume 483de898-5f8d-46ef-88df-ee43b1867ea1 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:16:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-370fa6cd-cb5b-4964-bcc6-2d5f4322bb8b tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:16:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-370fa6cd-cb5b-4964-bcc6-2d5f4322bb8b tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:16:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-370fa6cd-cb5b-4964-bcc6-2d5f4322bb8b tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:16:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-370fa6cd-cb5b-4964-bcc6-2d5f4322bb8b tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:16:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-370fa6cd-cb5b-4964-bcc6-2d5f4322bb8b tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:16:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-370fa6cd-cb5b-4964-bcc6-2d5f4322bb8b tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:16:05 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-370fa6cd-cb5b-4964-bcc6-2d5f4322bb8b tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:16:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-370fa6cd-cb5b-4964-bcc6-2d5f4322bb8b tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-483de898-5f8d-46ef-88df-ee43b1867ea1 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:05 devstack sudo[97725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-483de898-5f8d-46ef-88df-ee43b1867ea1 1073741824
Nov 05 19:16:05 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:05 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.304s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:05 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:16:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:16:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread count: 28 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 19:16:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread info: [<_MainThread(MainThread, started 126882883072128)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126882770872512)>, <Thread(Thread-3 (stat_writer), started daemon 126882769837376)>, <Thread(Rabbit-heartbeat, started daemon 126882768896256)>, <Thread(Thread-5 (_runner), started daemon 126882768980928)>, <Thread(Thread-7 (_runner), started daemon 126882767016448)>, <Thread(fd_logger, started daemon 126882764561216)>, <Thread(privsep_reader, started daemon 126882764568576)>, <Thread(tpool_thread_0, started daemon 126882759292608)>, <Thread(tpool_thread_1, started daemon 126882750899904)>, <Thread(tpool_thread_2, started daemon 126882742507200)>, <Thread(tpool_thread_3, started daemon 126882734114496)>, <Thread(tpool_thread_4, started daemon 126882725721792)>, <Thread(tpool_thread_5, started daemon 126882717329088)>, <Thread(tpool_thread_6, started daemon 126882708920000)>, <Thread(tpool_thread_7, started daemon 126882700510912)>, <Thread(tpool_thread_8, started daemon 126882692101824)>, <Thread(tpool_thread_9, started daemon 126882683692736)>, <Thread(tpool_thread_10, started daemon 126882675283648)>, <Thread(tpool_thread_11, started daemon 126882666874560)>, <Thread(tpool_thread_12, started daemon 126882658465472)>, <Thread(tpool_thread_13, started daemon 126882650056384)>, <Thread(tpool_thread_14, started daemon 126882641647296)>, <Thread(tpool_thread_15, started daemon 126882633238208)>, <Thread(tpool_thread_16, started daemon 126882624829120)>, <Thread(tpool_thread_17, started daemon 126882616420032)>, <Thread(tpool_thread_18, started daemon 126882608010944)>, <Thread(tpool_thread_19, started daemon 126882599601856)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 19:16:06 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-370fa6cd-cb5b-4964-bcc6-2d5f4322bb8b tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-483de898-5f8d-46ef-88df-ee43b1867ea1 1073741824" returned: 0 in 0.807s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-370fa6cd-cb5b-4964-bcc6-2d5f4322bb8b tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-483de898-5f8d-46ef-88df-ee43b1867ea1 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:06 devstack sudo[97731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-483de898-5f8d-46ef-88df-ee43b1867ea1
Nov 05 19:16:06 devstack sudo[97731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:06 devstack sudo[97731]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-370fa6cd-cb5b-4964-bcc6-2d5f4322bb8b tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-483de898-5f8d-46ef-88df-ee43b1867ea1" returned: 0 in 0.340s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-370fa6cd-cb5b-4964-bcc6-2d5f4322bb8b tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:16:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-370fa6cd-cb5b-4964-bcc6-2d5f4322bb8b tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:16:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-370fa6cd-cb5b-4964-bcc6-2d5f4322bb8b tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7155a0c-41b2-43ce-b5e0-b3c10ad0a21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-483de898-5f8d-46ef-88df-ee43b1867ea1', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-370fa6cd-cb5b-4964-bcc6-2d5f4322bb8b tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97e33fa5-ab7d-4232-837f-20c8e0ab2296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:06 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-370fa6cd-cb5b-4964-bcc6-2d5f4322bb8b tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Volume volume-483de898-5f8d-46ef-88df-ee43b1867ea1 (483de898-5f8d-46ef-88df-ee43b1867ea1): created successfully
Nov 05 19:16:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-370fa6cd-cb5b-4964-bcc6-2d5f4322bb8b tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97e33fa5-ab7d-4232-837f-20c8e0ab2296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-370fa6cd-cb5b-4964-bcc6-2d5f4322bb8b tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Flow 'volume_create_manager' (52a5c2c3-4433-45c4-9451-8d0463cba67c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:16:06 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-370fa6cd-cb5b-4964-bcc6-2d5f4322bb8b tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Created volume successfully.
Nov 05 19:16:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-5fae4754-c687-4ef0-be81-74812a33345e req-16fb8884-ab13-41db-8199-0334a7088775 tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:16:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-5fae4754-c687-4ef0-be81-74812a33345e req-16fb8884-ab13-41db-8199-0334a7088775 tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:16:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-5fae4754-c687-4ef0-be81-74812a33345e req-16fb8884-ab13-41db-8199-0334a7088775 tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:16:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-5fae4754-c687-4ef0-be81-74812a33345e req-16fb8884-ab13-41db-8199-0334a7088775 tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec', 'name': 'volume-483de898-5f8d-46ef-88df-ee43b1867ea1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f6cd618e-ca49-45b5-bfcc-bf7280f241e3', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 19:16:08 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-5fae4754-c687-4ef0-be81-74812a33345e req-16fb8884-ab13-41db-8199-0334a7088775 tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] attachment_update completed successfully.
Nov 05 19:16:13 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-ccc0a03d-8563-4f6d-82b6-02b63df3983d req-74f888e1-b255-4863-aeaf-4acc019f16b8 tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Terminate volume connection completed successfully.
Nov 05 19:16:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-ccc0a03d-8563-4f6d-82b6-02b63df3983d req-74f888e1-b255-4863-aeaf-4acc019f16b8 tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Deleting attachment f6cd618e-ca49-45b5-bfcc-bf7280f241e3. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 19:16:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fd67a455-7385-4f65-aefa-5fe4709b906a tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Acquiring lock "cinder-483de898-5f8d-46ef-88df-ee43b1867ea1-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:16:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fd67a455-7385-4f65-aefa-5fe4709b906a tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Lock "cinder-483de898-5f8d-46ef-88df-ee43b1867ea1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:16:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fd67a455-7385-4f65-aefa-5fe4709b906a tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Acquiring lock "cinder-quobyte-483de898-5f8d-46ef-88df-ee43b1867ea1" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:16:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fd67a455-7385-4f65-aefa-5fe4709b906a tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Lock "cinder-quobyte-483de898-5f8d-46ef-88df-ee43b1867ea1" acquired by "delete_volume" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:16:14 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf9a734-e9d3-49c1-8b61-d7d7f3a91ac2]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:16:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fd67a455-7385-4f65-aefa-5fe4709b906a tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-483de898-5f8d-46ef-88df-ee43b1867ea1 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:15 devstack sudo[97772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-483de898-5f8d-46ef-88df-ee43b1867ea1
Nov 05 19:16:15 devstack sudo[97772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:15 devstack sudo[97772]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fd67a455-7385-4f65-aefa-5fe4709b906a tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-483de898-5f8d-46ef-88df-ee43b1867ea1" returned: 0 in 0.456s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fd67a455-7385-4f65-aefa-5fe4709b906a tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-483de898-5f8d-46ef-88df-ee43b1867ea1 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:15 devstack sudo[97781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-483de898-5f8d-46ef-88df-ee43b1867ea1
Nov 05 19:16:15 devstack sudo[97781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:15 devstack sudo[97781]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fd67a455-7385-4f65-aefa-5fe4709b906a tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-483de898-5f8d-46ef-88df-ee43b1867ea1" returned: 0 in 0.289s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fd67a455-7385-4f65-aefa-5fe4709b906a tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Lock "cinder-quobyte-483de898-5f8d-46ef-88df-ee43b1867ea1" released by "delete_volume" :: held 0.808s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:16:15 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-fd67a455-7385-4f65-aefa-5fe4709b906a tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Created reservations ['201986a4-7bd2-478b-b969-438a6ebddb2f', 'a03259e5-a8de-4392-9578-1bd7a571cd74', '52be4d7d-a8dd-400a-b65a-4695554d5e6c', '7f685392-6615-4a5c-b38e-5e497baaf90d'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:16:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fd67a455-7385-4f65-aefa-5fe4709b906a tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:16:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fd67a455-7385-4f65-aefa-5fe4709b906a tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:16:15 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fd67a455-7385-4f65-aefa-5fe4709b906a tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:16:15 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fd67a455-7385-4f65-aefa-5fe4709b906a tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:16:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fd67a455-7385-4f65-aefa-5fe4709b906a tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:16:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fd67a455-7385-4f65-aefa-5fe4709b906a tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:15 devstack sudo[97784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:16:15 devstack sudo[97784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:16 devstack sudo[97784]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fd67a455-7385-4f65-aefa-5fe4709b906a tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.380s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:16 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-fd67a455-7385-4f65-aefa-5fe4709b906a tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:16:16 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-fd67a455-7385-4f65-aefa-5fe4709b906a tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Deleted volume successfully.
Nov 05 19:16:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fd67a455-7385-4f65-aefa-5fe4709b906a tempest-TestServerVolumeAttachScenarioOldVersion-656370178 None] Lock "cinder-483de898-5f8d-46ef-88df-ee43b1867ea1-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:16:18 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-a04b4cbe-6b61-498d-9444-2dbaf8cfac39 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:16:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a04b4cbe-6b61-498d-9444-2dbaf8cfac39 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Flow 'volume_create_manager' (f3c43488-752e-442c-8fab-5ea1c5e2cc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:16:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a04b4cbe-6b61-498d-9444-2dbaf8cfac39 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (368f8b22-9364-4d8c-9533-e136678c934c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a04b4cbe-6b61-498d-9444-2dbaf8cfac39 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (368f8b22-9364-4d8c-9533-e136678c934c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-559564252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7769ead-71f2-49d4-8fe3-3ad0d3fa11b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b8429279374bdf8262615ba90875b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:16:18Z,use_quota=True,user_id='d4a5f1ef8aaa45c3a69077f1f926b65b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b274dbc-030e-411f-8fd9-2dfc868e0b03),volume_type_id=0b274dbc-030e-411f-8fd9-2dfc868e0b03)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a04b4cbe-6b61-498d-9444-2dbaf8cfac39 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bcaa2c4-028c-4d40-a2d3-5b7b0d6c9940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a04b4cbe-6b61-498d-9444-2dbaf8cfac39 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bcaa2c4-028c-4d40-a2d3-5b7b0d6c9940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a04b4cbe-6b61-498d-9444-2dbaf8cfac39 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37fe9fd5-df27-4bc1-990f-683b4f9bfb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a04b4cbe-6b61-498d-9444-2dbaf8cfac39 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37fe9fd5-df27-4bc1-990f-683b4f9bfb70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7769ead-71f2-49d4-8fe3-3ad0d3fa11b3', 'volume_name': 'volume-f7769ead-71f2-49d4-8fe3-3ad0d3fa11b3', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a04b4cbe-6b61-498d-9444-2dbaf8cfac39 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c5e6431-2f94-4c6c-be3b-3cb1e8161f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a04b4cbe-6b61-498d-9444-2dbaf8cfac39 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c5e6431-2f94-4c6c-be3b-3cb1e8161f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a04b4cbe-6b61-498d-9444-2dbaf8cfac39 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (386a25ef-1016-4439-a43e-eba290e5b845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:18 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-a04b4cbe-6b61-498d-9444-2dbaf8cfac39 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Volume f7769ead-71f2-49d4-8fe3-3ad0d3fa11b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7769ead-71f2-49d4-8fe3-3ad0d3fa11b3', 'volume_size': 1}
Nov 05 19:16:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a04b4cbe-6b61-498d-9444-2dbaf8cfac39 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:16:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a04b4cbe-6b61-498d-9444-2dbaf8cfac39 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:16:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a04b4cbe-6b61-498d-9444-2dbaf8cfac39 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-559564252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7769ead-71f2-49d4-8fe3-3ad0d3fa11b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b8429279374bdf8262615ba90875b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:16:18Z,use_quota=True,user_id='d4a5f1ef8aaa45c3a69077f1f926b65b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b274dbc-030e-411f-8fd9-2dfc868e0b03),volume_type_id=0b274dbc-030e-411f-8fd9-2dfc868e0b03)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:16:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-a04b4cbe-6b61-498d-9444-2dbaf8cfac39 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Creating volume f7769ead-71f2-49d4-8fe3-3ad0d3fa11b3 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:16:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a04b4cbe-6b61-498d-9444-2dbaf8cfac39 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:16:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a04b4cbe-6b61-498d-9444-2dbaf8cfac39 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:16:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a04b4cbe-6b61-498d-9444-2dbaf8cfac39 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:16:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a04b4cbe-6b61-498d-9444-2dbaf8cfac39 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:16:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a04b4cbe-6b61-498d-9444-2dbaf8cfac39 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:16:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a04b4cbe-6b61-498d-9444-2dbaf8cfac39 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:16:18 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-a04b4cbe-6b61-498d-9444-2dbaf8cfac39 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:16:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a04b4cbe-6b61-498d-9444-2dbaf8cfac39 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f7769ead-71f2-49d4-8fe3-3ad0d3fa11b3 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:18 devstack sudo[97916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f7769ead-71f2-49d4-8fe3-3ad0d3fa11b3 1073741824
Nov 05 19:16:18 devstack sudo[97916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:19 devstack sudo[97916]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a04b4cbe-6b61-498d-9444-2dbaf8cfac39 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f7769ead-71f2-49d4-8fe3-3ad0d3fa11b3 1073741824" returned: 0 in 0.900s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a04b4cbe-6b61-498d-9444-2dbaf8cfac39 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f7769ead-71f2-49d4-8fe3-3ad0d3fa11b3 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:19 devstack sudo[97932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f7769ead-71f2-49d4-8fe3-3ad0d3fa11b3
Nov 05 19:16:19 devstack sudo[97932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:20 devstack sudo[97932]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a04b4cbe-6b61-498d-9444-2dbaf8cfac39 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f7769ead-71f2-49d4-8fe3-3ad0d3fa11b3" returned: 0 in 0.819s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a04b4cbe-6b61-498d-9444-2dbaf8cfac39 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] <== create_volume: return (1816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:16:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a04b4cbe-6b61-498d-9444-2dbaf8cfac39 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.824s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:16:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a04b4cbe-6b61-498d-9444-2dbaf8cfac39 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (386a25ef-1016-4439-a43e-eba290e5b845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7769ead-71f2-49d4-8fe3-3ad0d3fa11b3', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a04b4cbe-6b61-498d-9444-2dbaf8cfac39 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5483ff5b-10dd-4d57-b5f8-d3a249690294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:20 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-a04b4cbe-6b61-498d-9444-2dbaf8cfac39 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Volume volume-f7769ead-71f2-49d4-8fe3-3ad0d3fa11b3 (f7769ead-71f2-49d4-8fe3-3ad0d3fa11b3): created successfully
Nov 05 19:16:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a04b4cbe-6b61-498d-9444-2dbaf8cfac39 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5483ff5b-10dd-4d57-b5f8-d3a249690294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a04b4cbe-6b61-498d-9444-2dbaf8cfac39 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Flow 'volume_create_manager' (f3c43488-752e-442c-8fab-5ea1c5e2cc7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:16:20 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-a04b4cbe-6b61-498d-9444-2dbaf8cfac39 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Created volume successfully.
Nov 05 19:16:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6e28d914-a885-4a40-b42b-45456eb2ea62 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:16:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6e28d914-a885-4a40-b42b-45456eb2ea62 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:16:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6e28d914-a885-4a40-b42b-45456eb2ea62 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:16:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6e28d914-a885-4a40-b42b-45456eb2ea62 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:16:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6e28d914-a885-4a40-b42b-45456eb2ea62 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:16:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6e28d914-a885-4a40-b42b-45456eb2ea62 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:22 devstack sudo[97941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:16:22 devstack sudo[97941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:23 devstack sudo[97941]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6e28d914-a885-4a40-b42b-45456eb2ea62 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.408s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:23 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-6e28d914-a885-4a40-b42b-45456eb2ea62 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:16:23 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-6e28d914-a885-4a40-b42b-45456eb2ea62 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Retype volume completed successfully.
Nov 05 19:16:23 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-18a13d31-abe9-4dd3-8a4c-123e04dd27bb tempest-VolumesActionsTest-459479611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:16:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-18a13d31-abe9-4dd3-8a4c-123e04dd27bb tempest-VolumesActionsTest-459479611 None] Flow 'volume_create_manager' (5733114e-e8dd-4fa7-95aa-1cc95d032f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:16:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-18a13d31-abe9-4dd3-8a4c-123e04dd27bb tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4297acee-bbed-4231-a2b2-385f4a5407b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-18a13d31-abe9-4dd3-8a4c-123e04dd27bb tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4297acee-bbed-4231-a2b2-385f4a5407b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-388233758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dc4275e-61db-46d2-9e55-33060b38b0fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b461c484fe094feab37e9dc9faccdd30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:16:23Z,use_quota=True,user_id='569faebdd7f1457bbca32f55700e0795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-18a13d31-abe9-4dd3-8a4c-123e04dd27bb tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (168d31c7-07bc-4fa0-bc78-a574d869b77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-18a13d31-abe9-4dd3-8a4c-123e04dd27bb tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (168d31c7-07bc-4fa0-bc78-a574d869b77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-18a13d31-abe9-4dd3-8a4c-123e04dd27bb tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba749fe8-9138-4295-9ee5-8dbc21e6cb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-18a13d31-abe9-4dd3-8a4c-123e04dd27bb tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba749fe8-9138-4295-9ee5-8dbc21e6cb69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dc4275e-61db-46d2-9e55-33060b38b0fb', 'volume_name': 'volume-1dc4275e-61db-46d2-9e55-33060b38b0fb', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-18a13d31-abe9-4dd3-8a4c-123e04dd27bb tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec4f56c4-8bef-4f5b-9455-9ddc50f149f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-18a13d31-abe9-4dd3-8a4c-123e04dd27bb tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec4f56c4-8bef-4f5b-9455-9ddc50f149f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-18a13d31-abe9-4dd3-8a4c-123e04dd27bb tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (946a1381-f33e-45c9-b7e9-68156b4ec0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:23 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-18a13d31-abe9-4dd3-8a4c-123e04dd27bb tempest-VolumesActionsTest-459479611 None] Volume 1dc4275e-61db-46d2-9e55-33060b38b0fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dc4275e-61db-46d2-9e55-33060b38b0fb', 'volume_size': 1}
Nov 05 19:16:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-18a13d31-abe9-4dd3-8a4c-123e04dd27bb tempest-VolumesActionsTest-459479611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:16:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-18a13d31-abe9-4dd3-8a4c-123e04dd27bb tempest-VolumesActionsTest-459479611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:16:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-18a13d31-abe9-4dd3-8a4c-123e04dd27bb tempest-VolumesActionsTest-459479611 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-388233758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dc4275e-61db-46d2-9e55-33060b38b0fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b461c484fe094feab37e9dc9faccdd30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:16:23Z,use_quota=True,user_id='569faebdd7f1457bbca32f55700e0795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:16:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-18a13d31-abe9-4dd3-8a4c-123e04dd27bb tempest-VolumesActionsTest-459479611 None] Creating volume 1dc4275e-61db-46d2-9e55-33060b38b0fb {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:16:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-18a13d31-abe9-4dd3-8a4c-123e04dd27bb tempest-VolumesActionsTest-459479611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:16:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-18a13d31-abe9-4dd3-8a4c-123e04dd27bb tempest-VolumesActionsTest-459479611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:16:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-18a13d31-abe9-4dd3-8a4c-123e04dd27bb tempest-VolumesActionsTest-459479611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:16:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-18a13d31-abe9-4dd3-8a4c-123e04dd27bb tempest-VolumesActionsTest-459479611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:16:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-18a13d31-abe9-4dd3-8a4c-123e04dd27bb tempest-VolumesActionsTest-459479611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:16:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-18a13d31-abe9-4dd3-8a4c-123e04dd27bb tempest-VolumesActionsTest-459479611 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:16:23 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-18a13d31-abe9-4dd3-8a4c-123e04dd27bb tempest-VolumesActionsTest-459479611 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:16:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-18a13d31-abe9-4dd3-8a4c-123e04dd27bb tempest-VolumesActionsTest-459479611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-1dc4275e-61db-46d2-9e55-33060b38b0fb 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:23 devstack sudo[97944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-1dc4275e-61db-46d2-9e55-33060b38b0fb 1073741824
Nov 05 19:16:23 devstack sudo[97944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:24 devstack sudo[97944]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-18a13d31-abe9-4dd3-8a4c-123e04dd27bb tempest-VolumesActionsTest-459479611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-1dc4275e-61db-46d2-9e55-33060b38b0fb 1073741824" returned: 0 in 0.799s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-18a13d31-abe9-4dd3-8a4c-123e04dd27bb tempest-VolumesActionsTest-459479611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-1dc4275e-61db-46d2-9e55-33060b38b0fb {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dccea082-a8aa-4eed-b075-9ac09e0bbb93 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Acquiring lock "cinder-f7769ead-71f2-49d4-8fe3-3ad0d3fa11b3-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:16:24 devstack sudo[97949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-1dc4275e-61db-46d2-9e55-33060b38b0fb
Nov 05 19:16:24 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dccea082-a8aa-4eed-b075-9ac09e0bbb93 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Lock "cinder-f7769ead-71f2-49d4-8fe3-3ad0d3fa11b3-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:16:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dccea082-a8aa-4eed-b075-9ac09e0bbb93 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Acquiring lock "cinder-quobyte-f7769ead-71f2-49d4-8fe3-3ad0d3fa11b3" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:16:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dccea082-a8aa-4eed-b075-9ac09e0bbb93 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Lock "cinder-quobyte-f7769ead-71f2-49d4-8fe3-3ad0d3fa11b3" acquired by "delete_volume" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:16:24 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[73725964-ff3c-4ebe-869a-5edd8fc94ceb]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:16:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dccea082-a8aa-4eed-b075-9ac09e0bbb93 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f7769ead-71f2-49d4-8fe3-3ad0d3fa11b3 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:24 devstack sudo[97951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f7769ead-71f2-49d4-8fe3-3ad0d3fa11b3
Nov 05 19:16:24 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:24 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-18a13d31-abe9-4dd3-8a4c-123e04dd27bb tempest-VolumesActionsTest-459479611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-1dc4275e-61db-46d2-9e55-33060b38b0fb" returned: 0 in 0.516s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-18a13d31-abe9-4dd3-8a4c-123e04dd27bb tempest-VolumesActionsTest-459479611 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:16:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-18a13d31-abe9-4dd3-8a4c-123e04dd27bb tempest-VolumesActionsTest-459479611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:16:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-18a13d31-abe9-4dd3-8a4c-123e04dd27bb tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (946a1381-f33e-45c9-b7e9-68156b4ec0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dc4275e-61db-46d2-9e55-33060b38b0fb', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-18a13d31-abe9-4dd3-8a4c-123e04dd27bb tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cc376ea-2485-4250-a41f-680d61c58406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:24 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-18a13d31-abe9-4dd3-8a4c-123e04dd27bb tempest-VolumesActionsTest-459479611 None] Volume volume-1dc4275e-61db-46d2-9e55-33060b38b0fb (1dc4275e-61db-46d2-9e55-33060b38b0fb): created successfully
Nov 05 19:16:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-18a13d31-abe9-4dd3-8a4c-123e04dd27bb tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cc376ea-2485-4250-a41f-680d61c58406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-18a13d31-abe9-4dd3-8a4c-123e04dd27bb tempest-VolumesActionsTest-459479611 None] Flow 'volume_create_manager' (5733114e-e8dd-4fa7-95aa-1cc95d032f9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:16:24 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-18a13d31-abe9-4dd3-8a4c-123e04dd27bb tempest-VolumesActionsTest-459479611 None] Created volume successfully.
Nov 05 19:16:25 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dccea082-a8aa-4eed-b075-9ac09e0bbb93 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f7769ead-71f2-49d4-8fe3-3ad0d3fa11b3" returned: 0 in 0.573s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dccea082-a8aa-4eed-b075-9ac09e0bbb93 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f7769ead-71f2-49d4-8fe3-3ad0d3fa11b3 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:25 devstack sudo[97957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f7769ead-71f2-49d4-8fe3-3ad0d3fa11b3
Nov 05 19:16:25 devstack sudo[97957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:25 devstack sudo[97957]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dccea082-a8aa-4eed-b075-9ac09e0bbb93 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f7769ead-71f2-49d4-8fe3-3ad0d3fa11b3" returned: 0 in 0.271s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:25 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dccea082-a8aa-4eed-b075-9ac09e0bbb93 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Lock "cinder-quobyte-f7769ead-71f2-49d4-8fe3-3ad0d3fa11b3" released by "delete_volume" :: held 0.925s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:16:25 devstack cinder-volume[87184]: WARNING cinder.quota [None req-dccea082-a8aa-4eed-b075-9ac09e0bbb93 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 05 19:16:25 devstack cinder-volume[87184]: WARNING cinder.quota [None req-dccea082-a8aa-4eed-b075-9ac09e0bbb93 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 05 19:16:25 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-dccea082-a8aa-4eed-b075-9ac09e0bbb93 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Created reservations ['92a7d789-4872-482c-95dd-a8e57ec82869', '4cee88e0-6272-4efb-9dd5-291fb335175a', 'b1a17170-6c1e-467c-ab3f-2336e17534d7', '447382ba-9732-49b3-8c8e-5288fdd2beb6'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:16:25 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e122eb8c-7875-4025-bff5-d63ab810ff97 tempest-VolumesActionsTest-459479611 None] Acquiring lock "cinder-1dc4275e-61db-46d2-9e55-33060b38b0fb" by "attach_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:16:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dccea082-a8aa-4eed-b075-9ac09e0bbb93 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:16:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dccea082-a8aa-4eed-b075-9ac09e0bbb93 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:16:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dccea082-a8aa-4eed-b075-9ac09e0bbb93 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:16:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dccea082-a8aa-4eed-b075-9ac09e0bbb93 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:16:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dccea082-a8aa-4eed-b075-9ac09e0bbb93 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:16:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dccea082-a8aa-4eed-b075-9ac09e0bbb93 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:25 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e122eb8c-7875-4025-bff5-d63ab810ff97 tempest-VolumesActionsTest-459479611 None] Lock "cinder-1dc4275e-61db-46d2-9e55-33060b38b0fb" acquired by "attach_volume" :: waited 0.076s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:16:25 devstack sudo[97960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:16:25 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:25 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-e122eb8c-7875-4025-bff5-d63ab810ff97 tempest-VolumesActionsTest-459479611 None] Attaching volume 1dc4275e-61db-46d2-9e55-33060b38b0fb to instance 8b05baf0-7f03-4dca-847a-c491a73efd7f at mountpoint /dev/vdb on host None.
Nov 05 19:16:25 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-e122eb8c-7875-4025-bff5-d63ab810ff97 tempest-VolumesActionsTest-459479611 None] Attach volume completed successfully.
Nov 05 19:16:25 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e122eb8c-7875-4025-bff5-d63ab810ff97 tempest-VolumesActionsTest-459479611 None] Lock "cinder-1dc4275e-61db-46d2-9e55-33060b38b0fb" released by "attach_volume" :: held 0.294s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:16:25 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dccea082-a8aa-4eed-b075-9ac09e0bbb93 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.329s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:25 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-dccea082-a8aa-4eed-b075-9ac09e0bbb93 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:16:25 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-dccea082-a8aa-4eed-b075-9ac09e0bbb93 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Deleted volume successfully.
Nov 05 19:16:25 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dccea082-a8aa-4eed-b075-9ac09e0bbb93 tempest-VolumeRetypeWithoutMigrationTest-96184861 None] Lock "cinder-f7769ead-71f2-49d4-8fe3-3ad0d3fa11b3-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:16:27 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b2adaaf2-57c6-4a4d-b558-f697cc0bed96 tempest-VolumesActionsTest-518532599 None] Terminate volume connection completed successfully.
Nov 05 19:16:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b2adaaf2-57c6-4a4d-b558-f697cc0bed96 tempest-VolumesActionsTest-518532599 None] Acquiring lock "cinder-1dc4275e-61db-46d2-9e55-33060b38b0fb-detach_volume" by "detach_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:16:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b2adaaf2-57c6-4a4d-b558-f697cc0bed96 tempest-VolumesActionsTest-518532599 None] Lock "cinder-1dc4275e-61db-46d2-9e55-33060b38b0fb-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:16:27 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b2adaaf2-57c6-4a4d-b558-f697cc0bed96 tempest-VolumesActionsTest-518532599 None] Detaching volume 1dc4275e-61db-46d2-9e55-33060b38b0fb from instance 8b05baf0-7f03-4dca-847a-c491a73efd7f.
Nov 05 19:16:27 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b2adaaf2-57c6-4a4d-b558-f697cc0bed96 tempest-VolumesActionsTest-518532599 None] Detach volume completed successfully.
Nov 05 19:16:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b2adaaf2-57c6-4a4d-b558-f697cc0bed96 tempest-VolumesActionsTest-518532599 None] Lock "cinder-1dc4275e-61db-46d2-9e55-33060b38b0fb-detach_volume" released by "detach_volume" :: held 0.145s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:16:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c99d5185-e3dd-4a10-b049-8b89f0c54a2d tempest-VolumesActionsTest-459479611 None] Acquiring lock "cinder-1dc4275e-61db-46d2-9e55-33060b38b0fb-detach_volume" by "detach_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:16:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c99d5185-e3dd-4a10-b049-8b89f0c54a2d tempest-VolumesActionsTest-459479611 None] Lock "cinder-1dc4275e-61db-46d2-9e55-33060b38b0fb-detach_volume" acquired by "detach_volume" :: waited 0.042s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:16:27 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-c99d5185-e3dd-4a10-b049-8b89f0c54a2d tempest-VolumesActionsTest-459479611 None] Volume detach called, but volume not attached.
Nov 05 19:16:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c99d5185-e3dd-4a10-b049-8b89f0c54a2d tempest-VolumesActionsTest-459479611 None] Lock "cinder-1dc4275e-61db-46d2-9e55-33060b38b0fb-detach_volume" released by "detach_volume" :: held 0.064s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:16:28 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fe51267c-b0cb-4c58-b1b9-0f6d7fe46f54 tempest-VolumesActionsTest-459479611 None] Acquiring lock "cinder-1dc4275e-61db-46d2-9e55-33060b38b0fb-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:16:28 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fe51267c-b0cb-4c58-b1b9-0f6d7fe46f54 tempest-VolumesActionsTest-459479611 None] Lock "cinder-1dc4275e-61db-46d2-9e55-33060b38b0fb-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:16:28 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fe51267c-b0cb-4c58-b1b9-0f6d7fe46f54 tempest-VolumesActionsTest-459479611 None] Acquiring lock "cinder-quobyte-1dc4275e-61db-46d2-9e55-33060b38b0fb" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:16:28 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fe51267c-b0cb-4c58-b1b9-0f6d7fe46f54 tempest-VolumesActionsTest-459479611 None] Lock "cinder-quobyte-1dc4275e-61db-46d2-9e55-33060b38b0fb" acquired by "delete_volume" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:16:28 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edb1943-6708-4fc6-8690-8e1328b88841]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:16:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fe51267c-b0cb-4c58-b1b9-0f6d7fe46f54 tempest-VolumesActionsTest-459479611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-1dc4275e-61db-46d2-9e55-33060b38b0fb {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:28 devstack sudo[97965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-1dc4275e-61db-46d2-9e55-33060b38b0fb
Nov 05 19:16:28 devstack sudo[97965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:29 devstack sudo[97965]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fe51267c-b0cb-4c58-b1b9-0f6d7fe46f54 tempest-VolumesActionsTest-459479611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-1dc4275e-61db-46d2-9e55-33060b38b0fb" returned: 0 in 0.713s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fe51267c-b0cb-4c58-b1b9-0f6d7fe46f54 tempest-VolumesActionsTest-459479611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-1dc4275e-61db-46d2-9e55-33060b38b0fb {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:29 devstack sudo[97970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-1dc4275e-61db-46d2-9e55-33060b38b0fb
Nov 05 19:16:29 devstack sudo[97970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:29 devstack sudo[97970]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fe51267c-b0cb-4c58-b1b9-0f6d7fe46f54 tempest-VolumesActionsTest-459479611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-1dc4275e-61db-46d2-9e55-33060b38b0fb" returned: 0 in 0.669s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:29 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fe51267c-b0cb-4c58-b1b9-0f6d7fe46f54 tempest-VolumesActionsTest-459479611 None] Lock "cinder-quobyte-1dc4275e-61db-46d2-9e55-33060b38b0fb" released by "delete_volume" :: held 1.450s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:16:29 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-fe51267c-b0cb-4c58-b1b9-0f6d7fe46f54 tempest-VolumesActionsTest-459479611 None] Created reservations ['5f267c0f-743a-44bc-9f63-23f83d6a069c', 'da8db8bc-14ac-4e3f-8eeb-3bd6f1359293', '7f805152-1542-45c6-b73b-e0a2b5587f31', '42ecff71-3ff4-403b-b918-8b9edff2ee10'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:16:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fe51267c-b0cb-4c58-b1b9-0f6d7fe46f54 tempest-VolumesActionsTest-459479611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:16:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fe51267c-b0cb-4c58-b1b9-0f6d7fe46f54 tempest-VolumesActionsTest-459479611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:16:30 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fe51267c-b0cb-4c58-b1b9-0f6d7fe46f54 tempest-VolumesActionsTest-459479611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:16:30 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fe51267c-b0cb-4c58-b1b9-0f6d7fe46f54 tempest-VolumesActionsTest-459479611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:16:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fe51267c-b0cb-4c58-b1b9-0f6d7fe46f54 tempest-VolumesActionsTest-459479611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:16:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fe51267c-b0cb-4c58-b1b9-0f6d7fe46f54 tempest-VolumesActionsTest-459479611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:30 devstack sudo[97973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:16:30 devstack sudo[97973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:30 devstack sudo[97973]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fe51267c-b0cb-4c58-b1b9-0f6d7fe46f54 tempest-VolumesActionsTest-459479611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.392s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:30 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-fe51267c-b0cb-4c58-b1b9-0f6d7fe46f54 tempest-VolumesActionsTest-459479611 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:16:30 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-fe51267c-b0cb-4c58-b1b9-0f6d7fe46f54 tempest-VolumesActionsTest-459479611 None] Deleted volume successfully.
Nov 05 19:16:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fe51267c-b0cb-4c58-b1b9-0f6d7fe46f54 tempest-VolumesActionsTest-459479611 None] Lock "cinder-1dc4275e-61db-46d2-9e55-33060b38b0fb-delete_volume" released by "delete_volume" :: held 2.214s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:16:35 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-733cbf03-d600-47e4-9aca-cb2189333471 tempest-VolumesActionsTest-459479611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:16:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-733cbf03-d600-47e4-9aca-cb2189333471 tempest-VolumesActionsTest-459479611 None] Flow 'volume_create_manager' (2423ae90-47da-4604-8232-44041ee05add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:16:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-733cbf03-d600-47e4-9aca-cb2189333471 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (179407b5-bbad-43d9-a573-586635820d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-733cbf03-d600-47e4-9aca-cb2189333471 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (179407b5-bbad-43d9-a573-586635820d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1981028314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03597eaf-f7bb-4972-9750-f60de8775451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b461c484fe094feab37e9dc9faccdd30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:16:36Z,use_quota=True,user_id='569faebdd7f1457bbca32f55700e0795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-733cbf03-d600-47e4-9aca-cb2189333471 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e9af3db-e499-40e8-89f0-d509a7fabd4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-733cbf03-d600-47e4-9aca-cb2189333471 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e9af3db-e499-40e8-89f0-d509a7fabd4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-733cbf03-d600-47e4-9aca-cb2189333471 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5c162ff-dd3e-4b6e-a5ca-c19265dbe0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-733cbf03-d600-47e4-9aca-cb2189333471 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5c162ff-dd3e-4b6e-a5ca-c19265dbe0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03597eaf-f7bb-4972-9750-f60de8775451', 'volume_name': 'volume-03597eaf-f7bb-4972-9750-f60de8775451', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-733cbf03-d600-47e4-9aca-cb2189333471 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (051b3b5a-5332-4089-b1c3-558e6218641e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-733cbf03-d600-47e4-9aca-cb2189333471 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (051b3b5a-5332-4089-b1c3-558e6218641e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-733cbf03-d600-47e4-9aca-cb2189333471 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a32f41ab-7b38-4c8d-9227-cb4d336d4817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:35 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-733cbf03-d600-47e4-9aca-cb2189333471 tempest-VolumesActionsTest-459479611 None] Volume 03597eaf-f7bb-4972-9750-f60de8775451: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03597eaf-f7bb-4972-9750-f60de8775451', 'volume_size': 1}
Nov 05 19:16:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-733cbf03-d600-47e4-9aca-cb2189333471 tempest-VolumesActionsTest-459479611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:16:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-733cbf03-d600-47e4-9aca-cb2189333471 tempest-VolumesActionsTest-459479611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:16:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-733cbf03-d600-47e4-9aca-cb2189333471 tempest-VolumesActionsTest-459479611 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1981028314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03597eaf-f7bb-4972-9750-f60de8775451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b461c484fe094feab37e9dc9faccdd30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:16:36Z,use_quota=True,user_id='569faebdd7f1457bbca32f55700e0795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:16:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-733cbf03-d600-47e4-9aca-cb2189333471 tempest-VolumesActionsTest-459479611 None] Creating volume 03597eaf-f7bb-4972-9750-f60de8775451 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:16:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-733cbf03-d600-47e4-9aca-cb2189333471 tempest-VolumesActionsTest-459479611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:16:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-733cbf03-d600-47e4-9aca-cb2189333471 tempest-VolumesActionsTest-459479611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:16:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-733cbf03-d600-47e4-9aca-cb2189333471 tempest-VolumesActionsTest-459479611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:16:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-733cbf03-d600-47e4-9aca-cb2189333471 tempest-VolumesActionsTest-459479611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:16:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-733cbf03-d600-47e4-9aca-cb2189333471 tempest-VolumesActionsTest-459479611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:16:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-733cbf03-d600-47e4-9aca-cb2189333471 tempest-VolumesActionsTest-459479611 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:16:35 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-733cbf03-d600-47e4-9aca-cb2189333471 tempest-VolumesActionsTest-459479611 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:16:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-733cbf03-d600-47e4-9aca-cb2189333471 tempest-VolumesActionsTest-459479611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-03597eaf-f7bb-4972-9750-f60de8775451 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:35 devstack sudo[98008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-03597eaf-f7bb-4972-9750-f60de8775451 1073741824
Nov 05 19:16:35 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:36 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-733cbf03-d600-47e4-9aca-cb2189333471 tempest-VolumesActionsTest-459479611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-03597eaf-f7bb-4972-9750-f60de8775451 1073741824" returned: 0 in 0.488s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-733cbf03-d600-47e4-9aca-cb2189333471 tempest-VolumesActionsTest-459479611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-03597eaf-f7bb-4972-9750-f60de8775451 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:36 devstack sudo[98015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-03597eaf-f7bb-4972-9750-f60de8775451
Nov 05 19:16:36 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:36 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-733cbf03-d600-47e4-9aca-cb2189333471 tempest-VolumesActionsTest-459479611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-03597eaf-f7bb-4972-9750-f60de8775451" returned: 0 in 0.277s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-733cbf03-d600-47e4-9aca-cb2189333471 tempest-VolumesActionsTest-459479611 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:16:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-733cbf03-d600-47e4-9aca-cb2189333471 tempest-VolumesActionsTest-459479611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:16:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-733cbf03-d600-47e4-9aca-cb2189333471 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a32f41ab-7b38-4c8d-9227-cb4d336d4817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03597eaf-f7bb-4972-9750-f60de8775451', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-733cbf03-d600-47e4-9aca-cb2189333471 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (937343d1-3c43-45db-9187-c1b891cae355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:36 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-733cbf03-d600-47e4-9aca-cb2189333471 tempest-VolumesActionsTest-459479611 None] Volume volume-03597eaf-f7bb-4972-9750-f60de8775451 (03597eaf-f7bb-4972-9750-f60de8775451): created successfully
Nov 05 19:16:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-733cbf03-d600-47e4-9aca-cb2189333471 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (937343d1-3c43-45db-9187-c1b891cae355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-733cbf03-d600-47e4-9aca-cb2189333471 tempest-VolumesActionsTest-459479611 None] Flow 'volume_create_manager' (2423ae90-47da-4604-8232-44041ee05add) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:16:36 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-733cbf03-d600-47e4-9aca-cb2189333471 tempest-VolumesActionsTest-459479611 None] Created volume successfully.
Nov 05 19:16:37 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-558ea329-4547-41ea-bab3-1e042e29ca7d tempest-VolumesServicesTestJSON-1598646309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:16:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-558ea329-4547-41ea-bab3-1e042e29ca7d tempest-VolumesServicesTestJSON-1598646309 None] Flow 'volume_create_manager' (6a196821-21aa-473f-bec6-e119d2b786d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:16:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-558ea329-4547-41ea-bab3-1e042e29ca7d tempest-VolumesServicesTestJSON-1598646309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dadc3103-5171-4b18-95ed-e4e5b28d344b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-558ea329-4547-41ea-bab3-1e042e29ca7d tempest-VolumesServicesTestJSON-1598646309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dadc3103-5171-4b18-95ed-e4e5b28d344b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:16:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1475522240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4279057-c834-4e30-b8a3-c21c8d45589b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdca373e8e7844cc94e9c5aadb11c537',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:16:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:16:37Z,use_quota=True,user_id='05aab2028b4547e59a418ef34e573004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-558ea329-4547-41ea-bab3-1e042e29ca7d tempest-VolumesServicesTestJSON-1598646309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45591898-4b43-4a78-bc63-49aab7dceada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-558ea329-4547-41ea-bab3-1e042e29ca7d tempest-VolumesServicesTestJSON-1598646309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45591898-4b43-4a78-bc63-49aab7dceada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-558ea329-4547-41ea-bab3-1e042e29ca7d tempest-VolumesServicesTestJSON-1598646309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deb59127-272b-4036-8248-72641d0b04a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-558ea329-4547-41ea-bab3-1e042e29ca7d tempest-VolumesServicesTestJSON-1598646309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deb59127-272b-4036-8248-72641d0b04a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4279057-c834-4e30-b8a3-c21c8d45589b', 'volume_name': 'volume-a4279057-c834-4e30-b8a3-c21c8d45589b', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-558ea329-4547-41ea-bab3-1e042e29ca7d tempest-VolumesServicesTestJSON-1598646309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a8bf36b-a496-444e-934e-5782f0da9da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-558ea329-4547-41ea-bab3-1e042e29ca7d tempest-VolumesServicesTestJSON-1598646309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a8bf36b-a496-444e-934e-5782f0da9da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-558ea329-4547-41ea-bab3-1e042e29ca7d tempest-VolumesServicesTestJSON-1598646309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e7a6422-3587-4776-888a-a2ce5c71a826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:37 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-558ea329-4547-41ea-bab3-1e042e29ca7d tempest-VolumesServicesTestJSON-1598646309 None] Volume a4279057-c834-4e30-b8a3-c21c8d45589b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4279057-c834-4e30-b8a3-c21c8d45589b', 'volume_size': 1}
Nov 05 19:16:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-558ea329-4547-41ea-bab3-1e042e29ca7d tempest-VolumesServicesTestJSON-1598646309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:16:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-558ea329-4547-41ea-bab3-1e042e29ca7d tempest-VolumesServicesTestJSON-1598646309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:16:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-558ea329-4547-41ea-bab3-1e042e29ca7d tempest-VolumesServicesTestJSON-1598646309 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:16:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1475522240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4279057-c834-4e30-b8a3-c21c8d45589b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdca373e8e7844cc94e9c5aadb11c537',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:16:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:16:37Z,use_quota=True,user_id='05aab2028b4547e59a418ef34e573004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:16:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-558ea329-4547-41ea-bab3-1e042e29ca7d tempest-VolumesServicesTestJSON-1598646309 None] Creating volume a4279057-c834-4e30-b8a3-c21c8d45589b {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:16:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-558ea329-4547-41ea-bab3-1e042e29ca7d tempest-VolumesServicesTestJSON-1598646309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:16:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-558ea329-4547-41ea-bab3-1e042e29ca7d tempest-VolumesServicesTestJSON-1598646309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:16:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-558ea329-4547-41ea-bab3-1e042e29ca7d tempest-VolumesServicesTestJSON-1598646309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:16:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-558ea329-4547-41ea-bab3-1e042e29ca7d tempest-VolumesServicesTestJSON-1598646309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:16:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-558ea329-4547-41ea-bab3-1e042e29ca7d tempest-VolumesServicesTestJSON-1598646309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:16:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-558ea329-4547-41ea-bab3-1e042e29ca7d tempest-VolumesServicesTestJSON-1598646309 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:16:37 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-558ea329-4547-41ea-bab3-1e042e29ca7d tempest-VolumesServicesTestJSON-1598646309 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:16:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-558ea329-4547-41ea-bab3-1e042e29ca7d tempest-VolumesServicesTestJSON-1598646309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4279057-c834-4e30-b8a3-c21c8d45589b 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:37 devstack sudo[98021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4279057-c834-4e30-b8a3-c21c8d45589b 1073741824
Nov 05 19:16:37 devstack sudo[98021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:37 devstack sudo[98021]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-558ea329-4547-41ea-bab3-1e042e29ca7d tempest-VolumesServicesTestJSON-1598646309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4279057-c834-4e30-b8a3-c21c8d45589b 1073741824" returned: 0 in 0.465s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ab93455a-18e7-431b-aa6e-d06218c33a54 tempest-VolumesActionsTest-518532599 None] Acquiring lock "cinder-03597eaf-f7bb-4972-9750-f60de8775451-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:16:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ab93455a-18e7-431b-aa6e-d06218c33a54 tempest-VolumesActionsTest-518532599 None] Lock "cinder-03597eaf-f7bb-4972-9750-f60de8775451-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:16:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-558ea329-4547-41ea-bab3-1e042e29ca7d tempest-VolumesServicesTestJSON-1598646309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4279057-c834-4e30-b8a3-c21c8d45589b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:38 devstack sudo[98026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4279057-c834-4e30-b8a3-c21c8d45589b
Nov 05 19:16:38 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ab93455a-18e7-431b-aa6e-d06218c33a54 tempest-VolumesActionsTest-518532599 None] Acquiring lock "cinder-quobyte-03597eaf-f7bb-4972-9750-f60de8775451" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:16:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ab93455a-18e7-431b-aa6e-d06218c33a54 tempest-VolumesActionsTest-518532599 None] Lock "cinder-quobyte-03597eaf-f7bb-4972-9750-f60de8775451" acquired by "delete_volume" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:16:38 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b26fe60-985e-47cb-9d77-578210bec922]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:16:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ab93455a-18e7-431b-aa6e-d06218c33a54 tempest-VolumesActionsTest-518532599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-03597eaf-f7bb-4972-9750-f60de8775451 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:38 devstack sudo[98028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-03597eaf-f7bb-4972-9750-f60de8775451
Nov 05 19:16:38 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:38 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-558ea329-4547-41ea-bab3-1e042e29ca7d tempest-VolumesServicesTestJSON-1598646309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4279057-c834-4e30-b8a3-c21c8d45589b" returned: 0 in 0.398s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-558ea329-4547-41ea-bab3-1e042e29ca7d tempest-VolumesServicesTestJSON-1598646309 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:16:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-558ea329-4547-41ea-bab3-1e042e29ca7d tempest-VolumesServicesTestJSON-1598646309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:16:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-558ea329-4547-41ea-bab3-1e042e29ca7d tempest-VolumesServicesTestJSON-1598646309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e7a6422-3587-4776-888a-a2ce5c71a826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4279057-c834-4e30-b8a3-c21c8d45589b', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-558ea329-4547-41ea-bab3-1e042e29ca7d tempest-VolumesServicesTestJSON-1598646309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ed48bbe-607b-4949-b0ec-6d18f18fced3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:38 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-558ea329-4547-41ea-bab3-1e042e29ca7d tempest-VolumesServicesTestJSON-1598646309 None] Volume volume-a4279057-c834-4e30-b8a3-c21c8d45589b (a4279057-c834-4e30-b8a3-c21c8d45589b): created successfully
Nov 05 19:16:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-558ea329-4547-41ea-bab3-1e042e29ca7d tempest-VolumesServicesTestJSON-1598646309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ed48bbe-607b-4949-b0ec-6d18f18fced3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-558ea329-4547-41ea-bab3-1e042e29ca7d tempest-VolumesServicesTestJSON-1598646309 None] Flow 'volume_create_manager' (6a196821-21aa-473f-bec6-e119d2b786d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:16:38 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-558ea329-4547-41ea-bab3-1e042e29ca7d tempest-VolumesServicesTestJSON-1598646309 None] Created volume successfully.
Nov 05 19:16:38 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ab93455a-18e7-431b-aa6e-d06218c33a54 tempest-VolumesActionsTest-518532599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-03597eaf-f7bb-4972-9750-f60de8775451" returned: 0 in 0.489s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ab93455a-18e7-431b-aa6e-d06218c33a54 tempest-VolumesActionsTest-518532599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-03597eaf-f7bb-4972-9750-f60de8775451 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:38 devstack sudo[98040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-03597eaf-f7bb-4972-9750-f60de8775451
Nov 05 19:16:38 devstack sudo[98040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:38 devstack sudo[98040]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ab93455a-18e7-431b-aa6e-d06218c33a54 tempest-VolumesActionsTest-518532599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-03597eaf-f7bb-4972-9750-f60de8775451" returned: 0 in 0.283s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ab93455a-18e7-431b-aa6e-d06218c33a54 tempest-VolumesActionsTest-518532599 None] Lock "cinder-quobyte-03597eaf-f7bb-4972-9750-f60de8775451" released by "delete_volume" :: held 0.822s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:16:38 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-ab93455a-18e7-431b-aa6e-d06218c33a54 tempest-VolumesActionsTest-518532599 None] Created reservations ['7fd3067c-4c65-4b11-a8fa-46dd2fccc5e3', '03f08f37-24fd-4a50-8fe3-a86f91ce18e4', 'a35a4ab9-2824-46f5-8076-e09f506ec440', 'e16d6413-44fb-40e2-b593-0b4c2f7a753c'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:16:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ab93455a-18e7-431b-aa6e-d06218c33a54 tempest-VolumesActionsTest-518532599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:16:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ab93455a-18e7-431b-aa6e-d06218c33a54 tempest-VolumesActionsTest-518532599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:16:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ab93455a-18e7-431b-aa6e-d06218c33a54 tempest-VolumesActionsTest-518532599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:16:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ab93455a-18e7-431b-aa6e-d06218c33a54 tempest-VolumesActionsTest-518532599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:16:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ab93455a-18e7-431b-aa6e-d06218c33a54 tempest-VolumesActionsTest-518532599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:16:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ab93455a-18e7-431b-aa6e-d06218c33a54 tempest-VolumesActionsTest-518532599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:39 devstack sudo[98049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:16:39 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:39 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ab93455a-18e7-431b-aa6e-d06218c33a54 tempest-VolumesActionsTest-518532599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.376s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:39 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-ab93455a-18e7-431b-aa6e-d06218c33a54 tempest-VolumesActionsTest-518532599 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:16:39 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-ab93455a-18e7-431b-aa6e-d06218c33a54 tempest-VolumesActionsTest-518532599 None] Deleted volume successfully.
Nov 05 19:16:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ab93455a-18e7-431b-aa6e-d06218c33a54 tempest-VolumesActionsTest-518532599 None] Lock "cinder-03597eaf-f7bb-4972-9750-f60de8775451-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:16:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-899ff8c8-9968-4818-88f2-287ac35f4945 tempest-VolumesServicesTestJSON-1598646309 None] Acquiring lock "cinder-a4279057-c834-4e30-b8a3-c21c8d45589b-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:16:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-899ff8c8-9968-4818-88f2-287ac35f4945 tempest-VolumesServicesTestJSON-1598646309 None] Lock "cinder-a4279057-c834-4e30-b8a3-c21c8d45589b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:16:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-899ff8c8-9968-4818-88f2-287ac35f4945 tempest-VolumesServicesTestJSON-1598646309 None] Acquiring lock "cinder-quobyte-a4279057-c834-4e30-b8a3-c21c8d45589b" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:16:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-899ff8c8-9968-4818-88f2-287ac35f4945 tempest-VolumesServicesTestJSON-1598646309 None] Lock "cinder-quobyte-a4279057-c834-4e30-b8a3-c21c8d45589b" acquired by "delete_volume" :: waited 0.036s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:16:39 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d5b218e-201c-43ba-b038-4f95abdcc15d tempest-VolumesActionsTest-459479611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:16:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1d5b218e-201c-43ba-b038-4f95abdcc15d tempest-VolumesActionsTest-459479611 None] Flow 'volume_create_manager' (c2947d8d-3212-441a-9409-391a8e406855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:16:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1d5b218e-201c-43ba-b038-4f95abdcc15d tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ed42f5b-41c7-49b2-b1df-689bad5cdc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:40 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c080a9ec-d99d-470b-b288-ccb0678dcdaf]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:16:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-899ff8c8-9968-4818-88f2-287ac35f4945 tempest-VolumesServicesTestJSON-1598646309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4279057-c834-4e30-b8a3-c21c8d45589b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1d5b218e-201c-43ba-b038-4f95abdcc15d tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ed42f5b-41c7-49b2-b1df-689bad5cdc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-954943829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38b290a9-9a02-44d6-b2e6-f587d7c3ff3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b461c484fe094feab37e9dc9faccdd30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:16:40Z,use_quota=True,user_id='569faebdd7f1457bbca32f55700e0795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1d5b218e-201c-43ba-b038-4f95abdcc15d tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67e57754-ed4a-41b7-b8a9-1ef5284d2965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1d5b218e-201c-43ba-b038-4f95abdcc15d tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67e57754-ed4a-41b7-b8a9-1ef5284d2965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1d5b218e-201c-43ba-b038-4f95abdcc15d tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36f87b91-cb11-457e-b2d3-39e6273d699b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1d5b218e-201c-43ba-b038-4f95abdcc15d tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36f87b91-cb11-457e-b2d3-39e6273d699b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38b290a9-9a02-44d6-b2e6-f587d7c3ff3a', 'volume_name': 'volume-38b290a9-9a02-44d6-b2e6-f587d7c3ff3a', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1d5b218e-201c-43ba-b038-4f95abdcc15d tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (989dd21f-aa0f-449f-bc63-46daa5dcf3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1d5b218e-201c-43ba-b038-4f95abdcc15d tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (989dd21f-aa0f-449f-bc63-46daa5dcf3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1d5b218e-201c-43ba-b038-4f95abdcc15d tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba787468-e3d0-42b4-b20f-b8494fed1196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:40 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-1d5b218e-201c-43ba-b038-4f95abdcc15d tempest-VolumesActionsTest-459479611 None] Volume 38b290a9-9a02-44d6-b2e6-f587d7c3ff3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38b290a9-9a02-44d6-b2e6-f587d7c3ff3a', 'volume_size': 1}
Nov 05 19:16:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1d5b218e-201c-43ba-b038-4f95abdcc15d tempest-VolumesActionsTest-459479611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:16:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1d5b218e-201c-43ba-b038-4f95abdcc15d tempest-VolumesActionsTest-459479611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:16:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1d5b218e-201c-43ba-b038-4f95abdcc15d tempest-VolumesActionsTest-459479611 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-954943829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38b290a9-9a02-44d6-b2e6-f587d7c3ff3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b461c484fe094feab37e9dc9faccdd30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:16:40Z,use_quota=True,user_id='569faebdd7f1457bbca32f55700e0795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:16:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-1d5b218e-201c-43ba-b038-4f95abdcc15d tempest-VolumesActionsTest-459479611 None] Creating volume 38b290a9-9a02-44d6-b2e6-f587d7c3ff3a {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:16:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1d5b218e-201c-43ba-b038-4f95abdcc15d tempest-VolumesActionsTest-459479611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:16:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1d5b218e-201c-43ba-b038-4f95abdcc15d tempest-VolumesActionsTest-459479611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:16:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1d5b218e-201c-43ba-b038-4f95abdcc15d tempest-VolumesActionsTest-459479611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:16:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1d5b218e-201c-43ba-b038-4f95abdcc15d tempest-VolumesActionsTest-459479611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:16:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1d5b218e-201c-43ba-b038-4f95abdcc15d tempest-VolumesActionsTest-459479611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:16:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1d5b218e-201c-43ba-b038-4f95abdcc15d tempest-VolumesActionsTest-459479611 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:16:40 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-1d5b218e-201c-43ba-b038-4f95abdcc15d tempest-VolumesActionsTest-459479611 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:16:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1d5b218e-201c-43ba-b038-4f95abdcc15d tempest-VolumesActionsTest-459479611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-38b290a9-9a02-44d6-b2e6-f587d7c3ff3a 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:40 devstack sudo[98059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-38b290a9-9a02-44d6-b2e6-f587d7c3ff3a 1073741824
Nov 05 19:16:40 devstack sudo[98058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4279057-c834-4e30-b8a3-c21c8d45589b
Nov 05 19:16:40 devstack sudo[98059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:40 devstack sudo[98058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:40 devstack sudo[98058]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-899ff8c8-9968-4818-88f2-287ac35f4945 tempest-VolumesServicesTestJSON-1598646309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4279057-c834-4e30-b8a3-c21c8d45589b" returned: 0 in 0.421s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-899ff8c8-9968-4818-88f2-287ac35f4945 tempest-VolumesServicesTestJSON-1598646309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4279057-c834-4e30-b8a3-c21c8d45589b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:40 devstack sudo[98069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4279057-c834-4e30-b8a3-c21c8d45589b
Nov 05 19:16:40 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:40 devstack sudo[98059]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1d5b218e-201c-43ba-b038-4f95abdcc15d tempest-VolumesActionsTest-459479611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-38b290a9-9a02-44d6-b2e6-f587d7c3ff3a 1073741824" returned: 0 in 0.534s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1d5b218e-201c-43ba-b038-4f95abdcc15d tempest-VolumesActionsTest-459479611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-38b290a9-9a02-44d6-b2e6-f587d7c3ff3a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:40 devstack sudo[98072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-38b290a9-9a02-44d6-b2e6-f587d7c3ff3a
Nov 05 19:16:40 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:40 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-899ff8c8-9968-4818-88f2-287ac35f4945 tempest-VolumesServicesTestJSON-1598646309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4279057-c834-4e30-b8a3-c21c8d45589b" returned: 0 in 0.319s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-899ff8c8-9968-4818-88f2-287ac35f4945 tempest-VolumesServicesTestJSON-1598646309 None] Lock "cinder-quobyte-a4279057-c834-4e30-b8a3-c21c8d45589b" released by "delete_volume" :: held 0.861s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:16:40 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-899ff8c8-9968-4818-88f2-287ac35f4945 tempest-VolumesServicesTestJSON-1598646309 None] Created reservations ['2c74854e-378b-4358-a274-9e2c5ba963a5', 'f91f3bab-0973-43b1-ba5d-ddbf4100d403', '7000ad3e-3436-48d6-a27d-ab08024db733', 'f4409209-980b-426d-852a-1a42441147b3'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:16:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-899ff8c8-9968-4818-88f2-287ac35f4945 tempest-VolumesServicesTestJSON-1598646309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:16:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-899ff8c8-9968-4818-88f2-287ac35f4945 tempest-VolumesServicesTestJSON-1598646309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:16:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-899ff8c8-9968-4818-88f2-287ac35f4945 tempest-VolumesServicesTestJSON-1598646309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:16:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-899ff8c8-9968-4818-88f2-287ac35f4945 tempest-VolumesServicesTestJSON-1598646309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:16:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-899ff8c8-9968-4818-88f2-287ac35f4945 tempest-VolumesServicesTestJSON-1598646309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:16:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-899ff8c8-9968-4818-88f2-287ac35f4945 tempest-VolumesServicesTestJSON-1598646309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:40 devstack sudo[98076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:16:40 devstack sudo[98076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:40 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1d5b218e-201c-43ba-b038-4f95abdcc15d tempest-VolumesActionsTest-459479611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-38b290a9-9a02-44d6-b2e6-f587d7c3ff3a" returned: 0 in 0.305s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1d5b218e-201c-43ba-b038-4f95abdcc15d tempest-VolumesActionsTest-459479611 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:16:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1d5b218e-201c-43ba-b038-4f95abdcc15d tempest-VolumesActionsTest-459479611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:16:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1d5b218e-201c-43ba-b038-4f95abdcc15d tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba787468-e3d0-42b4-b20f-b8494fed1196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38b290a9-9a02-44d6-b2e6-f587d7c3ff3a', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1d5b218e-201c-43ba-b038-4f95abdcc15d tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ece48894-8262-45ef-afbe-d416cd5e8a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:41 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-1d5b218e-201c-43ba-b038-4f95abdcc15d tempest-VolumesActionsTest-459479611 None] Volume volume-38b290a9-9a02-44d6-b2e6-f587d7c3ff3a (38b290a9-9a02-44d6-b2e6-f587d7c3ff3a): created successfully
Nov 05 19:16:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1d5b218e-201c-43ba-b038-4f95abdcc15d tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ece48894-8262-45ef-afbe-d416cd5e8a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1d5b218e-201c-43ba-b038-4f95abdcc15d tempest-VolumesActionsTest-459479611 None] Flow 'volume_create_manager' (c2947d8d-3212-441a-9409-391a8e406855) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:16:41 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-1d5b218e-201c-43ba-b038-4f95abdcc15d tempest-VolumesActionsTest-459479611 None] Created volume successfully.
Nov 05 19:16:41 devstack sudo[98076]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-899ff8c8-9968-4818-88f2-287ac35f4945 tempest-VolumesServicesTestJSON-1598646309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.282s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:41 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-899ff8c8-9968-4818-88f2-287ac35f4945 tempest-VolumesServicesTestJSON-1598646309 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:16:41 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-899ff8c8-9968-4818-88f2-287ac35f4945 tempest-VolumesServicesTestJSON-1598646309 None] Deleted volume successfully.
Nov 05 19:16:41 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-899ff8c8-9968-4818-88f2-287ac35f4945 tempest-VolumesServicesTestJSON-1598646309 None] Lock "cinder-a4279057-c834-4e30-b8a3-c21c8d45589b-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:16:42 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-37bc49e3-e1df-4401-af86-d44566f46a6f tempest-VolumesActionsTest-518532599 None] Acquiring lock "cinder-38b290a9-9a02-44d6-b2e6-f587d7c3ff3a-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:16:42 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-37bc49e3-e1df-4401-af86-d44566f46a6f tempest-VolumesActionsTest-518532599 None] Lock "cinder-38b290a9-9a02-44d6-b2e6-f587d7c3ff3a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:16:42 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-37bc49e3-e1df-4401-af86-d44566f46a6f tempest-VolumesActionsTest-518532599 None] Acquiring lock "cinder-quobyte-38b290a9-9a02-44d6-b2e6-f587d7c3ff3a" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:16:42 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-37bc49e3-e1df-4401-af86-d44566f46a6f tempest-VolumesActionsTest-518532599 None] Lock "cinder-quobyte-38b290a9-9a02-44d6-b2e6-f587d7c3ff3a" acquired by "delete_volume" :: waited 0.016s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:16:42 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce02dd8-9544-40c1-b9f2-104ee5bb192c]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:16:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-37bc49e3-e1df-4401-af86-d44566f46a6f tempest-VolumesActionsTest-518532599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-38b290a9-9a02-44d6-b2e6-f587d7c3ff3a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:42 devstack sudo[98079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-38b290a9-9a02-44d6-b2e6-f587d7c3ff3a
Nov 05 19:16:42 devstack sudo[98079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:42 devstack sudo[98079]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-37bc49e3-e1df-4401-af86-d44566f46a6f tempest-VolumesActionsTest-518532599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-38b290a9-9a02-44d6-b2e6-f587d7c3ff3a" returned: 0 in 0.522s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-37bc49e3-e1df-4401-af86-d44566f46a6f tempest-VolumesActionsTest-518532599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-38b290a9-9a02-44d6-b2e6-f587d7c3ff3a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:42 devstack sudo[98084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-38b290a9-9a02-44d6-b2e6-f587d7c3ff3a
Nov 05 19:16:42 devstack sudo[98084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:43 devstack sudo[98084]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-37bc49e3-e1df-4401-af86-d44566f46a6f tempest-VolumesActionsTest-518532599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-38b290a9-9a02-44d6-b2e6-f587d7c3ff3a" returned: 0 in 0.378s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-37bc49e3-e1df-4401-af86-d44566f46a6f tempest-VolumesActionsTest-518532599 None] Lock "cinder-quobyte-38b290a9-9a02-44d6-b2e6-f587d7c3ff3a" released by "delete_volume" :: held 0.961s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:16:43 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-37bc49e3-e1df-4401-af86-d44566f46a6f tempest-VolumesActionsTest-518532599 None] Created reservations ['b7360e6d-b12c-41d0-a59a-a42fe99fc781', 'cbd2536a-db83-4531-96da-54d422eb8e3d', 'ce273fd0-6394-4731-bb1b-1cb47aea6009', '58e39108-9d09-47db-9324-f5c896b4482b'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:16:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-37bc49e3-e1df-4401-af86-d44566f46a6f tempest-VolumesActionsTest-518532599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:16:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-37bc49e3-e1df-4401-af86-d44566f46a6f tempest-VolumesActionsTest-518532599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:16:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-37bc49e3-e1df-4401-af86-d44566f46a6f tempest-VolumesActionsTest-518532599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:16:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-37bc49e3-e1df-4401-af86-d44566f46a6f tempest-VolumesActionsTest-518532599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:16:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-37bc49e3-e1df-4401-af86-d44566f46a6f tempest-VolumesActionsTest-518532599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:16:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-37bc49e3-e1df-4401-af86-d44566f46a6f tempest-VolumesActionsTest-518532599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:43 devstack sudo[98087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:16:43 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:43 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-37bc49e3-e1df-4401-af86-d44566f46a6f tempest-VolumesActionsTest-518532599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.345s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:43 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-37bc49e3-e1df-4401-af86-d44566f46a6f tempest-VolumesActionsTest-518532599 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:16:43 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-37bc49e3-e1df-4401-af86-d44566f46a6f tempest-VolumesActionsTest-518532599 None] Deleted volume successfully.
Nov 05 19:16:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-37bc49e3-e1df-4401-af86-d44566f46a6f tempest-VolumesActionsTest-518532599 None] Lock "cinder-38b290a9-9a02-44d6-b2e6-f587d7c3ff3a-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:16:45 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-020468a0-94f0-4fdc-825c-2fd4a2678951 tempest-VolumesActionsTest-459479611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:16:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-020468a0-94f0-4fdc-825c-2fd4a2678951 tempest-VolumesActionsTest-459479611 None] Flow 'volume_create_manager' (96c3f23e-950f-4a23-9a4b-076ff3995271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:16:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-020468a0-94f0-4fdc-825c-2fd4a2678951 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (489eb887-6352-4181-a8c3-bd113b284ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-020468a0-94f0-4fdc-825c-2fd4a2678951 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (489eb887-6352-4181-a8c3-bd113b284ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-177638533',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00ac3435-952c-48c6-a2d0-49f63d2b1f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b461c484fe094feab37e9dc9faccdd30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:16:45Z,use_quota=True,user_id='569faebdd7f1457bbca32f55700e0795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-020468a0-94f0-4fdc-825c-2fd4a2678951 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ca0eff2-f2c1-49af-957f-51af004d7ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-020468a0-94f0-4fdc-825c-2fd4a2678951 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ca0eff2-f2c1-49af-957f-51af004d7ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-020468a0-94f0-4fdc-825c-2fd4a2678951 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b60614ca-34ee-44d5-b777-d46363771844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-020468a0-94f0-4fdc-825c-2fd4a2678951 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b60614ca-34ee-44d5-b777-d46363771844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00ac3435-952c-48c6-a2d0-49f63d2b1f54', 'volume_name': 'volume-00ac3435-952c-48c6-a2d0-49f63d2b1f54', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-020468a0-94f0-4fdc-825c-2fd4a2678951 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8014d22e-7193-455b-8d1a-709c3becd7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-020468a0-94f0-4fdc-825c-2fd4a2678951 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8014d22e-7193-455b-8d1a-709c3becd7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-020468a0-94f0-4fdc-825c-2fd4a2678951 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42409df9-476f-48a0-9b3a-a4e392786d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:45 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-020468a0-94f0-4fdc-825c-2fd4a2678951 tempest-VolumesActionsTest-459479611 None] Volume 00ac3435-952c-48c6-a2d0-49f63d2b1f54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00ac3435-952c-48c6-a2d0-49f63d2b1f54', 'volume_size': 1}
Nov 05 19:16:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-020468a0-94f0-4fdc-825c-2fd4a2678951 tempest-VolumesActionsTest-459479611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:16:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-020468a0-94f0-4fdc-825c-2fd4a2678951 tempest-VolumesActionsTest-459479611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:16:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-020468a0-94f0-4fdc-825c-2fd4a2678951 tempest-VolumesActionsTest-459479611 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-177638533',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00ac3435-952c-48c6-a2d0-49f63d2b1f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b461c484fe094feab37e9dc9faccdd30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:16:45Z,use_quota=True,user_id='569faebdd7f1457bbca32f55700e0795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:16:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-020468a0-94f0-4fdc-825c-2fd4a2678951 tempest-VolumesActionsTest-459479611 None] Creating volume 00ac3435-952c-48c6-a2d0-49f63d2b1f54 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:16:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-020468a0-94f0-4fdc-825c-2fd4a2678951 tempest-VolumesActionsTest-459479611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:16:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-020468a0-94f0-4fdc-825c-2fd4a2678951 tempest-VolumesActionsTest-459479611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:16:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-020468a0-94f0-4fdc-825c-2fd4a2678951 tempest-VolumesActionsTest-459479611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:16:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-020468a0-94f0-4fdc-825c-2fd4a2678951 tempest-VolumesActionsTest-459479611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:16:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-020468a0-94f0-4fdc-825c-2fd4a2678951 tempest-VolumesActionsTest-459479611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:16:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-020468a0-94f0-4fdc-825c-2fd4a2678951 tempest-VolumesActionsTest-459479611 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:16:45 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-020468a0-94f0-4fdc-825c-2fd4a2678951 tempest-VolumesActionsTest-459479611 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:16:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-020468a0-94f0-4fdc-825c-2fd4a2678951 tempest-VolumesActionsTest-459479611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-00ac3435-952c-48c6-a2d0-49f63d2b1f54 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:45 devstack sudo[98090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-00ac3435-952c-48c6-a2d0-49f63d2b1f54 1073741824
Nov 05 19:16:45 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:45 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-020468a0-94f0-4fdc-825c-2fd4a2678951 tempest-VolumesActionsTest-459479611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-00ac3435-952c-48c6-a2d0-49f63d2b1f54 1073741824" returned: 0 in 0.529s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:45 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=77,cinder:UPDATE=100,cinder:DELETE=11,cinder:INSERT=23 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:16:45 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=100,cinder:UPDATE=106,cinder:INSERT=20,cinder:DELETE=6 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:16:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-020468a0-94f0-4fdc-825c-2fd4a2678951 tempest-VolumesActionsTest-459479611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-00ac3435-952c-48c6-a2d0-49f63d2b1f54 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:45 devstack sudo[98096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-00ac3435-952c-48c6-a2d0-49f63d2b1f54
Nov 05 19:16:45 devstack sudo[98096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:46 devstack sudo[98096]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-020468a0-94f0-4fdc-825c-2fd4a2678951 tempest-VolumesActionsTest-459479611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-00ac3435-952c-48c6-a2d0-49f63d2b1f54" returned: 0 in 0.298s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:46 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-020468a0-94f0-4fdc-825c-2fd4a2678951 tempest-VolumesActionsTest-459479611 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:16:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-020468a0-94f0-4fdc-825c-2fd4a2678951 tempest-VolumesActionsTest-459479611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:16:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-020468a0-94f0-4fdc-825c-2fd4a2678951 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42409df9-476f-48a0-9b3a-a4e392786d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00ac3435-952c-48c6-a2d0-49f63d2b1f54', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-020468a0-94f0-4fdc-825c-2fd4a2678951 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2473c1fc-c771-4af1-a34a-994c1169913c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:46 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-020468a0-94f0-4fdc-825c-2fd4a2678951 tempest-VolumesActionsTest-459479611 None] Volume volume-00ac3435-952c-48c6-a2d0-49f63d2b1f54 (00ac3435-952c-48c6-a2d0-49f63d2b1f54): created successfully
Nov 05 19:16:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-020468a0-94f0-4fdc-825c-2fd4a2678951 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2473c1fc-c771-4af1-a34a-994c1169913c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-020468a0-94f0-4fdc-825c-2fd4a2678951 tempest-VolumesActionsTest-459479611 None] Flow 'volume_create_manager' (96c3f23e-950f-4a23-9a4b-076ff3995271) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:16:46 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-020468a0-94f0-4fdc-825c-2fd4a2678951 tempest-VolumesActionsTest-459479611 None] Created volume successfully.
Nov 05 19:16:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-85cb7ed4-343e-440a-a54b-387f99f48044 tempest-VolumesActionsTest-518532599 None] Acquiring lock "cinder-00ac3435-952c-48c6-a2d0-49f63d2b1f54-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:16:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-85cb7ed4-343e-440a-a54b-387f99f48044 tempest-VolumesActionsTest-518532599 None] Lock "cinder-00ac3435-952c-48c6-a2d0-49f63d2b1f54-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:16:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-85cb7ed4-343e-440a-a54b-387f99f48044 tempest-VolumesActionsTest-518532599 None] Acquiring lock "cinder-quobyte-00ac3435-952c-48c6-a2d0-49f63d2b1f54" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:16:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-85cb7ed4-343e-440a-a54b-387f99f48044 tempest-VolumesActionsTest-518532599 None] Lock "cinder-quobyte-00ac3435-952c-48c6-a2d0-49f63d2b1f54" acquired by "delete_volume" :: waited 0.027s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:16:47 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[53860ee7-cd8f-492c-a2c9-c333c890dbb2]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:16:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-85cb7ed4-343e-440a-a54b-387f99f48044 tempest-VolumesActionsTest-518532599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-00ac3435-952c-48c6-a2d0-49f63d2b1f54 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:47 devstack sudo[98136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-00ac3435-952c-48c6-a2d0-49f63d2b1f54
Nov 05 19:16:47 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:47 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:16:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Flow 'volume_create_manager' (34846241-4605-4b09-9d1f-23f5b56f2b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:16:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a23848f-aa63-44c8-aa0f-503a8dd0ec08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a23848f-aa63-44c8-aa0f-503a8dd0ec08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1408272861',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5de1124-d17c-4804-806e-4780d8579584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e0232bebda4519a4d9b2ca8a8bc03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:16:48Z,use_quota=True,user_id='fc74b56aa3b547a6beef2d5bc6117d91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cad4b67a-c4c0-4b22-a9d1-818800d08d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cad4b67a-c4c0-4b22-a9d1-818800d08d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b5d2367-6397-4bfb-8569-f6a51b579e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:47 devstack cinder-volume[87184]: DEBUG cinder.image.glance [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Creating Keystone auth plugin from conf {{(pid=87184) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 19:16:48 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-85cb7ed4-343e-440a-a54b-387f99f48044 tempest-VolumesActionsTest-518532599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-00ac3435-952c-48c6-a2d0-49f63d2b1f54" returned: 0 in 0.397s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-85cb7ed4-343e-440a-a54b-387f99f48044 tempest-VolumesActionsTest-518532599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-00ac3435-952c-48c6-a2d0-49f63d2b1f54 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:48 devstack sudo[98141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-00ac3435-952c-48c6-a2d0-49f63d2b1f54
Nov 05 19:16:48 devstack sudo[98141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b5d2367-6397-4bfb-8569-f6a51b579e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd5de1124-d17c-4804-806e-4780d8579584', 'volume_name': 'volume-d5de1124-d17c-4804-806e-4780d8579584', 'volume_size': 1, 'image_id': '300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3e813114ebb84b35a5c6eb1b802f157f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'created_at': datetime.datetime(2026, 11, 5, 18, 1, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 18, 1, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x736631fd6660>}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf791206-f829-40fb-9bdf-5a60b8cb3d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf791206-f829-40fb-9bdf-5a60b8cb3d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (015b6c95-845e-4836-8fa5-0fc6c2204179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:48 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Volume d5de1124-d17c-4804-806e-4780d8579584: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d5de1124-d17c-4804-806e-4780d8579584', 'volume_size': 1, 'image_id': '300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3e813114ebb84b35a5c6eb1b802f157f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'created_at': datetime.datetime(2026, 11, 5, 18, 1, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 18, 1, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x736631fd6660>}
Nov 05 19:16:48 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Trying to clone d5de1124-d17c-4804-806e-4780d8579584 from image 300700a0-51ab-4ee2-8ef0-e0eeaa8aee29 at location (None, [{'url': 'file:///opt/stack/data/glance/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'metadata': {}}]). {{(pid=87184) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 19:16:48 devstack sudo[98141]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-85cb7ed4-343e-440a-a54b-387f99f48044 tempest-VolumesActionsTest-518532599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-00ac3435-952c-48c6-a2d0-49f63d2b1f54" returned: 0 in 0.294s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-85cb7ed4-343e-440a-a54b-387f99f48044 tempest-VolumesActionsTest-518532599 None] Lock "cinder-quobyte-00ac3435-952c-48c6-a2d0-49f63d2b1f54" released by "delete_volume" :: held 0.746s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:16:48 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-85cb7ed4-343e-440a-a54b-387f99f48044 tempest-VolumesActionsTest-518532599 None] Created reservations ['3eb97503-de78-4352-a7d0-a3cf8d39ff2e', 'c1a618ae-0dd9-4c54-acfe-ec9a9e441162', 'eb8ea66b-6e23-4dde-9006-38ac3d6f0920', 'e338acf9-40b8-4309-ad06-5a9003a3a07e'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:16:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-85cb7ed4-343e-440a-a54b-387f99f48044 tempest-VolumesActionsTest-518532599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:16:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-85cb7ed4-343e-440a-a54b-387f99f48044 tempest-VolumesActionsTest-518532599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:16:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-85cb7ed4-343e-440a-a54b-387f99f48044 tempest-VolumesActionsTest-518532599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:16:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-85cb7ed4-343e-440a-a54b-387f99f48044 tempest-VolumesActionsTest-518532599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:16:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-85cb7ed4-343e-440a-a54b-387f99f48044 tempest-VolumesActionsTest-518532599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:16:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-85cb7ed4-343e-440a-a54b-387f99f48044 tempest-VolumesActionsTest-518532599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:48 devstack sudo[98144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:16:48 devstack sudo[98144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:48 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_06_uhya3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 19:16:48 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 19:16:48 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a866777-38b7-4c82-b995-1533f3e44ab1]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:16:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_06_uhya3devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:49 devstack sudo[98144]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:49 devstack sudo[98147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_06_uhya3devstack@QuobyteHD
Nov 05 19:16:49 devstack sudo[98147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-85cb7ed4-343e-440a-a54b-387f99f48044 tempest-VolumesActionsTest-518532599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.497s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:49 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-85cb7ed4-343e-440a-a54b-387f99f48044 tempest-VolumesActionsTest-518532599 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:16:49 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-85cb7ed4-343e-440a-a54b-387f99f48044 tempest-VolumesActionsTest-518532599 None] Deleted volume successfully.
Nov 05 19:16:49 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-85cb7ed4-343e-440a-a54b-387f99f48044 tempest-VolumesActionsTest-518532599 None] Lock "cinder-00ac3435-952c-48c6-a2d0-49f63d2b1f54-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:16:49 devstack sudo[98147]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_06_uhya3devstack@QuobyteHD" returned: 0 in 0.534s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:49 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Temporary image 300700a0-51ab-4ee2-8ef0-e0eeaa8aee29 is fetched for user fc74b56aa3b547a6beef2d5bc6117d91. {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 19:16:49 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f279d1e4-e583-4b0f-a648-78fe7f20b97e]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:16:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_06_uhya3devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:49 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1032fd5-2c54-4d62-99a0-2524581eedf6 tempest-VolumesActionsTest-459479611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:16:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f1032fd5-2c54-4d62-99a0-2524581eedf6 tempest-VolumesActionsTest-459479611 None] Flow 'volume_create_manager' (625709d5-eaf2-47a1-9a2c-e04feab5dfd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:16:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f1032fd5-2c54-4d62-99a0-2524581eedf6 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (263fe85e-1aeb-4dc1-907d-7024c7ebd243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f1032fd5-2c54-4d62-99a0-2524581eedf6 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (263fe85e-1aeb-4dc1-907d-7024c7ebd243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1038965755',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e399413a-aeef-46da-97ff-aab931145b6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b461c484fe094feab37e9dc9faccdd30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:16:50Z,use_quota=True,user_id='569faebdd7f1457bbca32f55700e0795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f1032fd5-2c54-4d62-99a0-2524581eedf6 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e558242-cc4e-4d0e-a7e8-c97fdcac10a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f1032fd5-2c54-4d62-99a0-2524581eedf6 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e558242-cc4e-4d0e-a7e8-c97fdcac10a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f1032fd5-2c54-4d62-99a0-2524581eedf6 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4243d95a-0246-4746-a3be-9b1dc6ab2a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f1032fd5-2c54-4d62-99a0-2524581eedf6 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4243d95a-0246-4746-a3be-9b1dc6ab2a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e399413a-aeef-46da-97ff-aab931145b6d', 'volume_name': 'volume-e399413a-aeef-46da-97ff-aab931145b6d', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f1032fd5-2c54-4d62-99a0-2524581eedf6 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d58936f-5cfa-4e2f-8598-a977def3eb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f1032fd5-2c54-4d62-99a0-2524581eedf6 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d58936f-5cfa-4e2f-8598-a977def3eb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f1032fd5-2c54-4d62-99a0-2524581eedf6 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91152b08-640f-497d-9146-02641f31f65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:49 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-f1032fd5-2c54-4d62-99a0-2524581eedf6 tempest-VolumesActionsTest-459479611 None] Volume e399413a-aeef-46da-97ff-aab931145b6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e399413a-aeef-46da-97ff-aab931145b6d', 'volume_size': 1}
Nov 05 19:16:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f1032fd5-2c54-4d62-99a0-2524581eedf6 tempest-VolumesActionsTest-459479611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:16:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f1032fd5-2c54-4d62-99a0-2524581eedf6 tempest-VolumesActionsTest-459479611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:16:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f1032fd5-2c54-4d62-99a0-2524581eedf6 tempest-VolumesActionsTest-459479611 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1038965755',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e399413a-aeef-46da-97ff-aab931145b6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b461c484fe094feab37e9dc9faccdd30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:16:50Z,use_quota=True,user_id='569faebdd7f1457bbca32f55700e0795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:16:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-f1032fd5-2c54-4d62-99a0-2524581eedf6 tempest-VolumesActionsTest-459479611 None] Creating volume e399413a-aeef-46da-97ff-aab931145b6d {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:16:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f1032fd5-2c54-4d62-99a0-2524581eedf6 tempest-VolumesActionsTest-459479611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:16:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f1032fd5-2c54-4d62-99a0-2524581eedf6 tempest-VolumesActionsTest-459479611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:16:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f1032fd5-2c54-4d62-99a0-2524581eedf6 tempest-VolumesActionsTest-459479611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:16:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f1032fd5-2c54-4d62-99a0-2524581eedf6 tempest-VolumesActionsTest-459479611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:16:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f1032fd5-2c54-4d62-99a0-2524581eedf6 tempest-VolumesActionsTest-459479611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:16:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f1032fd5-2c54-4d62-99a0-2524581eedf6 tempest-VolumesActionsTest-459479611 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:16:49 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-f1032fd5-2c54-4d62-99a0-2524581eedf6 tempest-VolumesActionsTest-459479611 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:16:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f1032fd5-2c54-4d62-99a0-2524581eedf6 tempest-VolumesActionsTest-459479611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e399413a-aeef-46da-97ff-aab931145b6d 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:49 devstack sudo[98153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_06_uhya3devstack@QuobyteHD
Nov 05 19:16:49 devstack sudo[98153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:49 devstack sudo[98155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e399413a-aeef-46da-97ff-aab931145b6d 1073741824
Nov 05 19:16:49 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:49 devstack sudo[98153]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_06_uhya3devstack@QuobyteHD" returned: 0 in 0.386s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:16:50 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f1032fd5-2c54-4d62-99a0-2524581eedf6 tempest-VolumesActionsTest-459479611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e399413a-aeef-46da-97ff-aab931145b6d 1073741824" returned: 0 in 0.499s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f1032fd5-2c54-4d62-99a0-2524581eedf6 tempest-VolumesActionsTest-459479611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e399413a-aeef-46da-97ff-aab931145b6d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:50 devstack sudo[98164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e399413a-aeef-46da-97ff-aab931145b6d
Nov 05 19:16:50 devstack sudo[98164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:50 devstack sudo[98164]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f1032fd5-2c54-4d62-99a0-2524581eedf6 tempest-VolumesActionsTest-459479611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e399413a-aeef-46da-97ff-aab931145b6d" returned: 0 in 0.259s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f1032fd5-2c54-4d62-99a0-2524581eedf6 tempest-VolumesActionsTest-459479611 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:16:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f1032fd5-2c54-4d62-99a0-2524581eedf6 tempest-VolumesActionsTest-459479611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:16:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.534s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:16:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1408272861',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5de1124-d17c-4804-806e-4780d8579584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e0232bebda4519a4d9b2ca8a8bc03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:16:48Z,use_quota=True,user_id='fc74b56aa3b547a6beef2d5bc6117d91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:16:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Creating volume d5de1124-d17c-4804-806e-4780d8579584 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:16:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:16:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:16:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:16:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:16:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:16:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:16:50 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:16:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d5de1124-d17c-4804-806e-4780d8579584 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:50 devstack sudo[98167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d5de1124-d17c-4804-806e-4780d8579584 1073741824
Nov 05 19:16:50 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f1032fd5-2c54-4d62-99a0-2524581eedf6 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91152b08-640f-497d-9146-02641f31f65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e399413a-aeef-46da-97ff-aab931145b6d', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f1032fd5-2c54-4d62-99a0-2524581eedf6 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4f168b7-48c2-4553-b423-6e93bc375dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:50 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-f1032fd5-2c54-4d62-99a0-2524581eedf6 tempest-VolumesActionsTest-459479611 None] Volume volume-e399413a-aeef-46da-97ff-aab931145b6d (e399413a-aeef-46da-97ff-aab931145b6d): created successfully
Nov 05 19:16:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f1032fd5-2c54-4d62-99a0-2524581eedf6 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4f168b7-48c2-4553-b423-6e93bc375dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f1032fd5-2c54-4d62-99a0-2524581eedf6 tempest-VolumesActionsTest-459479611 None] Flow 'volume_create_manager' (625709d5-eaf2-47a1-9a2c-e04feab5dfd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:16:50 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f1032fd5-2c54-4d62-99a0-2524581eedf6 tempest-VolumesActionsTest-459479611 None] Created volume successfully.
Nov 05 19:16:50 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d5de1124-d17c-4804-806e-4780d8579584 1073741824" returned: 0 in 0.501s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d5de1124-d17c-4804-806e-4780d8579584 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:51 devstack sudo[98173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d5de1124-d17c-4804-806e-4780d8579584
Nov 05 19:16:51 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:51 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d5de1124-d17c-4804-806e-4780d8579584" returned: 0 in 0.252s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:51 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:16:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:16:51 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Attempting download of 300700a0-51ab-4ee2-8ef0-e0eeaa8aee29 ((None, [{'url': 'file:///opt/stack/data/glance/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'metadata': {}}])) to volume d5de1124-d17c-4804-806e-4780d8579584. {{(pid=87184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 19:16:51 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02dbfa1-94fe-4a57-9150-d98da4142663]: (4, 'raw') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:16:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_xmcux39s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:51 devstack sudo[98176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_xmcux39s
Nov 05 19:16:51 devstack sudo[98176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:51 devstack sudo[98176]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_xmcux39s" returned: 0 in 0.367s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_xmcux39s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bd8ca5ac-d6ec-4c38-b6ae-f8f7d4d2268e tempest-VolumesActionsTest-518532599 None] Acquiring lock "cinder-e399413a-aeef-46da-97ff-aab931145b6d-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:16:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bd8ca5ac-d6ec-4c38-b6ae-f8f7d4d2268e tempest-VolumesActionsTest-518532599 None] Lock "cinder-e399413a-aeef-46da-97ff-aab931145b6d-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:16:51 devstack sudo[98180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_xmcux39s
Nov 05 19:16:51 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bd8ca5ac-d6ec-4c38-b6ae-f8f7d4d2268e tempest-VolumesActionsTest-518532599 None] Acquiring lock "cinder-quobyte-e399413a-aeef-46da-97ff-aab931145b6d" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:16:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bd8ca5ac-d6ec-4c38-b6ae-f8f7d4d2268e tempest-VolumesActionsTest-518532599 None] Lock "cinder-quobyte-e399413a-aeef-46da-97ff-aab931145b6d" acquired by "delete_volume" :: waited 0.017s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:16:52 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72736b4-a0a0-4601-a090-e62c77be0c0e]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:16:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bd8ca5ac-d6ec-4c38-b6ae-f8f7d4d2268e tempest-VolumesActionsTest-518532599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e399413a-aeef-46da-97ff-aab931145b6d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:52 devstack sudo[98182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e399413a-aeef-46da-97ff-aab931145b6d
Nov 05 19:16:52 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:52 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_xmcux39s" returned: 1 in 0.465s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_xmcux39s' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 19:16:52 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3daefe1-ee88-41a1-abb2-25a9be85c679]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:16:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_06_uhya3devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:52 devstack sudo[98186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_06_uhya3devstack@QuobyteHD
Nov 05 19:16:52 devstack sudo[98186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:52 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bd8ca5ac-d6ec-4c38-b6ae-f8f7d4d2268e tempest-VolumesActionsTest-518532599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e399413a-aeef-46da-97ff-aab931145b6d" returned: 0 in 0.434s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bd8ca5ac-d6ec-4c38-b6ae-f8f7d4d2268e tempest-VolumesActionsTest-518532599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e399413a-aeef-46da-97ff-aab931145b6d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:52 devstack sudo[98191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e399413a-aeef-46da-97ff-aab931145b6d
Nov 05 19:16:52 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:52 devstack sudo[98186]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_06_uhya3devstack@QuobyteHD" returned: 0 in 0.371s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:52 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] 300700a0-51ab-4ee2-8ef0-e0eeaa8aee29 was qcow2, converting to qcow2 {{(pid=87184) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 19:16:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_06_uhya3devstack@QuobyteHD /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d5de1124-d17c-4804-806e-4780d8579584 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:52 devstack sudo[98196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_06_uhya3devstack@QuobyteHD /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d5de1124-d17c-4804-806e-4780d8579584
Nov 05 19:16:52 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:52 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bd8ca5ac-d6ec-4c38-b6ae-f8f7d4d2268e tempest-VolumesActionsTest-518532599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e399413a-aeef-46da-97ff-aab931145b6d" returned: 0 in 0.285s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bd8ca5ac-d6ec-4c38-b6ae-f8f7d4d2268e tempest-VolumesActionsTest-518532599 None] Lock "cinder-quobyte-e399413a-aeef-46da-97ff-aab931145b6d" released by "delete_volume" :: held 0.786s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:16:52 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-bd8ca5ac-d6ec-4c38-b6ae-f8f7d4d2268e tempest-VolumesActionsTest-518532599 None] Created reservations ['8e9b6cf3-d9ea-4391-9586-deb187430c5a', '64ae9bfa-708b-4ba6-8ac3-e23f9b05fb94', 'dd1e2b13-234b-4672-9e80-7776cbcf357c', '86a786ef-bdf9-4ce7-b0c0-656f1c96d540'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:16:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bd8ca5ac-d6ec-4c38-b6ae-f8f7d4d2268e tempest-VolumesActionsTest-518532599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:16:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bd8ca5ac-d6ec-4c38-b6ae-f8f7d4d2268e tempest-VolumesActionsTest-518532599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:16:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bd8ca5ac-d6ec-4c38-b6ae-f8f7d4d2268e tempest-VolumesActionsTest-518532599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:16:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bd8ca5ac-d6ec-4c38-b6ae-f8f7d4d2268e tempest-VolumesActionsTest-518532599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:16:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bd8ca5ac-d6ec-4c38-b6ae-f8f7d4d2268e tempest-VolumesActionsTest-518532599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:16:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bd8ca5ac-d6ec-4c38-b6ae-f8f7d4d2268e tempest-VolumesActionsTest-518532599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:52 devstack sudo[98203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:16:52 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:53 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bd8ca5ac-d6ec-4c38-b6ae-f8f7d4d2268e tempest-VolumesActionsTest-518532599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.285s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:53 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-bd8ca5ac-d6ec-4c38-b6ae-f8f7d4d2268e tempest-VolumesActionsTest-518532599 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:16:53 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-bd8ca5ac-d6ec-4c38-b6ae-f8f7d4d2268e tempest-VolumesActionsTest-518532599 None] Deleted volume successfully.
Nov 05 19:16:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bd8ca5ac-d6ec-4c38-b6ae-f8f7d4d2268e tempest-VolumesActionsTest-518532599 None] Lock "cinder-e399413a-aeef-46da-97ff-aab931145b6d-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:16:53 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-6244158d-2e7f-40e5-a223-4c651062ebd6 tempest-VolumesActionsTest-459479611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:16:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6244158d-2e7f-40e5-a223-4c651062ebd6 tempest-VolumesActionsTest-459479611 None] Flow 'volume_create_manager' (7e9a76cc-0fff-403e-aafb-df9c7f4cf779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:16:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6244158d-2e7f-40e5-a223-4c651062ebd6 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (509e5ebc-0780-44c8-b4e5-56b6021999b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6244158d-2e7f-40e5-a223-4c651062ebd6 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (509e5ebc-0780-44c8-b4e5-56b6021999b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-304428791',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71f02f78-ed9b-4cf0-bedc-ae8f6bcdc1c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b461c484fe094feab37e9dc9faccdd30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:16:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:16:54Z,use_quota=True,user_id='569faebdd7f1457bbca32f55700e0795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6244158d-2e7f-40e5-a223-4c651062ebd6 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72911ed6-ffbc-43e2-b2f3-193445ffd63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6244158d-2e7f-40e5-a223-4c651062ebd6 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72911ed6-ffbc-43e2-b2f3-193445ffd63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6244158d-2e7f-40e5-a223-4c651062ebd6 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a3c35ec-cf13-4895-a31c-f968af9d25a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6244158d-2e7f-40e5-a223-4c651062ebd6 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a3c35ec-cf13-4895-a31c-f968af9d25a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71f02f78-ed9b-4cf0-bedc-ae8f6bcdc1c0', 'volume_name': 'volume-71f02f78-ed9b-4cf0-bedc-ae8f6bcdc1c0', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6244158d-2e7f-40e5-a223-4c651062ebd6 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6b3467e-0ce5-4778-ab88-23becb3bc61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6244158d-2e7f-40e5-a223-4c651062ebd6 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6b3467e-0ce5-4778-ab88-23becb3bc61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6244158d-2e7f-40e5-a223-4c651062ebd6 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c802b34-4c40-4152-862c-353a823c9bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:53 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-6244158d-2e7f-40e5-a223-4c651062ebd6 tempest-VolumesActionsTest-459479611 None] Volume 71f02f78-ed9b-4cf0-bedc-ae8f6bcdc1c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71f02f78-ed9b-4cf0-bedc-ae8f6bcdc1c0', 'volume_size': 1}
Nov 05 19:16:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6244158d-2e7f-40e5-a223-4c651062ebd6 tempest-VolumesActionsTest-459479611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:16:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6244158d-2e7f-40e5-a223-4c651062ebd6 tempest-VolumesActionsTest-459479611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:16:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6244158d-2e7f-40e5-a223-4c651062ebd6 tempest-VolumesActionsTest-459479611 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-304428791',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71f02f78-ed9b-4cf0-bedc-ae8f6bcdc1c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b461c484fe094feab37e9dc9faccdd30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:16:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:16:54Z,use_quota=True,user_id='569faebdd7f1457bbca32f55700e0795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:16:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-6244158d-2e7f-40e5-a223-4c651062ebd6 tempest-VolumesActionsTest-459479611 None] Creating volume 71f02f78-ed9b-4cf0-bedc-ae8f6bcdc1c0 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:16:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6244158d-2e7f-40e5-a223-4c651062ebd6 tempest-VolumesActionsTest-459479611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:16:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6244158d-2e7f-40e5-a223-4c651062ebd6 tempest-VolumesActionsTest-459479611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:16:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6244158d-2e7f-40e5-a223-4c651062ebd6 tempest-VolumesActionsTest-459479611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:16:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6244158d-2e7f-40e5-a223-4c651062ebd6 tempest-VolumesActionsTest-459479611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:16:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6244158d-2e7f-40e5-a223-4c651062ebd6 tempest-VolumesActionsTest-459479611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:16:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6244158d-2e7f-40e5-a223-4c651062ebd6 tempest-VolumesActionsTest-459479611 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:16:53 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-6244158d-2e7f-40e5-a223-4c651062ebd6 tempest-VolumesActionsTest-459479611 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:16:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6244158d-2e7f-40e5-a223-4c651062ebd6 tempest-VolumesActionsTest-459479611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-71f02f78-ed9b-4cf0-bedc-ae8f6bcdc1c0 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:53 devstack sudo[98210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-71f02f78-ed9b-4cf0-bedc-ae8f6bcdc1c0 1073741824
Nov 05 19:16:53 devstack sudo[98210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:54 devstack sudo[98210]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6244158d-2e7f-40e5-a223-4c651062ebd6 tempest-VolumesActionsTest-459479611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-71f02f78-ed9b-4cf0-bedc-ae8f6bcdc1c0 1073741824" returned: 0 in 0.636s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6244158d-2e7f-40e5-a223-4c651062ebd6 tempest-VolumesActionsTest-459479611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-71f02f78-ed9b-4cf0-bedc-ae8f6bcdc1c0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:54 devstack sudo[98216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-71f02f78-ed9b-4cf0-bedc-ae8f6bcdc1c0
Nov 05 19:16:54 devstack sudo[98216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:54 devstack sudo[98216]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6244158d-2e7f-40e5-a223-4c651062ebd6 tempest-VolumesActionsTest-459479611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-71f02f78-ed9b-4cf0-bedc-ae8f6bcdc1c0" returned: 0 in 0.312s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6244158d-2e7f-40e5-a223-4c651062ebd6 tempest-VolumesActionsTest-459479611 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:16:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6244158d-2e7f-40e5-a223-4c651062ebd6 tempest-VolumesActionsTest-459479611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:16:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6244158d-2e7f-40e5-a223-4c651062ebd6 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c802b34-4c40-4152-862c-353a823c9bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71f02f78-ed9b-4cf0-bedc-ae8f6bcdc1c0', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6244158d-2e7f-40e5-a223-4c651062ebd6 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (614db122-7f70-4173-a36b-b12037dad98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:54 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-6244158d-2e7f-40e5-a223-4c651062ebd6 tempest-VolumesActionsTest-459479611 None] Volume volume-71f02f78-ed9b-4cf0-bedc-ae8f6bcdc1c0 (71f02f78-ed9b-4cf0-bedc-ae8f6bcdc1c0): created successfully
Nov 05 19:16:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6244158d-2e7f-40e5-a223-4c651062ebd6 tempest-VolumesActionsTest-459479611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (614db122-7f70-4173-a36b-b12037dad98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6244158d-2e7f-40e5-a223-4c651062ebd6 tempest-VolumesActionsTest-459479611 None] Flow 'volume_create_manager' (7e9a76cc-0fff-403e-aafb-df9c7f4cf779) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:16:54 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-6244158d-2e7f-40e5-a223-4c651062ebd6 tempest-VolumesActionsTest-459479611 None] Created volume successfully.
Nov 05 19:16:55 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_06_uhya3devstack@QuobyteHD /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d5de1124-d17c-4804-806e-4780d8579584" returned: 0 in 2.438s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:55 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_06_uhya3devstack@QuobyteHD, size 112.00 MB, duration 2.44 sec, destination /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d5de1124-d17c-4804-806e-4780d8579584 {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 19:16:55 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Converted 112.00 MB image at 45.90 MB/s
Nov 05 19:16:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d5de1124-d17c-4804-806e-4780d8579584 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:55 devstack sudo[98219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d5de1124-d17c-4804-806e-4780d8579584 1G
Nov 05 19:16:55 devstack sudo[98219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:55 devstack sudo[98219]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d5de1124-d17c-4804-806e-4780d8579584 1G" returned: 0 in 0.409s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:55 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Downloaded image 300700a0-51ab-4ee2-8ef0-e0eeaa8aee29 ((None, [{'url': 'file:///opt/stack/data/glance/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'metadata': {}}])) to volume d5de1124-d17c-4804-806e-4780d8579584 successfully. {{(pid=87184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 19:16:55 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Temporary image 300700a0-51ab-4ee2-8ef0-e0eeaa8aee29 for user fc74b56aa3b547a6beef2d5bc6117d91 is deleted. {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 19:16:55 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Marking volume d5de1124-d17c-4804-806e-4780d8579584 as bootable. {{(pid=87184) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 19:16:55 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Copying metadata from image 300700a0-51ab-4ee2-8ef0-e0eeaa8aee29 to d5de1124-d17c-4804-806e-4780d8579584. {{(pid=87184) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 19:16:55 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Creating volume glance metadata for volume d5de1124-d17c-4804-806e-4780d8579584 backed by image 300700a0-51ab-4ee2-8ef0-e0eeaa8aee29 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87184) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 19:16:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (015b6c95-845e-4836-8fa5-0fc6c2204179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5de1124-d17c-4804-806e-4780d8579584', 'volume_size': 1, 'image_id': '300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3e813114ebb84b35a5c6eb1b802f157f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'created_at': datetime.datetime(2026, 11, 5, 18, 1, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 18, 1, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x736631fd6660>}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1ea76b6-7a32-403f-9610-ca20e5075a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:16:55 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Volume volume-d5de1124-d17c-4804-806e-4780d8579584 (d5de1124-d17c-4804-806e-4780d8579584): created successfully
Nov 05 19:16:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1ea76b6-7a32-403f-9610-ca20e5075a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:16:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Flow 'volume_create_manager' (34846241-4605-4b09-9d1f-23f5b56f2b27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:16:55 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-a656a5ec-583f-496b-9ed3-e18fa3703315 tempest-VolumesImageMetadata-1190936851 None] Created volume successfully.
Nov 05 19:16:56 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5e514db7-57a7-4080-8676-4f3959ca7cd7 tempest-VolumesActionsTest-459479611 None] Acquiring lock "cinder-71f02f78-ed9b-4cf0-bedc-ae8f6bcdc1c0-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:16:56 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5e514db7-57a7-4080-8676-4f3959ca7cd7 tempest-VolumesActionsTest-459479611 None] Lock "cinder-71f02f78-ed9b-4cf0-bedc-ae8f6bcdc1c0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:16:56 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5e514db7-57a7-4080-8676-4f3959ca7cd7 tempest-VolumesActionsTest-459479611 None] Acquiring lock "cinder-quobyte-71f02f78-ed9b-4cf0-bedc-ae8f6bcdc1c0" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:16:56 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5e514db7-57a7-4080-8676-4f3959ca7cd7 tempest-VolumesActionsTest-459479611 None] Lock "cinder-quobyte-71f02f78-ed9b-4cf0-bedc-ae8f6bcdc1c0" acquired by "delete_volume" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:16:56 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a6bcc3-ce3a-4c24-9e9e-79f974449dc1]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:16:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5e514db7-57a7-4080-8676-4f3959ca7cd7 tempest-VolumesActionsTest-459479611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-71f02f78-ed9b-4cf0-bedc-ae8f6bcdc1c0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:56 devstack sudo[98225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-71f02f78-ed9b-4cf0-bedc-ae8f6bcdc1c0
Nov 05 19:16:56 devstack sudo[98225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:56 devstack sudo[98225]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5e514db7-57a7-4080-8676-4f3959ca7cd7 tempest-VolumesActionsTest-459479611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-71f02f78-ed9b-4cf0-bedc-ae8f6bcdc1c0" returned: 0 in 0.411s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5e514db7-57a7-4080-8676-4f3959ca7cd7 tempest-VolumesActionsTest-459479611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-71f02f78-ed9b-4cf0-bedc-ae8f6bcdc1c0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:57 devstack sudo[98231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-71f02f78-ed9b-4cf0-bedc-ae8f6bcdc1c0
Nov 05 19:16:57 devstack sudo[98231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:57 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1dc114eb-eb20-4c59-8bc8-b9e3ae85045a tempest-VolumesImageMetadata-1190936851 None] Acquiring lock "cinder-d5de1124-d17c-4804-806e-4780d8579584-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:16:57 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1dc114eb-eb20-4c59-8bc8-b9e3ae85045a tempest-VolumesImageMetadata-1190936851 None] Lock "cinder-d5de1124-d17c-4804-806e-4780d8579584-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:16:57 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1dc114eb-eb20-4c59-8bc8-b9e3ae85045a tempest-VolumesImageMetadata-1190936851 None] Acquiring lock "cinder-quobyte-d5de1124-d17c-4804-806e-4780d8579584" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:16:57 devstack sudo[98231]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5e514db7-57a7-4080-8676-4f3959ca7cd7 tempest-VolumesActionsTest-459479611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-71f02f78-ed9b-4cf0-bedc-ae8f6bcdc1c0" returned: 0 in 0.293s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:57 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1dc114eb-eb20-4c59-8bc8-b9e3ae85045a tempest-VolumesImageMetadata-1190936851 None] Lock "cinder-quobyte-d5de1124-d17c-4804-806e-4780d8579584" acquired by "delete_volume" :: waited 0.028s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:16:57 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5e514db7-57a7-4080-8676-4f3959ca7cd7 tempest-VolumesActionsTest-459479611 None] Lock "cinder-quobyte-71f02f78-ed9b-4cf0-bedc-ae8f6bcdc1c0" released by "delete_volume" :: held 0.767s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:16:57 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[06760ef7-7e22-40cf-992c-6a594e9163aa]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:16:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1dc114eb-eb20-4c59-8bc8-b9e3ae85045a tempest-VolumesImageMetadata-1190936851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d5de1124-d17c-4804-806e-4780d8579584 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:57 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-5e514db7-57a7-4080-8676-4f3959ca7cd7 tempest-VolumesActionsTest-459479611 None] Created reservations ['f6b2ee93-dd2b-446a-abd7-79fd745be985', '6b5a501e-94a3-44af-b2df-e959efd8a9a6', '9941b27d-21ea-4433-bd52-a971d504d9ab', '3f0a1e6c-61ed-4571-a72e-e139bff1a015'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:16:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5e514db7-57a7-4080-8676-4f3959ca7cd7 tempest-VolumesActionsTest-459479611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:16:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5e514db7-57a7-4080-8676-4f3959ca7cd7 tempest-VolumesActionsTest-459479611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:16:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5e514db7-57a7-4080-8676-4f3959ca7cd7 tempest-VolumesActionsTest-459479611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:16:57 devstack sudo[98235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d5de1124-d17c-4804-806e-4780d8579584
Nov 05 19:16:57 devstack sudo[98235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5e514db7-57a7-4080-8676-4f3959ca7cd7 tempest-VolumesActionsTest-459479611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:16:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5e514db7-57a7-4080-8676-4f3959ca7cd7 tempest-VolumesActionsTest-459479611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:16:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5e514db7-57a7-4080-8676-4f3959ca7cd7 tempest-VolumesActionsTest-459479611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:57 devstack sudo[98237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:16:57 devstack sudo[98237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:57 devstack sudo[98237]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5e514db7-57a7-4080-8676-4f3959ca7cd7 tempest-VolumesActionsTest-459479611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.339s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:57 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-5e514db7-57a7-4080-8676-4f3959ca7cd7 tempest-VolumesActionsTest-459479611 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:16:57 devstack sudo[98235]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:57 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-5e514db7-57a7-4080-8676-4f3959ca7cd7 tempest-VolumesActionsTest-459479611 None] Deleted volume successfully.
Nov 05 19:16:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1dc114eb-eb20-4c59-8bc8-b9e3ae85045a tempest-VolumesImageMetadata-1190936851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d5de1124-d17c-4804-806e-4780d8579584" returned: 0 in 0.506s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1dc114eb-eb20-4c59-8bc8-b9e3ae85045a tempest-VolumesImageMetadata-1190936851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d5de1124-d17c-4804-806e-4780d8579584 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:57 devstack sudo[98243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d5de1124-d17c-4804-806e-4780d8579584
Nov 05 19:16:57 devstack sudo[98243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:57 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5e514db7-57a7-4080-8676-4f3959ca7cd7 tempest-VolumesActionsTest-459479611 None] Lock "cinder-71f02f78-ed9b-4cf0-bedc-ae8f6bcdc1c0-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:16:58 devstack sudo[98243]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1dc114eb-eb20-4c59-8bc8-b9e3ae85045a tempest-VolumesImageMetadata-1190936851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d5de1124-d17c-4804-806e-4780d8579584" returned: 0 in 0.362s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:58 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1dc114eb-eb20-4c59-8bc8-b9e3ae85045a tempest-VolumesImageMetadata-1190936851 None] Lock "cinder-quobyte-d5de1124-d17c-4804-806e-4780d8579584" released by "delete_volume" :: held 0.929s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:16:58 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-1dc114eb-eb20-4c59-8bc8-b9e3ae85045a tempest-VolumesImageMetadata-1190936851 None] Created reservations ['40b770cf-2777-4d27-a151-d0b0637c8802', '8a1a0cfa-ab46-475d-a458-cbafdb5dc752', '21a6b7da-0a86-4479-8de7-8140602287be', 'ef02aa85-1808-4789-b9dd-67a05d0cfaa9'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:16:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1dc114eb-eb20-4c59-8bc8-b9e3ae85045a tempest-VolumesImageMetadata-1190936851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:16:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1dc114eb-eb20-4c59-8bc8-b9e3ae85045a tempest-VolumesImageMetadata-1190936851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:16:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1dc114eb-eb20-4c59-8bc8-b9e3ae85045a tempest-VolumesImageMetadata-1190936851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:16:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1dc114eb-eb20-4c59-8bc8-b9e3ae85045a tempest-VolumesImageMetadata-1190936851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:16:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1dc114eb-eb20-4c59-8bc8-b9e3ae85045a tempest-VolumesImageMetadata-1190936851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:16:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1dc114eb-eb20-4c59-8bc8-b9e3ae85045a tempest-VolumesImageMetadata-1190936851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:16:58 devstack sudo[98250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:16:58 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:16:58 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root
Nov 05 19:16:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1dc114eb-eb20-4c59-8bc8-b9e3ae85045a tempest-VolumesImageMetadata-1190936851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.317s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:16:58 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-1dc114eb-eb20-4c59-8bc8-b9e3ae85045a tempest-VolumesImageMetadata-1190936851 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:16:58 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-1dc114eb-eb20-4c59-8bc8-b9e3ae85045a tempest-VolumesImageMetadata-1190936851 None] Deleted volume successfully.
Nov 05 19:16:58 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1dc114eb-eb20-4c59-8bc8-b9e3ae85045a tempest-VolumesImageMetadata-1190936851 None] Lock "cinder-d5de1124-d17c-4804-806e-4780d8579584-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:17:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:17:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:17:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:17:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:17:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:17:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:17:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:17:05 devstack sudo[98260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:17:05 devstack sudo[98260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:17:05 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-873a566b-5681-4ea0-849d-4fbb1d21bbf7 req-0caea0ad-3930-4e8f-91aa-bf1ff93da699 tempest-TestMinimumBasicScenario-121717189 None] Terminate volume connection completed successfully.
Nov 05 19:17:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-873a566b-5681-4ea0-849d-4fbb1d21bbf7 req-0caea0ad-3930-4e8f-91aa-bf1ff93da699 tempest-TestMinimumBasicScenario-121717189 None] Deleting attachment 2eb41f82-cea0-4054-8804-dd659ffe679e. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 19:17:05 devstack sudo[98260]: pam_unix(sudo:session): session closed for user root
Nov 05 19:17:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.441s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:17:05 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:17:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:17:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread count: 28 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 19:17:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread info: [<_MainThread(MainThread, started 126882883072128)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126882770872512)>, <Thread(Thread-3 (stat_writer), started daemon 126882769837376)>, <Thread(Rabbit-heartbeat, started daemon 126882768896256)>, <Thread(Thread-5 (_runner), started daemon 126882768980928)>, <Thread(Thread-7 (_runner), started daemon 126882767016448)>, <Thread(fd_logger, started daemon 126882764561216)>, <Thread(privsep_reader, started daemon 126882764568576)>, <Thread(tpool_thread_0, started daemon 126882759292608)>, <Thread(tpool_thread_1, started daemon 126882750899904)>, <Thread(tpool_thread_2, started daemon 126882742507200)>, <Thread(tpool_thread_3, started daemon 126882734114496)>, <Thread(tpool_thread_4, started daemon 126882725721792)>, <Thread(tpool_thread_5, started daemon 126882717329088)>, <Thread(tpool_thread_6, started daemon 126882708920000)>, <Thread(tpool_thread_7, started daemon 126882700510912)>, <Thread(tpool_thread_8, started daemon 126882692101824)>, <Thread(tpool_thread_9, started daemon 126882683692736)>, <Thread(tpool_thread_10, started daemon 126882675283648)>, <Thread(tpool_thread_11, started daemon 126882666874560)>, <Thread(tpool_thread_12, started daemon 126882658465472)>, <Thread(tpool_thread_13, started daemon 126882650056384)>, <Thread(tpool_thread_14, started daemon 126882641647296)>, <Thread(tpool_thread_15, started daemon 126882633238208)>, <Thread(tpool_thread_16, started daemon 126882624829120)>, <Thread(tpool_thread_17, started daemon 126882616420032)>, <Thread(tpool_thread_18, started daemon 126882608010944)>, <Thread(tpool_thread_19, started daemon 126882599601856)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 19:17:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e1954030-e0e3-4719-a56d-105301a08f6d tempest-TestMinimumBasicScenario-121717189 None] Acquiring lock "cinder-525b8d40-a819-4551-ad70-64047a190402-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:17:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e1954030-e0e3-4719-a56d-105301a08f6d tempest-TestMinimumBasicScenario-121717189 None] Lock "cinder-525b8d40-a819-4551-ad70-64047a190402-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:17:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e1954030-e0e3-4719-a56d-105301a08f6d tempest-TestMinimumBasicScenario-121717189 None] Acquiring lock "cinder-quobyte-525b8d40-a819-4551-ad70-64047a190402" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:17:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e1954030-e0e3-4719-a56d-105301a08f6d tempest-TestMinimumBasicScenario-121717189 None] Lock "cinder-quobyte-525b8d40-a819-4551-ad70-64047a190402" acquired by "delete_volume" :: waited 0.035s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:17:06 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[250823e7-0403-439a-b89c-9ef027ad61bd]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:17:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e1954030-e0e3-4719-a56d-105301a08f6d tempest-TestMinimumBasicScenario-121717189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-525b8d40-a819-4551-ad70-64047a190402 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:17:06 devstack sudo[98267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-525b8d40-a819-4551-ad70-64047a190402
Nov 05 19:17:06 devstack sudo[98267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:17:07 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aefaba3-3c5c-498f-9c56-e8dace04503c tempest-VolumesTransfersV355Test-2014761176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:17:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9aefaba3-3c5c-498f-9c56-e8dace04503c tempest-VolumesTransfersV355Test-2014761176 None] Flow 'volume_create_manager' (6065db78-5471-409d-8889-eb52b519e572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:17:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9aefaba3-3c5c-498f-9c56-e8dace04503c tempest-VolumesTransfersV355Test-2014761176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80ea7716-89ec-49c0-9404-e66f4f2616b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:17:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9aefaba3-3c5c-498f-9c56-e8dace04503c tempest-VolumesTransfersV355Test-2014761176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80ea7716-89ec-49c0-9404-e66f4f2616b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1926937574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e27ea2ca-9100-473c-8dac-85da66454d13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d481b9d6b7d4c41bae9da7c77921276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:17:07Z,use_quota=True,user_id='8fe1590a5fa448968e4f16b8031e10b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:17:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9aefaba3-3c5c-498f-9c56-e8dace04503c tempest-VolumesTransfersV355Test-2014761176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33af89ae-4d54-48ef-aefd-a499e41598bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:17:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9aefaba3-3c5c-498f-9c56-e8dace04503c tempest-VolumesTransfersV355Test-2014761176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33af89ae-4d54-48ef-aefd-a499e41598bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:17:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9aefaba3-3c5c-498f-9c56-e8dace04503c tempest-VolumesTransfersV355Test-2014761176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b57e5d8-2a4e-433a-b8a7-68dfec5ecd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:17:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9aefaba3-3c5c-498f-9c56-e8dace04503c tempest-VolumesTransfersV355Test-2014761176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b57e5d8-2a4e-433a-b8a7-68dfec5ecd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e27ea2ca-9100-473c-8dac-85da66454d13', 'volume_name': 'volume-e27ea2ca-9100-473c-8dac-85da66454d13', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:17:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9aefaba3-3c5c-498f-9c56-e8dace04503c tempest-VolumesTransfersV355Test-2014761176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e84c9c1-c55b-44f6-8947-e9e7cd166db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:17:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9aefaba3-3c5c-498f-9c56-e8dace04503c tempest-VolumesTransfersV355Test-2014761176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e84c9c1-c55b-44f6-8947-e9e7cd166db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:17:07 devstack sudo[98267]: pam_unix(sudo:session): session closed for user root
Nov 05 19:17:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9aefaba3-3c5c-498f-9c56-e8dace04503c tempest-VolumesTransfersV355Test-2014761176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a28f41e0-bb2f-47a2-a23a-d530a7c38f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:17:07 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-9aefaba3-3c5c-498f-9c56-e8dace04503c tempest-VolumesTransfersV355Test-2014761176 None] Volume e27ea2ca-9100-473c-8dac-85da66454d13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e27ea2ca-9100-473c-8dac-85da66454d13', 'volume_size': 1}
Nov 05 19:17:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9aefaba3-3c5c-498f-9c56-e8dace04503c tempest-VolumesTransfersV355Test-2014761176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:17:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9aefaba3-3c5c-498f-9c56-e8dace04503c tempest-VolumesTransfersV355Test-2014761176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:17:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9aefaba3-3c5c-498f-9c56-e8dace04503c tempest-VolumesTransfersV355Test-2014761176 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1926937574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e27ea2ca-9100-473c-8dac-85da66454d13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d481b9d6b7d4c41bae9da7c77921276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:17:07Z,use_quota=True,user_id='8fe1590a5fa448968e4f16b8031e10b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:17:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-9aefaba3-3c5c-498f-9c56-e8dace04503c tempest-VolumesTransfersV355Test-2014761176 None] Creating volume e27ea2ca-9100-473c-8dac-85da66454d13 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:17:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9aefaba3-3c5c-498f-9c56-e8dace04503c tempest-VolumesTransfersV355Test-2014761176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:17:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9aefaba3-3c5c-498f-9c56-e8dace04503c tempest-VolumesTransfersV355Test-2014761176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:17:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9aefaba3-3c5c-498f-9c56-e8dace04503c tempest-VolumesTransfersV355Test-2014761176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:17:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9aefaba3-3c5c-498f-9c56-e8dace04503c tempest-VolumesTransfersV355Test-2014761176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:17:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9aefaba3-3c5c-498f-9c56-e8dace04503c tempest-VolumesTransfersV355Test-2014761176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:17:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9aefaba3-3c5c-498f-9c56-e8dace04503c tempest-VolumesTransfersV355Test-2014761176 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:17:07 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-9aefaba3-3c5c-498f-9c56-e8dace04503c tempest-VolumesTransfersV355Test-2014761176 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:17:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9aefaba3-3c5c-498f-9c56-e8dace04503c tempest-VolumesTransfersV355Test-2014761176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e27ea2ca-9100-473c-8dac-85da66454d13 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:17:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e1954030-e0e3-4719-a56d-105301a08f6d tempest-TestMinimumBasicScenario-121717189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-525b8d40-a819-4551-ad70-64047a190402" returned: 0 in 0.518s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:17:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e1954030-e0e3-4719-a56d-105301a08f6d tempest-TestMinimumBasicScenario-121717189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-525b8d40-a819-4551-ad70-64047a190402 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:17:07 devstack sudo[98273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e27ea2ca-9100-473c-8dac-85da66454d13 1073741824
Nov 05 19:17:07 devstack sudo[98273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:17:07 devstack sudo[98274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-525b8d40-a819-4551-ad70-64047a190402
Nov 05 19:17:07 devstack sudo[98274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:17:07 devstack sudo[98274]: pam_unix(sudo:session): session closed for user root
Nov 05 19:17:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e1954030-e0e3-4719-a56d-105301a08f6d tempest-TestMinimumBasicScenario-121717189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-525b8d40-a819-4551-ad70-64047a190402" returned: 0 in 0.325s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:17:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e1954030-e0e3-4719-a56d-105301a08f6d tempest-TestMinimumBasicScenario-121717189 None] Lock "cinder-quobyte-525b8d40-a819-4551-ad70-64047a190402" released by "delete_volume" :: held 0.919s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:17:07 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-e1954030-e0e3-4719-a56d-105301a08f6d tempest-TestMinimumBasicScenario-121717189 None] Created reservations ['c2703c57-7c5b-45f6-8b30-87eff1d83bd2', '5b715715-2849-488e-a13e-621b4a4a4f29', '169594be-bdcd-43b7-ab7a-316926fc8160', '8fa701b2-02ec-47e7-b663-78324b4e97e1'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:17:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e1954030-e0e3-4719-a56d-105301a08f6d tempest-TestMinimumBasicScenario-121717189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:17:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e1954030-e0e3-4719-a56d-105301a08f6d tempest-TestMinimumBasicScenario-121717189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:17:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e1954030-e0e3-4719-a56d-105301a08f6d tempest-TestMinimumBasicScenario-121717189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:17:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e1954030-e0e3-4719-a56d-105301a08f6d tempest-TestMinimumBasicScenario-121717189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:17:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e1954030-e0e3-4719-a56d-105301a08f6d tempest-TestMinimumBasicScenario-121717189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:17:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e1954030-e0e3-4719-a56d-105301a08f6d tempest-TestMinimumBasicScenario-121717189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:17:07 devstack sudo[98273]: pam_unix(sudo:session): session closed for user root
Nov 05 19:17:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9aefaba3-3c5c-498f-9c56-e8dace04503c tempest-VolumesTransfersV355Test-2014761176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e27ea2ca-9100-473c-8dac-85da66454d13 1073741824" returned: 0 in 0.647s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:17:07 devstack sudo[98282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:17:07 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:17:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9aefaba3-3c5c-498f-9c56-e8dace04503c tempest-VolumesTransfersV355Test-2014761176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e27ea2ca-9100-473c-8dac-85da66454d13 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:17:08 devstack sudo[98284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e27ea2ca-9100-473c-8dac-85da66454d13
Nov 05 19:17:08 devstack sudo[98284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:17:08 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root
Nov 05 19:17:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e1954030-e0e3-4719-a56d-105301a08f6d tempest-TestMinimumBasicScenario-121717189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.349s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:17:08 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-e1954030-e0e3-4719-a56d-105301a08f6d tempest-TestMinimumBasicScenario-121717189 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:17:08 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-e1954030-e0e3-4719-a56d-105301a08f6d tempest-TestMinimumBasicScenario-121717189 None] Deleted volume successfully.
Nov 05 19:17:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e1954030-e0e3-4719-a56d-105301a08f6d tempest-TestMinimumBasicScenario-121717189 None] Lock "cinder-525b8d40-a819-4551-ad70-64047a190402-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:17:08 devstack sudo[98284]: pam_unix(sudo:session): session closed for user root
Nov 05 19:17:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9aefaba3-3c5c-498f-9c56-e8dace04503c tempest-VolumesTransfersV355Test-2014761176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e27ea2ca-9100-473c-8dac-85da66454d13" returned: 0 in 0.322s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:17:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9aefaba3-3c5c-498f-9c56-e8dace04503c tempest-VolumesTransfersV355Test-2014761176 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:17:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9aefaba3-3c5c-498f-9c56-e8dace04503c tempest-VolumesTransfersV355Test-2014761176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:17:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9aefaba3-3c5c-498f-9c56-e8dace04503c tempest-VolumesTransfersV355Test-2014761176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a28f41e0-bb2f-47a2-a23a-d530a7c38f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e27ea2ca-9100-473c-8dac-85da66454d13', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:17:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9aefaba3-3c5c-498f-9c56-e8dace04503c tempest-VolumesTransfersV355Test-2014761176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfdcf797-3993-4e63-91de-b22a9d9133b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:17:08 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-9aefaba3-3c5c-498f-9c56-e8dace04503c tempest-VolumesTransfersV355Test-2014761176 None] Volume volume-e27ea2ca-9100-473c-8dac-85da66454d13 (e27ea2ca-9100-473c-8dac-85da66454d13): created successfully
Nov 05 19:17:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9aefaba3-3c5c-498f-9c56-e8dace04503c tempest-VolumesTransfersV355Test-2014761176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfdcf797-3993-4e63-91de-b22a9d9133b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:17:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9aefaba3-3c5c-498f-9c56-e8dace04503c tempest-VolumesTransfersV355Test-2014761176 None] Flow 'volume_create_manager' (6065db78-5471-409d-8889-eb52b519e572) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:17:08 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-9aefaba3-3c5c-498f-9c56-e8dace04503c tempest-VolumesTransfersV355Test-2014761176 None] Created volume successfully.
Nov 05 19:17:10 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-ef76b5e9-ab6c-4c7a-933e-db3c95a32f8d tempest-VolumesTransfersV355Test-429812766 None] Transfer volume completed successfully.
Nov 05 19:17:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6572265f-424f-4e2b-a2c3-e0caea1e2e42 tempest-VolumesTransfersV355Test-16697655 None] Acquiring lock "cinder-e27ea2ca-9100-473c-8dac-85da66454d13-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:17:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6572265f-424f-4e2b-a2c3-e0caea1e2e42 tempest-VolumesTransfersV355Test-16697655 None] Lock "cinder-e27ea2ca-9100-473c-8dac-85da66454d13-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:17:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6572265f-424f-4e2b-a2c3-e0caea1e2e42 tempest-VolumesTransfersV355Test-16697655 None] Acquiring lock "cinder-quobyte-e27ea2ca-9100-473c-8dac-85da66454d13" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:17:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6572265f-424f-4e2b-a2c3-e0caea1e2e42 tempest-VolumesTransfersV355Test-16697655 None] Lock "cinder-quobyte-e27ea2ca-9100-473c-8dac-85da66454d13" acquired by "delete_volume" :: waited 0.023s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:17:11 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8d156f-d24a-439b-ba6c-3641de88fcef]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:17:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6572265f-424f-4e2b-a2c3-e0caea1e2e42 tempest-VolumesTransfersV355Test-16697655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e27ea2ca-9100-473c-8dac-85da66454d13 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:17:11 devstack sudo[98309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e27ea2ca-9100-473c-8dac-85da66454d13
Nov 05 19:17:11 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:17:11 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root
Nov 05 19:17:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6572265f-424f-4e2b-a2c3-e0caea1e2e42 tempest-VolumesTransfersV355Test-16697655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e27ea2ca-9100-473c-8dac-85da66454d13" returned: 0 in 0.684s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:17:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6572265f-424f-4e2b-a2c3-e0caea1e2e42 tempest-VolumesTransfersV355Test-16697655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e27ea2ca-9100-473c-8dac-85da66454d13 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:17:11 devstack sudo[98316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e27ea2ca-9100-473c-8dac-85da66454d13
Nov 05 19:17:11 devstack sudo[98316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:17:12 devstack sudo[98316]: pam_unix(sudo:session): session closed for user root
Nov 05 19:17:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6572265f-424f-4e2b-a2c3-e0caea1e2e42 tempest-VolumesTransfersV355Test-16697655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e27ea2ca-9100-473c-8dac-85da66454d13" returned: 0 in 0.407s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:17:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6572265f-424f-4e2b-a2c3-e0caea1e2e42 tempest-VolumesTransfersV355Test-16697655 None] Lock "cinder-quobyte-e27ea2ca-9100-473c-8dac-85da66454d13" released by "delete_volume" :: held 1.153s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:17:12 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-6572265f-424f-4e2b-a2c3-e0caea1e2e42 tempest-VolumesTransfersV355Test-16697655 None] Created reservations ['4e4c947c-7495-4b22-a851-841f1f0a5850', '63c2563e-e165-48e7-89ea-f89bca7f873d', '76a1541e-d9ea-4cf0-89b0-940064519265', 'ba449e53-8e14-41c4-9078-01e2d2b1a02d'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:17:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6572265f-424f-4e2b-a2c3-e0caea1e2e42 tempest-VolumesTransfersV355Test-16697655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:17:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6572265f-424f-4e2b-a2c3-e0caea1e2e42 tempest-VolumesTransfersV355Test-16697655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:17:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6572265f-424f-4e2b-a2c3-e0caea1e2e42 tempest-VolumesTransfersV355Test-16697655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:17:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6572265f-424f-4e2b-a2c3-e0caea1e2e42 tempest-VolumesTransfersV355Test-16697655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:17:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6572265f-424f-4e2b-a2c3-e0caea1e2e42 tempest-VolumesTransfersV355Test-16697655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:17:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6572265f-424f-4e2b-a2c3-e0caea1e2e42 tempest-VolumesTransfersV355Test-16697655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:17:12 devstack sudo[98320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:17:12 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:17:12 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a65e182-4628-44d0-a6ff-30c60649c465 tempest-TestImageHashVerification-1650486199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:17:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0a65e182-4628-44d0-a6ff-30c60649c465 tempest-TestImageHashVerification-1650486199 None] Flow 'volume_create_manager' (42e7098f-83e6-4904-86db-e49079d8316c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:17:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0a65e182-4628-44d0-a6ff-30c60649c465 tempest-TestImageHashVerification-1650486199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1219e724-e9f9-4063-95c7-c76e15eaf8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:17:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0a65e182-4628-44d0-a6ff-30c60649c465 tempest-TestImageHashVerification-1650486199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1219e724-e9f9-4063-95c7-c76e15eaf8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-284402621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d70ee974-6bd1-4a9b-a1ac-bf95556730e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56681fdaa24441308987d8086b67d67b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:17:12Z,use_quota=True,user_id='bf3ab4ef07f1495e82bb02fe8c0e5e98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:17:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0a65e182-4628-44d0-a6ff-30c60649c465 tempest-TestImageHashVerification-1650486199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7225f78-2958-4a54-a86b-f275cdd1e5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:17:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0a65e182-4628-44d0-a6ff-30c60649c465 tempest-TestImageHashVerification-1650486199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7225f78-2958-4a54-a86b-f275cdd1e5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:17:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0a65e182-4628-44d0-a6ff-30c60649c465 tempest-TestImageHashVerification-1650486199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc673d75-e5ec-42d5-a575-38d0ec0d38ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:17:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0a65e182-4628-44d0-a6ff-30c60649c465 tempest-TestImageHashVerification-1650486199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc673d75-e5ec-42d5-a575-38d0ec0d38ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd70ee974-6bd1-4a9b-a1ac-bf95556730e0', 'volume_name': 'volume-d70ee974-6bd1-4a9b-a1ac-bf95556730e0', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:17:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0a65e182-4628-44d0-a6ff-30c60649c465 tempest-TestImageHashVerification-1650486199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abe7553d-8ec3-46c8-a4e1-733a6a16634a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:17:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0a65e182-4628-44d0-a6ff-30c60649c465 tempest-TestImageHashVerification-1650486199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abe7553d-8ec3-46c8-a4e1-733a6a16634a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:17:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0a65e182-4628-44d0-a6ff-30c60649c465 tempest-TestImageHashVerification-1650486199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38353ef7-b6ca-44bb-beed-c8326e3b944f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:17:12 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-0a65e182-4628-44d0-a6ff-30c60649c465 tempest-TestImageHashVerification-1650486199 None] Volume d70ee974-6bd1-4a9b-a1ac-bf95556730e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d70ee974-6bd1-4a9b-a1ac-bf95556730e0', 'volume_size': 1}
Nov 05 19:17:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0a65e182-4628-44d0-a6ff-30c60649c465 tempest-TestImageHashVerification-1650486199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:17:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0a65e182-4628-44d0-a6ff-30c60649c465 tempest-TestImageHashVerification-1650486199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:17:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0a65e182-4628-44d0-a6ff-30c60649c465 tempest-TestImageHashVerification-1650486199 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-284402621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d70ee974-6bd1-4a9b-a1ac-bf95556730e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56681fdaa24441308987d8086b67d67b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:17:12Z,use_quota=True,user_id='bf3ab4ef07f1495e82bb02fe8c0e5e98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:17:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-0a65e182-4628-44d0-a6ff-30c60649c465 tempest-TestImageHashVerification-1650486199 None] Creating volume d70ee974-6bd1-4a9b-a1ac-bf95556730e0 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:17:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0a65e182-4628-44d0-a6ff-30c60649c465 tempest-TestImageHashVerification-1650486199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:17:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0a65e182-4628-44d0-a6ff-30c60649c465 tempest-TestImageHashVerification-1650486199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:17:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0a65e182-4628-44d0-a6ff-30c60649c465 tempest-TestImageHashVerification-1650486199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:17:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0a65e182-4628-44d0-a6ff-30c60649c465 tempest-TestImageHashVerification-1650486199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:17:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0a65e182-4628-44d0-a6ff-30c60649c465 tempest-TestImageHashVerification-1650486199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:17:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0a65e182-4628-44d0-a6ff-30c60649c465 tempest-TestImageHashVerification-1650486199 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:17:12 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-0a65e182-4628-44d0-a6ff-30c60649c465 tempest-TestImageHashVerification-1650486199 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:17:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0a65e182-4628-44d0-a6ff-30c60649c465 tempest-TestImageHashVerification-1650486199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d70ee974-6bd1-4a9b-a1ac-bf95556730e0 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:17:12 devstack sudo[98323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d70ee974-6bd1-4a9b-a1ac-bf95556730e0 1073741824
Nov 05 19:17:12 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:17:12 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root
Nov 05 19:17:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6572265f-424f-4e2b-a2c3-e0caea1e2e42 tempest-VolumesTransfersV355Test-16697655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.445s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:17:12 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-6572265f-424f-4e2b-a2c3-e0caea1e2e42 tempest-VolumesTransfersV355Test-16697655 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:17:12 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-6572265f-424f-4e2b-a2c3-e0caea1e2e42 tempest-VolumesTransfersV355Test-16697655 None] Deleted volume successfully.
Nov 05 19:17:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6572265f-424f-4e2b-a2c3-e0caea1e2e42 tempest-VolumesTransfersV355Test-16697655 None] Lock "cinder-e27ea2ca-9100-473c-8dac-85da66454d13-delete_volume" released by "delete_volume" :: held 1.985s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:17:13 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root
Nov 05 19:17:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0a65e182-4628-44d0-a6ff-30c60649c465 tempest-TestImageHashVerification-1650486199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d70ee974-6bd1-4a9b-a1ac-bf95556730e0 1073741824" returned: 0 in 0.668s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:17:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0a65e182-4628-44d0-a6ff-30c60649c465 tempest-TestImageHashVerification-1650486199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d70ee974-6bd1-4a9b-a1ac-bf95556730e0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:17:13 devstack sudo[98330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d70ee974-6bd1-4a9b-a1ac-bf95556730e0
Nov 05 19:17:13 devstack sudo[98330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:17:13 devstack sudo[98330]: pam_unix(sudo:session): session closed for user root
Nov 05 19:17:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0a65e182-4628-44d0-a6ff-30c60649c465 tempest-TestImageHashVerification-1650486199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d70ee974-6bd1-4a9b-a1ac-bf95556730e0" returned: 0 in 0.298s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:17:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0a65e182-4628-44d0-a6ff-30c60649c465 tempest-TestImageHashVerification-1650486199 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:17:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0a65e182-4628-44d0-a6ff-30c60649c465 tempest-TestImageHashVerification-1650486199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:17:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0a65e182-4628-44d0-a6ff-30c60649c465 tempest-TestImageHashVerification-1650486199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38353ef7-b6ca-44bb-beed-c8326e3b944f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d70ee974-6bd1-4a9b-a1ac-bf95556730e0', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:17:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0a65e182-4628-44d0-a6ff-30c60649c465 tempest-TestImageHashVerification-1650486199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0db9e4a-aa0c-46f2-a95f-f4da0763f8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:17:13 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-0a65e182-4628-44d0-a6ff-30c60649c465 tempest-TestImageHashVerification-1650486199 None] Volume volume-d70ee974-6bd1-4a9b-a1ac-bf95556730e0 (d70ee974-6bd1-4a9b-a1ac-bf95556730e0): created successfully
Nov 05 19:17:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0a65e182-4628-44d0-a6ff-30c60649c465 tempest-TestImageHashVerification-1650486199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0db9e4a-aa0c-46f2-a95f-f4da0763f8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:17:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0a65e182-4628-44d0-a6ff-30c60649c465 tempest-TestImageHashVerification-1650486199 None] Flow 'volume_create_manager' (42e7098f-83e6-4904-86db-e49079d8316c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:17:13 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-0a65e182-4628-44d0-a6ff-30c60649c465 tempest-TestImageHashVerification-1650486199 None] Created volume successfully.
Nov 05 19:17:14 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ae7fe54-270d-4313-bdcd-f4c529ed91e7 tempest-VolumesTransfersV355Test-2014761176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:17:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8ae7fe54-270d-4313-bdcd-f4c529ed91e7 tempest-VolumesTransfersV355Test-2014761176 None] Flow 'volume_create_manager' (5a35b1f5-84dc-4aea-90a1-55db7cf9926b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:17:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8ae7fe54-270d-4313-bdcd-f4c529ed91e7 tempest-VolumesTransfersV355Test-2014761176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a526f9ff-4bc6-4c3d-b271-d27745106e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:17:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8ae7fe54-270d-4313-bdcd-f4c529ed91e7 tempest-VolumesTransfersV355Test-2014761176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a526f9ff-4bc6-4c3d-b271-d27745106e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1506075567',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3addeef5-2e89-4337-8117-2436958df926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d481b9d6b7d4c41bae9da7c77921276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:17:14Z,use_quota=True,user_id='8fe1590a5fa448968e4f16b8031e10b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:17:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8ae7fe54-270d-4313-bdcd-f4c529ed91e7 tempest-VolumesTransfersV355Test-2014761176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97043f0a-aa1b-4802-a78f-319e20663070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:17:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8ae7fe54-270d-4313-bdcd-f4c529ed91e7 tempest-VolumesTransfersV355Test-2014761176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97043f0a-aa1b-4802-a78f-319e20663070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:17:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8ae7fe54-270d-4313-bdcd-f4c529ed91e7 tempest-VolumesTransfersV355Test-2014761176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a3c119-2fc2-4560-8543-9a2b4428d1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:17:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8ae7fe54-270d-4313-bdcd-f4c529ed91e7 tempest-VolumesTransfersV355Test-2014761176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a3c119-2fc2-4560-8543-9a2b4428d1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3addeef5-2e89-4337-8117-2436958df926', 'volume_name': 'volume-3addeef5-2e89-4337-8117-2436958df926', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:17:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8ae7fe54-270d-4313-bdcd-f4c529ed91e7 tempest-VolumesTransfersV355Test-2014761176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd10cbca-3be4-43b1-a46c-0bd90d874e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:17:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8ae7fe54-270d-4313-bdcd-f4c529ed91e7 tempest-VolumesTransfersV355Test-2014761176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd10cbca-3be4-43b1-a46c-0bd90d874e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:17:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8ae7fe54-270d-4313-bdcd-f4c529ed91e7 tempest-VolumesTransfersV355Test-2014761176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4282e0df-9ea1-4fec-b5ae-c0abf3968ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:17:14 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-8ae7fe54-270d-4313-bdcd-f4c529ed91e7 tempest-VolumesTransfersV355Test-2014761176 None] Volume 3addeef5-2e89-4337-8117-2436958df926: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3addeef5-2e89-4337-8117-2436958df926', 'volume_size': 1}
Nov 05 19:17:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8ae7fe54-270d-4313-bdcd-f4c529ed91e7 tempest-VolumesTransfersV355Test-2014761176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:17:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8ae7fe54-270d-4313-bdcd-f4c529ed91e7 tempest-VolumesTransfersV355Test-2014761176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:17:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8ae7fe54-270d-4313-bdcd-f4c529ed91e7 tempest-VolumesTransfersV355Test-2014761176 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1506075567',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3addeef5-2e89-4337-8117-2436958df926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d481b9d6b7d4c41bae9da7c77921276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:17:14Z,use_quota=True,user_id='8fe1590a5fa448968e4f16b8031e10b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:17:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-8ae7fe54-270d-4313-bdcd-f4c529ed91e7 tempest-VolumesTransfersV355Test-2014761176 None] Creating volume 3addeef5-2e89-4337-8117-2436958df926 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:17:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8ae7fe54-270d-4313-bdcd-f4c529ed91e7 tempest-VolumesTransfersV355Test-2014761176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:17:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8ae7fe54-270d-4313-bdcd-f4c529ed91e7 tempest-VolumesTransfersV355Test-2014761176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:17:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8ae7fe54-270d-4313-bdcd-f4c529ed91e7 tempest-VolumesTransfersV355Test-2014761176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:17:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8ae7fe54-270d-4313-bdcd-f4c529ed91e7 tempest-VolumesTransfersV355Test-2014761176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:17:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8ae7fe54-270d-4313-bdcd-f4c529ed91e7 tempest-VolumesTransfersV355Test-2014761176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:17:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8ae7fe54-270d-4313-bdcd-f4c529ed91e7 tempest-VolumesTransfersV355Test-2014761176 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:17:14 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-8ae7fe54-270d-4313-bdcd-f4c529ed91e7 tempest-VolumesTransfersV355Test-2014761176 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:17:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8ae7fe54-270d-4313-bdcd-f4c529ed91e7 tempest-VolumesTransfersV355Test-2014761176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3addeef5-2e89-4337-8117-2436958df926 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:17:14 devstack sudo[98333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3addeef5-2e89-4337-8117-2436958df926 1073741824
Nov 05 19:17:14 devstack sudo[98333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:17:14 devstack sudo[98333]: pam_unix(sudo:session): session closed for user root
Nov 05 19:17:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8ae7fe54-270d-4313-bdcd-f4c529ed91e7 tempest-VolumesTransfersV355Test-2014761176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3addeef5-2e89-4337-8117-2436958df926 1073741824" returned: 0 in 0.573s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:17:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8ae7fe54-270d-4313-bdcd-f4c529ed91e7 tempest-VolumesTransfersV355Test-2014761176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3addeef5-2e89-4337-8117-2436958df926 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:17:14 devstack sudo[98339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3addeef5-2e89-4337-8117-2436958df926
Nov 05 19:17:14 devstack sudo[98339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:17:15 devstack sudo[98339]: pam_unix(sudo:session): session closed for user root
Nov 05 19:17:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8ae7fe54-270d-4313-bdcd-f4c529ed91e7 tempest-VolumesTransfersV355Test-2014761176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3addeef5-2e89-4337-8117-2436958df926" returned: 0 in 0.349s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:17:15 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8ae7fe54-270d-4313-bdcd-f4c529ed91e7 tempest-VolumesTransfersV355Test-2014761176 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:17:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8ae7fe54-270d-4313-bdcd-f4c529ed91e7 tempest-VolumesTransfersV355Test-2014761176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:17:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8ae7fe54-270d-4313-bdcd-f4c529ed91e7 tempest-VolumesTransfersV355Test-2014761176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4282e0df-9ea1-4fec-b5ae-c0abf3968ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3addeef5-2e89-4337-8117-2436958df926', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:17:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8ae7fe54-270d-4313-bdcd-f4c529ed91e7 tempest-VolumesTransfersV355Test-2014761176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b221bd5-895b-4c51-90b1-05df7d4bc07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:17:15 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-8ae7fe54-270d-4313-bdcd-f4c529ed91e7 tempest-VolumesTransfersV355Test-2014761176 None] Volume volume-3addeef5-2e89-4337-8117-2436958df926 (3addeef5-2e89-4337-8117-2436958df926): created successfully
Nov 05 19:17:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8ae7fe54-270d-4313-bdcd-f4c529ed91e7 tempest-VolumesTransfersV355Test-2014761176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b221bd5-895b-4c51-90b1-05df7d4bc07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:17:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8ae7fe54-270d-4313-bdcd-f4c529ed91e7 tempest-VolumesTransfersV355Test-2014761176 None] Flow 'volume_create_manager' (5a35b1f5-84dc-4aea-90a1-55db7cf9926b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:17:15 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-8ae7fe54-270d-4313-bdcd-f4c529ed91e7 tempest-VolumesTransfersV355Test-2014761176 None] Created volume successfully.
Nov 05 19:17:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c84ffbd8-1838-4981-934b-81d91256d1d4 tempest-TestImageHashVerification-1650486199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:17:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c84ffbd8-1838-4981-934b-81d91256d1d4 tempest-TestImageHashVerification-1650486199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:17:16 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[847c5fe8-d456-47de-86c7-53e60249c7a7]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:17:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c84ffbd8-1838-4981-934b-81d91256d1d4 tempest-TestImageHashVerification-1650486199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d70ee974-6bd1-4a9b-a1ac-bf95556730e0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:17:16 devstack sudo[98342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d70ee974-6bd1-4a9b-a1ac-bf95556730e0
Nov 05 19:17:16 devstack sudo[98342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:17:16 devstack sudo[98342]: pam_unix(sudo:session): session closed for user root
Nov 05 19:17:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c84ffbd8-1838-4981-934b-81d91256d1d4 tempest-TestImageHashVerification-1650486199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d70ee974-6bd1-4a9b-a1ac-bf95556730e0" returned: 0 in 0.482s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:17:16 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1d350f-960f-45db-b760-fbac320660b3]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:17:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c84ffbd8-1838-4981-934b-81d91256d1d4 tempest-TestImageHashVerification-1650486199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d70ee974-6bd1-4a9b-a1ac-bf95556730e0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:17:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-92584257-f48d-47b8-ae28-c01f0bbc95f2 tempest-VolumesTransfersV355Test-16697655 None] Acquiring lock "cinder-3addeef5-2e89-4337-8117-2436958df926-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:17:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-92584257-f48d-47b8-ae28-c01f0bbc95f2 tempest-VolumesTransfersV355Test-16697655 None] Lock "cinder-3addeef5-2e89-4337-8117-2436958df926-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:17:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-92584257-f48d-47b8-ae28-c01f0bbc95f2 tempest-VolumesTransfersV355Test-16697655 None] Acquiring lock "cinder-quobyte-3addeef5-2e89-4337-8117-2436958df926" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:17:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-92584257-f48d-47b8-ae28-c01f0bbc95f2 tempest-VolumesTransfersV355Test-16697655 None] Lock "cinder-quobyte-3addeef5-2e89-4337-8117-2436958df926" acquired by "delete_volume" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:17:16 devstack sudo[98348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d70ee974-6bd1-4a9b-a1ac-bf95556730e0
Nov 05 19:17:16 devstack sudo[98348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:17:16 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2841bee-5936-4a28-ae14-315eee7676d2]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:17:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-92584257-f48d-47b8-ae28-c01f0bbc95f2 tempest-VolumesTransfersV355Test-16697655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3addeef5-2e89-4337-8117-2436958df926 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:17:16 devstack sudo[98350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3addeef5-2e89-4337-8117-2436958df926
Nov 05 19:17:16 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:17:17 devstack sudo[98348]: pam_unix(sudo:session): session closed for user root
Nov 05 19:17:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c84ffbd8-1838-4981-934b-81d91256d1d4 tempest-TestImageHashVerification-1650486199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d70ee974-6bd1-4a9b-a1ac-bf95556730e0" returned: 0 in 0.485s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:17:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c84ffbd8-1838-4981-934b-81d91256d1d4 tempest-TestImageHashVerification-1650486199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d70ee974-6bd1-4a9b-a1ac-bf95556730e0 /opt/stack/data/cinder/conversion/d70ee974-6bd1-4a9b-a1ac-bf95556730e0.temp_image.3bf2026a-7c23-47c0-8ffe-4393310d2f28o93dizmw.img {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:17:17 devstack sudo[98356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d70ee974-6bd1-4a9b-a1ac-bf95556730e0 /opt/stack/data/cinder/conversion/d70ee974-6bd1-4a9b-a1ac-bf95556730e0.temp_image.3bf2026a-7c23-47c0-8ffe-4393310d2f28o93dizmw.img
Nov 05 19:17:17 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:17:17 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root
Nov 05 19:17:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-92584257-f48d-47b8-ae28-c01f0bbc95f2 tempest-VolumesTransfersV355Test-16697655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3addeef5-2e89-4337-8117-2436958df926" returned: 0 in 0.468s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:17:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-92584257-f48d-47b8-ae28-c01f0bbc95f2 tempest-VolumesTransfersV355Test-16697655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3addeef5-2e89-4337-8117-2436958df926 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:17:17 devstack sudo[98361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3addeef5-2e89-4337-8117-2436958df926
Nov 05 19:17:17 devstack sudo[98361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:17:17 devstack sudo[98361]: pam_unix(sudo:session): session closed for user root
Nov 05 19:17:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-92584257-f48d-47b8-ae28-c01f0bbc95f2 tempest-VolumesTransfersV355Test-16697655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3addeef5-2e89-4337-8117-2436958df926" returned: 0 in 0.477s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:17:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-92584257-f48d-47b8-ae28-c01f0bbc95f2 tempest-VolumesTransfersV355Test-16697655 None] Lock "cinder-quobyte-3addeef5-2e89-4337-8117-2436958df926" released by "delete_volume" :: held 1.029s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:17:17 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-92584257-f48d-47b8-ae28-c01f0bbc95f2 tempest-VolumesTransfersV355Test-16697655 None] Created reservations ['fa958c02-21cd-4916-a0ca-ebed37a9ddc9', 'e49c6e42-7b3a-45f5-b8fc-3229efe55f3d', '488b42fd-4426-45a4-9f29-03532e5ac79d', 'a9fbc37c-ad1f-4088-acf8-e66dc7147187'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:17:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-92584257-f48d-47b8-ae28-c01f0bbc95f2 tempest-VolumesTransfersV355Test-16697655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:17:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-92584257-f48d-47b8-ae28-c01f0bbc95f2 tempest-VolumesTransfersV355Test-16697655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:17:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-92584257-f48d-47b8-ae28-c01f0bbc95f2 tempest-VolumesTransfersV355Test-16697655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:17:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-92584257-f48d-47b8-ae28-c01f0bbc95f2 tempest-VolumesTransfersV355Test-16697655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:17:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-92584257-f48d-47b8-ae28-c01f0bbc95f2 tempest-VolumesTransfersV355Test-16697655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:17:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-92584257-f48d-47b8-ae28-c01f0bbc95f2 tempest-VolumesTransfersV355Test-16697655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:17:18 devstack sudo[98375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:17:18 devstack sudo[98375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:17:18 devstack sudo[98375]: pam_unix(sudo:session): session closed for user root
Nov 05 19:17:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-92584257-f48d-47b8-ae28-c01f0bbc95f2 tempest-VolumesTransfersV355Test-16697655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.354s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:17:18 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-92584257-f48d-47b8-ae28-c01f0bbc95f2 tempest-VolumesTransfersV355Test-16697655 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:17:18 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-92584257-f48d-47b8-ae28-c01f0bbc95f2 tempest-VolumesTransfersV355Test-16697655 None] Deleted volume successfully.
Nov 05 19:17:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-92584257-f48d-47b8-ae28-c01f0bbc95f2 tempest-VolumesTransfersV355Test-16697655 None] Lock "cinder-3addeef5-2e89-4337-8117-2436958df926-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:17:20 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-98b1691a-519f-4893-8bf4-1f7eb25191a1 tempest-VolumesDeleteCascade-2046550965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:17:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-98b1691a-519f-4893-8bf4-1f7eb25191a1 tempest-VolumesDeleteCascade-2046550965 None] Flow 'volume_create_manager' (fade6ffe-46fa-4e16-926b-66c510849354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:17:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-98b1691a-519f-4893-8bf4-1f7eb25191a1 tempest-VolumesDeleteCascade-2046550965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fee4918-3e2f-4914-94c8-31f0670ed419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:17:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-98b1691a-519f-4893-8bf4-1f7eb25191a1 tempest-VolumesDeleteCascade-2046550965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fee4918-3e2f-4914-94c8-31f0670ed419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-647735370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfc5687c-c4f9-4f16-ac2a-3e71af9f729f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48f6ed00672a4db4be8715a188e1077d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:17:20Z,use_quota=True,user_id='3c21ea053b724e50bc8bee7aebb509aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:17:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-98b1691a-519f-4893-8bf4-1f7eb25191a1 tempest-VolumesDeleteCascade-2046550965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bfc2fe2-48be-4227-9a98-ab6a8f12e3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:17:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-98b1691a-519f-4893-8bf4-1f7eb25191a1 tempest-VolumesDeleteCascade-2046550965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bfc2fe2-48be-4227-9a98-ab6a8f12e3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:17:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-98b1691a-519f-4893-8bf4-1f7eb25191a1 tempest-VolumesDeleteCascade-2046550965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbc8804b-c3b1-49fc-9f8b-db387b06c64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:17:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-98b1691a-519f-4893-8bf4-1f7eb25191a1 tempest-VolumesDeleteCascade-2046550965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbc8804b-c3b1-49fc-9f8b-db387b06c64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfc5687c-c4f9-4f16-ac2a-3e71af9f729f', 'volume_name': 'volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:17:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-98b1691a-519f-4893-8bf4-1f7eb25191a1 tempest-VolumesDeleteCascade-2046550965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (250f5b21-c398-4159-a0b1-8ca0a9e11c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:17:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-98b1691a-519f-4893-8bf4-1f7eb25191a1 tempest-VolumesDeleteCascade-2046550965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (250f5b21-c398-4159-a0b1-8ca0a9e11c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:17:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-98b1691a-519f-4893-8bf4-1f7eb25191a1 tempest-VolumesDeleteCascade-2046550965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55863c8c-1af7-42ed-9154-5734db4a4e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:17:20 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-98b1691a-519f-4893-8bf4-1f7eb25191a1 tempest-VolumesDeleteCascade-2046550965 None] Volume dfc5687c-c4f9-4f16-ac2a-3e71af9f729f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f', 'volume_size': 1}
Nov 05 19:17:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-98b1691a-519f-4893-8bf4-1f7eb25191a1 tempest-VolumesDeleteCascade-2046550965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:17:25 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root
Nov 05 19:17:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c84ffbd8-1838-4981-934b-81d91256d1d4 tempest-TestImageHashVerification-1650486199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d70ee974-6bd1-4a9b-a1ac-bf95556730e0 /opt/stack/data/cinder/conversion/d70ee974-6bd1-4a9b-a1ac-bf95556730e0.temp_image.3bf2026a-7c23-47c0-8ffe-4393310d2f28o93dizmw.img" returned: 0 in 8.407s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:17:25 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[587c18ea-39a9-42da-849d-0abc85f78783]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:17:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c84ffbd8-1838-4981-934b-81d91256d1d4 tempest-TestImageHashVerification-1650486199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d70ee974-6bd1-4a9b-a1ac-bf95556730e0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:17:25 devstack sudo[98381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d70ee974-6bd1-4a9b-a1ac-bf95556730e0
Nov 05 19:17:25 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:17:26 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root
Nov 05 19:17:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c84ffbd8-1838-4981-934b-81d91256d1d4 tempest-TestImageHashVerification-1650486199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d70ee974-6bd1-4a9b-a1ac-bf95556730e0" returned: 0 in 0.588s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:17:26 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-c84ffbd8-1838-4981-934b-81d91256d1d4 tempest-TestImageHashVerification-1650486199 None] Image conversion details: src /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d70ee974-6bd1-4a9b-a1ac-bf95556730e0, size 1024.00 MB, duration 8.41 sec, destination /opt/stack/data/cinder/conversion/d70ee974-6bd1-4a9b-a1ac-bf95556730e0.temp_image.3bf2026a-7c23-47c0-8ffe-4393310d2f28o93dizmw.img {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 19:17:26 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-c84ffbd8-1838-4981-934b-81d91256d1d4 tempest-TestImageHashVerification-1650486199 None] Converted 1024.00 MB image at 121.79 MB/s
Nov 05 19:17:26 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-c84ffbd8-1838-4981-934b-81d91256d1d4 tempest-TestImageHashVerification-1650486199 None] 3bf2026a-7c23-47c0-8ffe-4393310d2f28 was raw, no need to convert to raw {{(pid=87184) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Nov 05 19:17:30 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=59,cinder:INSERT=22,cinder:UPDATE=81,cinder:DELETE=7 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:17:45 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=1 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:17:45 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:UPDATE=76,cinder:DELETE=7,cinder:SELECT=59,cinder:INSERT=26 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:17:46 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-05f6a62e-bc9f-4f05-8329-e371d109fe8a tempest-VolumesActionsTest-2059143216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:17:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-05f6a62e-bc9f-4f05-8329-e371d109fe8a tempest-VolumesActionsTest-2059143216 None] Flow 'volume_create_manager' (9ee3101b-8ae2-43ed-806f-579715113a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:17:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-05f6a62e-bc9f-4f05-8329-e371d109fe8a tempest-VolumesActionsTest-2059143216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbb133f5-cf0c-4850-a3fa-b320cf238d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:17:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-05f6a62e-bc9f-4f05-8329-e371d109fe8a tempest-VolumesActionsTest-2059143216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbb133f5-cf0c-4850-a3fa-b320cf238d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2109924657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4d2d6a8-1b4c-4e76-94a5-6934fff57484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9099528e104942ba9973cbeedfc5cc77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:17:46Z,use_quota=True,user_id='c13fb1d7bac04897aa5741a4664a0e17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:17:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-05f6a62e-bc9f-4f05-8329-e371d109fe8a tempest-VolumesActionsTest-2059143216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c226d91e-6a19-4d66-a055-900329ebe5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:17:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-05f6a62e-bc9f-4f05-8329-e371d109fe8a tempest-VolumesActionsTest-2059143216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c226d91e-6a19-4d66-a055-900329ebe5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:17:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-05f6a62e-bc9f-4f05-8329-e371d109fe8a tempest-VolumesActionsTest-2059143216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a07e1723-628b-4e1e-b91d-d43b1767786f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:17:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-05f6a62e-bc9f-4f05-8329-e371d109fe8a tempest-VolumesActionsTest-2059143216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a07e1723-628b-4e1e-b91d-d43b1767786f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4d2d6a8-1b4c-4e76-94a5-6934fff57484', 'volume_name': 'volume-a4d2d6a8-1b4c-4e76-94a5-6934fff57484', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:17:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-05f6a62e-bc9f-4f05-8329-e371d109fe8a tempest-VolumesActionsTest-2059143216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b3f34ac-4914-46eb-ad7a-ce83b230dee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:17:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-05f6a62e-bc9f-4f05-8329-e371d109fe8a tempest-VolumesActionsTest-2059143216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b3f34ac-4914-46eb-ad7a-ce83b230dee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:17:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-05f6a62e-bc9f-4f05-8329-e371d109fe8a tempest-VolumesActionsTest-2059143216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (584281d8-9d05-4dfc-a82f-cbe2799170eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:17:46 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-05f6a62e-bc9f-4f05-8329-e371d109fe8a tempest-VolumesActionsTest-2059143216 None] Volume a4d2d6a8-1b4c-4e76-94a5-6934fff57484: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4d2d6a8-1b4c-4e76-94a5-6934fff57484', 'volume_size': 1}
Nov 05 19:17:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-05f6a62e-bc9f-4f05-8329-e371d109fe8a tempest-VolumesActionsTest-2059143216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:17:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c84ffbd8-1838-4981-934b-81d91256d1d4 tempest-TestImageHashVerification-1650486199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 34.719s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:17:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c84ffbd8-1838-4981-934b-81d91256d1d4 tempest-TestImageHashVerification-1650486199 None] Uploaded volume to glance image-id: 3bf2026a-7c23-47c0-8ffe-4393310d2f28. {{(pid=87184) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 05 19:17:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-98b1691a-519f-4893-8bf4-1f7eb25191a1 tempest-VolumesDeleteCascade-2046550965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 30.339s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:17:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-98b1691a-519f-4893-8bf4-1f7eb25191a1 tempest-VolumesDeleteCascade-2046550965 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-647735370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfc5687c-c4f9-4f16-ac2a-3e71af9f729f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48f6ed00672a4db4be8715a188e1077d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:17:20Z,use_quota=True,user_id='3c21ea053b724e50bc8bee7aebb509aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:17:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-98b1691a-519f-4893-8bf4-1f7eb25191a1 tempest-VolumesDeleteCascade-2046550965 None] Creating volume dfc5687c-c4f9-4f16-ac2a-3e71af9f729f {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:17:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-98b1691a-519f-4893-8bf4-1f7eb25191a1 tempest-VolumesDeleteCascade-2046550965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:17:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-98b1691a-519f-4893-8bf4-1f7eb25191a1 tempest-VolumesDeleteCascade-2046550965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:17:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-98b1691a-519f-4893-8bf4-1f7eb25191a1 tempest-VolumesDeleteCascade-2046550965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:17:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-98b1691a-519f-4893-8bf4-1f7eb25191a1 tempest-VolumesDeleteCascade-2046550965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:17:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-98b1691a-519f-4893-8bf4-1f7eb25191a1 tempest-VolumesDeleteCascade-2046550965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:17:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-98b1691a-519f-4893-8bf4-1f7eb25191a1 tempest-VolumesDeleteCascade-2046550965 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:17:50 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-98b1691a-519f-4893-8bf4-1f7eb25191a1 tempest-VolumesDeleteCascade-2046550965 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:17:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-98b1691a-519f-4893-8bf4-1f7eb25191a1 tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:17:50 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-c84ffbd8-1838-4981-934b-81d91256d1d4 tempest-TestImageHashVerification-1650486199 None] Copy volume to image completed successfully.
Nov 05 19:17:50 devstack sudo[98437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f 1073741824
Nov 05 19:17:50 devstack sudo[98437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:17:51 devstack sudo[98437]: pam_unix(sudo:session): session closed for user root
Nov 05 19:17:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-98b1691a-519f-4893-8bf4-1f7eb25191a1 tempest-VolumesDeleteCascade-2046550965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f 1073741824" returned: 0 in 0.699s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:17:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-98b1691a-519f-4893-8bf4-1f7eb25191a1 tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:17:51 devstack sudo[98443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f
Nov 05 19:17:51 devstack sudo[98443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:17:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-57da6c12-c1e6-4ae4-b0a7-f7f77262a839 tempest-TestImageHashVerification-1650486199 None] Acquiring lock "cinder-d70ee974-6bd1-4a9b-a1ac-bf95556730e0-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:17:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-57da6c12-c1e6-4ae4-b0a7-f7f77262a839 tempest-TestImageHashVerification-1650486199 None] Lock "cinder-d70ee974-6bd1-4a9b-a1ac-bf95556730e0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:17:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-57da6c12-c1e6-4ae4-b0a7-f7f77262a839 tempest-TestImageHashVerification-1650486199 None] Acquiring lock "cinder-quobyte-d70ee974-6bd1-4a9b-a1ac-bf95556730e0" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:17:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-57da6c12-c1e6-4ae4-b0a7-f7f77262a839 tempest-TestImageHashVerification-1650486199 None] Lock "cinder-quobyte-d70ee974-6bd1-4a9b-a1ac-bf95556730e0" acquired by "delete_volume" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:17:51 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2e4bf9-7671-4143-ad9d-8ca816c9e796]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:17:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-57da6c12-c1e6-4ae4-b0a7-f7f77262a839 tempest-TestImageHashVerification-1650486199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d70ee974-6bd1-4a9b-a1ac-bf95556730e0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:17:51 devstack sudo[98443]: pam_unix(sudo:session): session closed for user root
Nov 05 19:17:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-98b1691a-519f-4893-8bf4-1f7eb25191a1 tempest-VolumesDeleteCascade-2046550965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f" returned: 0 in 0.384s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:17:51 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-98b1691a-519f-4893-8bf4-1f7eb25191a1 tempest-VolumesDeleteCascade-2046550965 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:17:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-98b1691a-519f-4893-8bf4-1f7eb25191a1 tempest-VolumesDeleteCascade-2046550965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:17:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-05f6a62e-bc9f-4f05-8329-e371d109fe8a tempest-VolumesActionsTest-2059143216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.166s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:17:51 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-05f6a62e-bc9f-4f05-8329-e371d109fe8a tempest-VolumesActionsTest-2059143216 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2109924657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4d2d6a8-1b4c-4e76-94a5-6934fff57484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9099528e104942ba9973cbeedfc5cc77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:17:46Z,use_quota=True,user_id='c13fb1d7bac04897aa5741a4664a0e17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:17:51 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-05f6a62e-bc9f-4f05-8329-e371d109fe8a tempest-VolumesActionsTest-2059143216 None] Creating volume a4d2d6a8-1b4c-4e76-94a5-6934fff57484 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:17:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-05f6a62e-bc9f-4f05-8329-e371d109fe8a tempest-VolumesActionsTest-2059143216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:17:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-05f6a62e-bc9f-4f05-8329-e371d109fe8a tempest-VolumesActionsTest-2059143216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:17:51 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-05f6a62e-bc9f-4f05-8329-e371d109fe8a tempest-VolumesActionsTest-2059143216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:17:51 devstack sudo[98445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d70ee974-6bd1-4a9b-a1ac-bf95556730e0
Nov 05 19:17:51 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-05f6a62e-bc9f-4f05-8329-e371d109fe8a tempest-VolumesActionsTest-2059143216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:17:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-05f6a62e-bc9f-4f05-8329-e371d109fe8a tempest-VolumesActionsTest-2059143216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:17:51 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-05f6a62e-bc9f-4f05-8329-e371d109fe8a tempest-VolumesActionsTest-2059143216 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:17:51 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-05f6a62e-bc9f-4f05-8329-e371d109fe8a tempest-VolumesActionsTest-2059143216 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:17:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-05f6a62e-bc9f-4f05-8329-e371d109fe8a tempest-VolumesActionsTest-2059143216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4d2d6a8-1b4c-4e76-94a5-6934fff57484 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:17:51 devstack sudo[98445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:17:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-98b1691a-519f-4893-8bf4-1f7eb25191a1 tempest-VolumesDeleteCascade-2046550965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55863c8c-1af7-42ed-9154-5734db4a4e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:17:51 devstack sudo[98448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4d2d6a8-1b4c-4e76-94a5-6934fff57484 1073741824
Nov 05 19:17:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-98b1691a-519f-4893-8bf4-1f7eb25191a1 tempest-VolumesDeleteCascade-2046550965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (855acad2-f799-4b4c-9658-dd359b09e94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:17:51 devstack sudo[98448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:17:51 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-98b1691a-519f-4893-8bf4-1f7eb25191a1 tempest-VolumesDeleteCascade-2046550965 None] Volume volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f (dfc5687c-c4f9-4f16-ac2a-3e71af9f729f): created successfully
Nov 05 19:17:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-98b1691a-519f-4893-8bf4-1f7eb25191a1 tempest-VolumesDeleteCascade-2046550965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (855acad2-f799-4b4c-9658-dd359b09e94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:17:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-98b1691a-519f-4893-8bf4-1f7eb25191a1 tempest-VolumesDeleteCascade-2046550965 None] Flow 'volume_create_manager' (fade6ffe-46fa-4e16-926b-66c510849354) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:17:52 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-98b1691a-519f-4893-8bf4-1f7eb25191a1 tempest-VolumesDeleteCascade-2046550965 None] Created volume successfully.
Nov 05 19:17:52 devstack sudo[98445]: pam_unix(sudo:session): session closed for user root
Nov 05 19:17:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-57da6c12-c1e6-4ae4-b0a7-f7f77262a839 tempest-TestImageHashVerification-1650486199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d70ee974-6bd1-4a9b-a1ac-bf95556730e0" returned: 0 in 0.619s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:17:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-57da6c12-c1e6-4ae4-b0a7-f7f77262a839 tempest-TestImageHashVerification-1650486199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d70ee974-6bd1-4a9b-a1ac-bf95556730e0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:17:52 devstack sudo[98457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d70ee974-6bd1-4a9b-a1ac-bf95556730e0
Nov 05 19:17:52 devstack sudo[98457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:17:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-729a87e4-1717-4d83-86ba-921a53f9419c tempest-VolumesDeleteCascade-2046550965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:17:52 devstack sudo[98448]: pam_unix(sudo:session): session closed for user root
Nov 05 19:17:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-05f6a62e-bc9f-4f05-8329-e371d109fe8a tempest-VolumesActionsTest-2059143216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4d2d6a8-1b4c-4e76-94a5-6934fff57484 1073741824" returned: 0 in 0.719s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:17:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-05f6a62e-bc9f-4f05-8329-e371d109fe8a tempest-VolumesActionsTest-2059143216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4d2d6a8-1b4c-4e76-94a5-6934fff57484 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:17:52 devstack sudo[98457]: pam_unix(sudo:session): session closed for user root
Nov 05 19:17:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-57da6c12-c1e6-4ae4-b0a7-f7f77262a839 tempest-TestImageHashVerification-1650486199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d70ee974-6bd1-4a9b-a1ac-bf95556730e0" returned: 0 in 0.345s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:17:52 devstack sudo[98461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4d2d6a8-1b4c-4e76-94a5-6934fff57484
Nov 05 19:17:52 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:17:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-57da6c12-c1e6-4ae4-b0a7-f7f77262a839 tempest-TestImageHashVerification-1650486199 None] Lock "cinder-quobyte-d70ee974-6bd1-4a9b-a1ac-bf95556730e0" released by "delete_volume" :: held 1.025s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:17:52 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-57da6c12-c1e6-4ae4-b0a7-f7f77262a839 tempest-TestImageHashVerification-1650486199 None] Created reservations ['55586bac-7397-46e4-99b1-3257b5b905ea', '3a33c231-3c2c-4f2b-b5ba-f8afa4b85d59', 'cf70b8c7-95f1-4374-9fad-d6c7371486e3', 'ce38d501-3bea-41ed-8834-626c9383e686'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:17:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-57da6c12-c1e6-4ae4-b0a7-f7f77262a839 tempest-TestImageHashVerification-1650486199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:17:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-57da6c12-c1e6-4ae4-b0a7-f7f77262a839 tempest-TestImageHashVerification-1650486199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:17:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-57da6c12-c1e6-4ae4-b0a7-f7f77262a839 tempest-TestImageHashVerification-1650486199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:17:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-57da6c12-c1e6-4ae4-b0a7-f7f77262a839 tempest-TestImageHashVerification-1650486199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:17:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-57da6c12-c1e6-4ae4-b0a7-f7f77262a839 tempest-TestImageHashVerification-1650486199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:17:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-57da6c12-c1e6-4ae4-b0a7-f7f77262a839 tempest-TestImageHashVerification-1650486199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:17:52 devstack sudo[98463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:17:52 devstack sudo[98463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:17:53 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root
Nov 05 19:17:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-05f6a62e-bc9f-4f05-8329-e371d109fe8a tempest-VolumesActionsTest-2059143216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4d2d6a8-1b4c-4e76-94a5-6934fff57484" returned: 0 in 0.408s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:17:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-05f6a62e-bc9f-4f05-8329-e371d109fe8a tempest-VolumesActionsTest-2059143216 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:17:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-05f6a62e-bc9f-4f05-8329-e371d109fe8a tempest-VolumesActionsTest-2059143216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:17:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-729a87e4-1717-4d83-86ba-921a53f9419c tempest-VolumesDeleteCascade-2046550965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.508s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:17:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-05f6a62e-bc9f-4f05-8329-e371d109fe8a tempest-VolumesActionsTest-2059143216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (584281d8-9d05-4dfc-a82f-cbe2799170eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4d2d6a8-1b4c-4e76-94a5-6934fff57484', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:17:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-05f6a62e-bc9f-4f05-8329-e371d109fe8a tempest-VolumesActionsTest-2059143216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f673ed6-93ff-49cc-bead-f1d4dd50bddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:17:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-729a87e4-1717-4d83-86ba-921a53f9419c tempest-VolumesDeleteCascade-2046550965 None] Creating offline snapshot bcdbaff8-8613-4c7f-8136-d712d4631f38 of volume dfc5687c-c4f9-4f16-ac2a-3e71af9f729f {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:17:53 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-05f6a62e-bc9f-4f05-8329-e371d109fe8a tempest-VolumesActionsTest-2059143216 None] Volume volume-a4d2d6a8-1b4c-4e76-94a5-6934fff57484 (a4d2d6a8-1b4c-4e76-94a5-6934fff57484): created successfully
Nov 05 19:17:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-05f6a62e-bc9f-4f05-8329-e371d109fe8a tempest-VolumesActionsTest-2059143216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f673ed6-93ff-49cc-bead-f1d4dd50bddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:17:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-05f6a62e-bc9f-4f05-8329-e371d109fe8a tempest-VolumesActionsTest-2059143216 None] Flow 'volume_create_manager' (9ee3101b-8ae2-43ed-806f-579715113a1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:17:53 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[373e3d5d-79b7-4a3e-a731-80ce80466205]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:17:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-729a87e4-1717-4d83-86ba-921a53f9419c tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:17:53 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-05f6a62e-bc9f-4f05-8329-e371d109fe8a tempest-VolumesActionsTest-2059143216 None] Created volume successfully.
Nov 05 19:17:53 devstack sudo[98463]: pam_unix(sudo:session): session closed for user root
Nov 05 19:17:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-57da6c12-c1e6-4ae4-b0a7-f7f77262a839 tempest-TestImageHashVerification-1650486199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.314s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:17:53 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-57da6c12-c1e6-4ae4-b0a7-f7f77262a839 tempest-TestImageHashVerification-1650486199 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:17:53 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-57da6c12-c1e6-4ae4-b0a7-f7f77262a839 tempest-TestImageHashVerification-1650486199 None] Deleted volume successfully.
Nov 05 19:17:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-57da6c12-c1e6-4ae4-b0a7-f7f77262a839 tempest-TestImageHashVerification-1650486199 None] Lock "cinder-d70ee974-6bd1-4a9b-a1ac-bf95556730e0-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:17:53 devstack sudo[98466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f
Nov 05 19:17:53 devstack sudo[98466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:17:53 devstack sudo[98466]: pam_unix(sudo:session): session closed for user root
Nov 05 19:17:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-729a87e4-1717-4d83-86ba-921a53f9419c tempest-VolumesDeleteCascade-2046550965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f" returned: 0 in 0.449s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:17:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-729a87e4-1717-4d83-86ba-921a53f9419c tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.bcdbaff8-8613-4c7f-8136-d712d4631f38 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:17:53 devstack sudo[98472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.bcdbaff8-8613-4c7f-8136-d712d4631f38 1G
Nov 05 19:17:53 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:17:54 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root
Nov 05 19:17:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-729a87e4-1717-4d83-86ba-921a53f9419c tempest-VolumesDeleteCascade-2046550965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.bcdbaff8-8613-4c7f-8136-d712d4631f38 1G" returned: 0 in 0.491s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:17:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-729a87e4-1717-4d83-86ba-921a53f9419c tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.bcdbaff8-8613-4c7f-8136-d712d4631f38 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:17:54 devstack sudo[98478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.bcdbaff8-8613-4c7f-8136-d712d4631f38
Nov 05 19:17:54 devstack sudo[98478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:17:54 devstack sudo[98478]: pam_unix(sudo:session): session closed for user root
Nov 05 19:17:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-729a87e4-1717-4d83-86ba-921a53f9419c tempest-VolumesDeleteCascade-2046550965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.bcdbaff8-8613-4c7f-8136-d712d4631f38" returned: 0 in 0.344s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:17:54 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-729a87e4-1717-4d83-86ba-921a53f9419c tempest-VolumesDeleteCascade-2046550965 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.bcdbaff8-8613-4c7f-8136-d712d4631f38 is being set with open permissions: ugo+rw
Nov 05 19:17:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-729a87e4-1717-4d83-86ba-921a53f9419c tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.bcdbaff8-8613-4c7f-8136-d712d4631f38 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:17:54 devstack sudo[98483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.bcdbaff8-8613-4c7f-8136-d712d4631f38
Nov 05 19:17:54 devstack sudo[98483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:17:54 devstack sudo[98483]: pam_unix(sudo:session): session closed for user root
Nov 05 19:17:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-729a87e4-1717-4d83-86ba-921a53f9419c tempest-VolumesDeleteCascade-2046550965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.bcdbaff8-8613-4c7f-8136-d712d4631f38" returned: 0 in 0.279s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:17:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-729a87e4-1717-4d83-86ba-921a53f9419c tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:17:54 devstack sudo[98486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.info
Nov 05 19:17:54 devstack sudo[98486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:17:55 devstack sudo[98486]: pam_unix(sudo:session): session closed for user root
Nov 05 19:17:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-729a87e4-1717-4d83-86ba-921a53f9419c tempest-VolumesDeleteCascade-2046550965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.info" returned: 0 in 0.320s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:17:55 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-729a87e4-1717-4d83-86ba-921a53f9419c tempest-VolumesDeleteCascade-2046550965 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.info is being set with open permissions: ugo+rw
Nov 05 19:17:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-729a87e4-1717-4d83-86ba-921a53f9419c tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:17:55 devstack sudo[98489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.info
Nov 05 19:17:55 devstack sudo[98489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:17:55 devstack sudo[98489]: pam_unix(sudo:session): session closed for user root
Nov 05 19:17:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-729a87e4-1717-4d83-86ba-921a53f9419c tempest-VolumesDeleteCascade-2046550965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.info" returned: 0 in 0.253s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:17:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-729a87e4-1717-4d83-86ba-921a53f9419c tempest-VolumesDeleteCascade-2046550965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.301s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:17:55 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-729a87e4-1717-4d83-86ba-921a53f9419c tempest-VolumesDeleteCascade-2046550965 None] Create snapshot completed successfully
Nov 05 19:17:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a410246e-f6da-459d-9b04-11f8e352bfec tempest-VolumesDeleteCascade-2046550965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:17:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a410246e-f6da-459d-9b04-11f8e352bfec tempest-VolumesDeleteCascade-2046550965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:17:56 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-a410246e-f6da-459d-9b04-11f8e352bfec tempest-VolumesDeleteCascade-2046550965 None] Creating offline snapshot c2b375b7-e746-4908-b0b0-b050cf8862af of volume dfc5687c-c4f9-4f16-ac2a-3e71af9f729f {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:17:56 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ca444f-ff16-4d73-82ee-ec5560f20d9b]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:17:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a410246e-f6da-459d-9b04-11f8e352bfec tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.bcdbaff8-8613-4c7f-8136-d712d4631f38 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:17:56 devstack sudo[98493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.bcdbaff8-8613-4c7f-8136-d712d4631f38
Nov 05 19:17:56 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:17:56 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root
Nov 05 19:17:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a410246e-f6da-459d-9b04-11f8e352bfec tempest-VolumesDeleteCascade-2046550965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.bcdbaff8-8613-4c7f-8136-d712d4631f38" returned: 0 in 0.543s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:17:56 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-a410246e-f6da-459d-9b04-11f8e352bfec tempest-VolumesDeleteCascade-2046550965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:17:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a410246e-f6da-459d-9b04-11f8e352bfec tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.bcdbaff8-8613-4c7f-8136-d712d4631f38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.c2b375b7-e746-4908-b0b0-b050cf8862af 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:17:56 devstack sudo[98501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.bcdbaff8-8613-4c7f-8136-d712d4631f38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.c2b375b7-e746-4908-b0b0-b050cf8862af 1G
Nov 05 19:17:56 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:17:57 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root
Nov 05 19:17:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a410246e-f6da-459d-9b04-11f8e352bfec tempest-VolumesDeleteCascade-2046550965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.bcdbaff8-8613-4c7f-8136-d712d4631f38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.c2b375b7-e746-4908-b0b0-b050cf8862af 1G" returned: 0 in 0.629s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:17:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a410246e-f6da-459d-9b04-11f8e352bfec tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.bcdbaff8-8613-4c7f-8136-d712d4631f38 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.c2b375b7-e746-4908-b0b0-b050cf8862af {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:17:57 devstack sudo[98508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.bcdbaff8-8613-4c7f-8136-d712d4631f38 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.c2b375b7-e746-4908-b0b0-b050cf8862af
Nov 05 19:17:57 devstack sudo[98508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:17:57 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2b2517f-16c1-462e-8536-79973e81a1ac tempest-TestServerVolumeAttachmentScenario-2143879364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:17:57 devstack sudo[98508]: pam_unix(sudo:session): session closed for user root
Nov 05 19:17:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b2b2517f-16c1-462e-8536-79973e81a1ac tempest-TestServerVolumeAttachmentScenario-2143879364 None] Flow 'volume_create_manager' (f03ecac6-9b6c-4b7c-a148-740b14c1ac4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:17:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b2b2517f-16c1-462e-8536-79973e81a1ac tempest-TestServerVolumeAttachmentScenario-2143879364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08223192-fcde-45fc-bdae-85e2727fafe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:17:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a410246e-f6da-459d-9b04-11f8e352bfec tempest-VolumesDeleteCascade-2046550965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.bcdbaff8-8613-4c7f-8136-d712d4631f38 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.c2b375b7-e746-4908-b0b0-b050cf8862af" returned: 0 in 0.612s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:17:57 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-a410246e-f6da-459d-9b04-11f8e352bfec tempest-VolumesDeleteCascade-2046550965 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.c2b375b7-e746-4908-b0b0-b050cf8862af is being set with open permissions: ugo+rw
Nov 05 19:17:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a410246e-f6da-459d-9b04-11f8e352bfec tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.c2b375b7-e746-4908-b0b0-b050cf8862af {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:17:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b2b2517f-16c1-462e-8536-79973e81a1ac tempest-TestServerVolumeAttachmentScenario-2143879364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08223192-fcde-45fc-bdae-85e2727fafe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2107600961',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=576ab429-1b58-4421-84cf-7c34ed96bf14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca96ce73628044228a2837ba2c6c7211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:17:58Z,use_quota=True,user_id='f7ba3d035533445087d31c9c503ecb61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:17:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b2b2517f-16c1-462e-8536-79973e81a1ac tempest-TestServerVolumeAttachmentScenario-2143879364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f712edf4-a27c-4bd4-bddc-37ffd04404e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:17:57 devstack sudo[98516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.c2b375b7-e746-4908-b0b0-b050cf8862af
Nov 05 19:17:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b2b2517f-16c1-462e-8536-79973e81a1ac tempest-TestServerVolumeAttachmentScenario-2143879364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f712edf4-a27c-4bd4-bddc-37ffd04404e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:17:57 devstack sudo[98516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:17:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b2b2517f-16c1-462e-8536-79973e81a1ac tempest-TestServerVolumeAttachmentScenario-2143879364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (854b8207-d32a-4d80-ab7f-af1d6b603602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:17:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b2b2517f-16c1-462e-8536-79973e81a1ac tempest-TestServerVolumeAttachmentScenario-2143879364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (854b8207-d32a-4d80-ab7f-af1d6b603602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '576ab429-1b58-4421-84cf-7c34ed96bf14', 'volume_name': 'volume-576ab429-1b58-4421-84cf-7c34ed96bf14', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:17:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b2b2517f-16c1-462e-8536-79973e81a1ac tempest-TestServerVolumeAttachmentScenario-2143879364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d4b9f7d-a423-480d-bfab-98ae048f9c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:17:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b2b2517f-16c1-462e-8536-79973e81a1ac tempest-TestServerVolumeAttachmentScenario-2143879364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d4b9f7d-a423-480d-bfab-98ae048f9c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:17:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b2b2517f-16c1-462e-8536-79973e81a1ac tempest-TestServerVolumeAttachmentScenario-2143879364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa79ba75-b64d-4c27-bdc7-8de44ba228a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:17:57 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-b2b2517f-16c1-462e-8536-79973e81a1ac tempest-TestServerVolumeAttachmentScenario-2143879364 None] Volume 576ab429-1b58-4421-84cf-7c34ed96bf14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-576ab429-1b58-4421-84cf-7c34ed96bf14', 'volume_size': 1}
Nov 05 19:17:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b2b2517f-16c1-462e-8536-79973e81a1ac tempest-TestServerVolumeAttachmentScenario-2143879364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:17:58 devstack sudo[98516]: pam_unix(sudo:session): session closed for user root
Nov 05 19:17:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a410246e-f6da-459d-9b04-11f8e352bfec tempest-VolumesDeleteCascade-2046550965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.c2b375b7-e746-4908-b0b0-b050cf8862af" returned: 0 in 0.354s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:17:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a410246e-f6da-459d-9b04-11f8e352bfec tempest-VolumesDeleteCascade-2046550965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.294s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:17:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b2b2517f-16c1-462e-8536-79973e81a1ac tempest-TestServerVolumeAttachmentScenario-2143879364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.335s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:17:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b2b2517f-16c1-462e-8536-79973e81a1ac tempest-TestServerVolumeAttachmentScenario-2143879364 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2107600961',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=576ab429-1b58-4421-84cf-7c34ed96bf14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca96ce73628044228a2837ba2c6c7211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:17:58Z,use_quota=True,user_id='f7ba3d035533445087d31c9c503ecb61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:17:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-b2b2517f-16c1-462e-8536-79973e81a1ac tempest-TestServerVolumeAttachmentScenario-2143879364 None] Creating volume 576ab429-1b58-4421-84cf-7c34ed96bf14 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:17:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b2b2517f-16c1-462e-8536-79973e81a1ac tempest-TestServerVolumeAttachmentScenario-2143879364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:17:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b2b2517f-16c1-462e-8536-79973e81a1ac tempest-TestServerVolumeAttachmentScenario-2143879364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:17:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b2b2517f-16c1-462e-8536-79973e81a1ac tempest-TestServerVolumeAttachmentScenario-2143879364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:17:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b2b2517f-16c1-462e-8536-79973e81a1ac tempest-TestServerVolumeAttachmentScenario-2143879364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:17:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b2b2517f-16c1-462e-8536-79973e81a1ac tempest-TestServerVolumeAttachmentScenario-2143879364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:17:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b2b2517f-16c1-462e-8536-79973e81a1ac tempest-TestServerVolumeAttachmentScenario-2143879364 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:17:58 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-b2b2517f-16c1-462e-8536-79973e81a1ac tempest-TestServerVolumeAttachmentScenario-2143879364 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:17:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b2b2517f-16c1-462e-8536-79973e81a1ac tempest-TestServerVolumeAttachmentScenario-2143879364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-576ab429-1b58-4421-84cf-7c34ed96bf14 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:17:58 devstack sudo[98519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-576ab429-1b58-4421-84cf-7c34ed96bf14 1073741824
Nov 05 19:17:58 devstack sudo[98519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:17:58 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-a410246e-f6da-459d-9b04-11f8e352bfec tempest-VolumesDeleteCascade-2046550965 None] Create snapshot completed successfully
Nov 05 19:17:58 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-e220857b-3261-4069-89ca-1d52c9c18c7d tempest-TestServerVolumeAttachmentScenario-2143879364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:17:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e220857b-3261-4069-89ca-1d52c9c18c7d tempest-TestServerVolumeAttachmentScenario-2143879364 None] Flow 'volume_create_manager' (abb8faf5-0427-4030-891b-f963b9740276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:17:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e220857b-3261-4069-89ca-1d52c9c18c7d tempest-TestServerVolumeAttachmentScenario-2143879364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6244a8ad-a685-427d-97e1-9164283fc36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:17:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e220857b-3261-4069-89ca-1d52c9c18c7d tempest-TestServerVolumeAttachmentScenario-2143879364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6244a8ad-a685-427d-97e1-9164283fc36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1698370802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dabe7fcc-6013-41b0-aa53-a8ee0cf89454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca96ce73628044228a2837ba2c6c7211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:17:58Z,use_quota=True,user_id='f7ba3d035533445087d31c9c503ecb61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:17:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e220857b-3261-4069-89ca-1d52c9c18c7d tempest-TestServerVolumeAttachmentScenario-2143879364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04be7230-230d-49fd-880d-33c353d79e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:17:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e220857b-3261-4069-89ca-1d52c9c18c7d tempest-TestServerVolumeAttachmentScenario-2143879364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04be7230-230d-49fd-880d-33c353d79e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:17:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e220857b-3261-4069-89ca-1d52c9c18c7d tempest-TestServerVolumeAttachmentScenario-2143879364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19671679-90a1-4e87-a76b-87436fc55db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:17:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e220857b-3261-4069-89ca-1d52c9c18c7d tempest-TestServerVolumeAttachmentScenario-2143879364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19671679-90a1-4e87-a76b-87436fc55db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dabe7fcc-6013-41b0-aa53-a8ee0cf89454', 'volume_name': 'volume-dabe7fcc-6013-41b0-aa53-a8ee0cf89454', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:17:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e220857b-3261-4069-89ca-1d52c9c18c7d tempest-TestServerVolumeAttachmentScenario-2143879364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ab46e1c-4bc5-41b6-aed4-08bebff06795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:17:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e220857b-3261-4069-89ca-1d52c9c18c7d tempest-TestServerVolumeAttachmentScenario-2143879364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ab46e1c-4bc5-41b6-aed4-08bebff06795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:17:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e220857b-3261-4069-89ca-1d52c9c18c7d tempest-TestServerVolumeAttachmentScenario-2143879364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69c9a75d-6b9c-4129-a515-e7df26185fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:17:58 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-e220857b-3261-4069-89ca-1d52c9c18c7d tempest-TestServerVolumeAttachmentScenario-2143879364 None] Volume dabe7fcc-6013-41b0-aa53-a8ee0cf89454: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dabe7fcc-6013-41b0-aa53-a8ee0cf89454', 'volume_size': 1}
Nov 05 19:17:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e220857b-3261-4069-89ca-1d52c9c18c7d tempest-TestServerVolumeAttachmentScenario-2143879364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:17:59 devstack sudo[98519]: pam_unix(sudo:session): session closed for user root
Nov 05 19:17:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b2b2517f-16c1-462e-8536-79973e81a1ac tempest-TestServerVolumeAttachmentScenario-2143879364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-576ab429-1b58-4421-84cf-7c34ed96bf14 1073741824" returned: 0 in 0.873s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:17:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b2b2517f-16c1-462e-8536-79973e81a1ac tempest-TestServerVolumeAttachmentScenario-2143879364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-576ab429-1b58-4421-84cf-7c34ed96bf14 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:17:59 devstack sudo[98525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-576ab429-1b58-4421-84cf-7c34ed96bf14
Nov 05 19:17:59 devstack sudo[98525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:17:59 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Acquiring lock "cinder-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:17:59 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Lock "cinder-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:17:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Performing cascade delete. {{(pid=87184) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Nov 05 19:17:59 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Acquiring lock "cinder-bcdbaff8-8613-4c7f-8136-d712d4631f38-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:17:59 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Lock "cinder-bcdbaff8-8613-4c7f-8136-d712d4631f38-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:17:59 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Acquiring lock "cinder-quobyte-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:17:59 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Lock "cinder-quobyte-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:17:59 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Acquiring lock "cinder-quobyte-bcdbaff8-8613-4c7f-8136-d712d4631f38" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:17:59 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Lock "cinder-quobyte-bcdbaff8-8613-4c7f-8136-d712d4631f38" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:17:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Deleting offline snapshot bcdbaff8-8613-4c7f-8136-d712d4631f38 of volume dfc5687c-c4f9-4f16-ac2a-3e71af9f729f {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:17:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] snapshot_file for this snap is: volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.bcdbaff8-8613-4c7f-8136-d712d4631f38 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:17:59 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c285f0db-07d9-42cb-a61e-5186163bebdf]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:17:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.bcdbaff8-8613-4c7f-8136-d712d4631f38 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:17:59 devstack sudo[98525]: pam_unix(sudo:session): session closed for user root
Nov 05 19:17:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b2b2517f-16c1-462e-8536-79973e81a1ac tempest-TestServerVolumeAttachmentScenario-2143879364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-576ab429-1b58-4421-84cf-7c34ed96bf14" returned: 0 in 0.414s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:17:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b2b2517f-16c1-462e-8536-79973e81a1ac tempest-TestServerVolumeAttachmentScenario-2143879364 None] <== create_volume: return (1365ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:17:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b2b2517f-16c1-462e-8536-79973e81a1ac tempest-TestServerVolumeAttachmentScenario-2143879364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.371s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:17:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e220857b-3261-4069-89ca-1d52c9c18c7d tempest-TestServerVolumeAttachmentScenario-2143879364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.143s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:17:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e220857b-3261-4069-89ca-1d52c9c18c7d tempest-TestServerVolumeAttachmentScenario-2143879364 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1698370802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dabe7fcc-6013-41b0-aa53-a8ee0cf89454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca96ce73628044228a2837ba2c6c7211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:17:58Z,use_quota=True,user_id='f7ba3d035533445087d31c9c503ecb61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:17:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-e220857b-3261-4069-89ca-1d52c9c18c7d tempest-TestServerVolumeAttachmentScenario-2143879364 None] Creating volume dabe7fcc-6013-41b0-aa53-a8ee0cf89454 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:17:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e220857b-3261-4069-89ca-1d52c9c18c7d tempest-TestServerVolumeAttachmentScenario-2143879364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:17:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e220857b-3261-4069-89ca-1d52c9c18c7d tempest-TestServerVolumeAttachmentScenario-2143879364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:17:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e220857b-3261-4069-89ca-1d52c9c18c7d tempest-TestServerVolumeAttachmentScenario-2143879364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:17:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e220857b-3261-4069-89ca-1d52c9c18c7d tempest-TestServerVolumeAttachmentScenario-2143879364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:17:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e220857b-3261-4069-89ca-1d52c9c18c7d tempest-TestServerVolumeAttachmentScenario-2143879364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:17:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e220857b-3261-4069-89ca-1d52c9c18c7d tempest-TestServerVolumeAttachmentScenario-2143879364 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:17:59 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-e220857b-3261-4069-89ca-1d52c9c18c7d tempest-TestServerVolumeAttachmentScenario-2143879364 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:17:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e220857b-3261-4069-89ca-1d52c9c18c7d tempest-TestServerVolumeAttachmentScenario-2143879364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dabe7fcc-6013-41b0-aa53-a8ee0cf89454 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:17:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b2b2517f-16c1-462e-8536-79973e81a1ac tempest-TestServerVolumeAttachmentScenario-2143879364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa79ba75-b64d-4c27-bdc7-8de44ba228a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-576ab429-1b58-4421-84cf-7c34ed96bf14', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:17:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b2b2517f-16c1-462e-8536-79973e81a1ac tempest-TestServerVolumeAttachmentScenario-2143879364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3e42d56-8c3b-489d-966d-85722f0d9de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:17:59 devstack sudo[98529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dabe7fcc-6013-41b0-aa53-a8ee0cf89454 1073741824
Nov 05 19:17:59 devstack sudo[98529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:17:59 devstack sudo[98528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.bcdbaff8-8613-4c7f-8136-d712d4631f38
Nov 05 19:17:59 devstack sudo[98528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:17:59 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-b2b2517f-16c1-462e-8536-79973e81a1ac tempest-TestServerVolumeAttachmentScenario-2143879364 None] Volume volume-576ab429-1b58-4421-84cf-7c34ed96bf14 (576ab429-1b58-4421-84cf-7c34ed96bf14): created successfully
Nov 05 19:17:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b2b2517f-16c1-462e-8536-79973e81a1ac tempest-TestServerVolumeAttachmentScenario-2143879364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3e42d56-8c3b-489d-966d-85722f0d9de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:17:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b2b2517f-16c1-462e-8536-79973e81a1ac tempest-TestServerVolumeAttachmentScenario-2143879364 None] Flow 'volume_create_manager' (f03ecac6-9b6c-4b7c-a148-740b14c1ac4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:17:59 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b2b2517f-16c1-462e-8536-79973e81a1ac tempest-TestServerVolumeAttachmentScenario-2143879364 None] Created volume successfully.
Nov 05 19:18:00 devstack sudo[98528]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.bcdbaff8-8613-4c7f-8136-d712d4631f38" returned: 0 in 0.622s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:18:00 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7de540-7617-4076-ad53-77a56494210e]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:18:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:00 devstack sudo[98542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f
Nov 05 19:18:00 devstack sudo[98542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:00 devstack sudo[98529]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e220857b-3261-4069-89ca-1d52c9c18c7d tempest-TestServerVolumeAttachmentScenario-2143879364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dabe7fcc-6013-41b0-aa53-a8ee0cf89454 1073741824" returned: 0 in 0.870s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e220857b-3261-4069-89ca-1d52c9c18c7d tempest-TestServerVolumeAttachmentScenario-2143879364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dabe7fcc-6013-41b0-aa53-a8ee0cf89454 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:00 devstack sudo[98551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dabe7fcc-6013-41b0-aa53-a8ee0cf89454
Nov 05 19:18:00 devstack sudo[98551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:00 devstack sudo[98542]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f" returned: 0 in 0.560s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:00 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a25dd8d-c0f2-48b2-b1b7-b459bea60066]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:18:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.c2b375b7-e746-4908-b0b0-b050cf8862af {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:01 devstack sudo[98551]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e220857b-3261-4069-89ca-1d52c9c18c7d tempest-TestServerVolumeAttachmentScenario-2143879364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dabe7fcc-6013-41b0-aa53-a8ee0cf89454" returned: 0 in 0.387s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e220857b-3261-4069-89ca-1d52c9c18c7d tempest-TestServerVolumeAttachmentScenario-2143879364 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:18:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e220857b-3261-4069-89ca-1d52c9c18c7d tempest-TestServerVolumeAttachmentScenario-2143879364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.357s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:18:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e220857b-3261-4069-89ca-1d52c9c18c7d tempest-TestServerVolumeAttachmentScenario-2143879364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69c9a75d-6b9c-4129-a515-e7df26185fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dabe7fcc-6013-41b0-aa53-a8ee0cf89454', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:18:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e220857b-3261-4069-89ca-1d52c9c18c7d tempest-TestServerVolumeAttachmentScenario-2143879364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f96acdeb-4c5d-46a4-a1a2-1aec0c700e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:18:01 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-e220857b-3261-4069-89ca-1d52c9c18c7d tempest-TestServerVolumeAttachmentScenario-2143879364 None] Volume volume-dabe7fcc-6013-41b0-aa53-a8ee0cf89454 (dabe7fcc-6013-41b0-aa53-a8ee0cf89454): created successfully
Nov 05 19:18:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e220857b-3261-4069-89ca-1d52c9c18c7d tempest-TestServerVolumeAttachmentScenario-2143879364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f96acdeb-4c5d-46a4-a1a2-1aec0c700e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:18:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e220857b-3261-4069-89ca-1d52c9c18c7d tempest-TestServerVolumeAttachmentScenario-2143879364 None] Flow 'volume_create_manager' (abb8faf5-0427-4030-891b-f963b9740276) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:18:01 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-e220857b-3261-4069-89ca-1d52c9c18c7d tempest-TestServerVolumeAttachmentScenario-2143879364 None] Created volume successfully.
Nov 05 19:18:01 devstack sudo[98560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.c2b375b7-e746-4908-b0b0-b050cf8862af
Nov 05 19:18:01 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:01 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.c2b375b7-e746-4908-b0b0-b050cf8862af" returned: 0 in 0.487s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:18:01 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccd6435-44cf-4715-bdd8-80c466509b6d]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:18:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.bcdbaff8-8613-4c7f-8136-d712d4631f38 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:01 devstack sudo[98571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.bcdbaff8-8613-4c7f-8136-d712d4631f38
Nov 05 19:18:01 devstack sudo[98571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:01 devstack sudo[98571]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.bcdbaff8-8613-4c7f-8136-d712d4631f38" returned: 0 in 0.531s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:18:02 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b4f285-b543-4e45-a0d6-025ae2de415a]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:18:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:02 devstack sudo[98577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f
Nov 05 19:18:02 devstack sudo[98577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:02 devstack sudo[98577]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f" returned: 0 in 0.415s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.bcdbaff8-8613-4c7f-8136-d712d4631f38 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:02 devstack sudo[98582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.bcdbaff8-8613-4c7f-8136-d712d4631f38
Nov 05 19:18:02 devstack sudo[98582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:02 devstack sudo[98582]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.bcdbaff8-8613-4c7f-8136-d712d4631f38" returned: 0 in 0.404s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.bcdbaff8-8613-4c7f-8136-d712d4631f38 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:02 devstack sudo[98587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.bcdbaff8-8613-4c7f-8136-d712d4631f38
Nov 05 19:18:02 devstack sudo[98587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:03 devstack sudo[98587]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.bcdbaff8-8613-4c7f-8136-d712d4631f38" returned: 0 in 0.280s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.c2b375b7-e746-4908-b0b0-b050cf8862af -F qcow2 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:03 devstack sudo[98590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.c2b375b7-e746-4908-b0b0-b050cf8862af -F qcow2
Nov 05 19:18:03 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:03 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.c2b375b7-e746-4908-b0b0-b050cf8862af -F qcow2" returned: 0 in 0.357s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Lock "cinder-quobyte-bcdbaff8-8613-4c7f-8136-d712d4631f38" released by "_delete_snapshot" :: held 3.959s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:18:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Lock "cinder-quobyte-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f" released by "delete_snapshot" :: held 3.989s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:18:03 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Created reservations ['a7991304-692f-46ad-8b70-f8279c7665d5', '886eab24-1c5e-463f-8e6a-d48485a04e3c', 'aa2553d1-f4dc-4a2b-8844-1a32f80a6dd8', 'e243e891-a184-4671-b96a-1b953b8059bb'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:18:03 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Delete snapshot completed successfully.
Nov 05 19:18:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Lock "cinder-bcdbaff8-8613-4c7f-8136-d712d4631f38-delete_snapshot" released by "delete_snapshot" :: held 4.175s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:18:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Acquiring lock "cinder-c2b375b7-e746-4908-b0b0-b050cf8862af-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:18:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Lock "cinder-c2b375b7-e746-4908-b0b0-b050cf8862af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:18:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Acquiring lock "cinder-quobyte-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:18:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Lock "cinder-quobyte-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:18:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Acquiring lock "cinder-quobyte-c2b375b7-e746-4908-b0b0-b050cf8862af" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:18:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Lock "cinder-quobyte-c2b375b7-e746-4908-b0b0-b050cf8862af" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:18:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Deleting offline snapshot c2b375b7-e746-4908-b0b0-b050cf8862af of volume dfc5687c-c4f9-4f16-ac2a-3e71af9f729f {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:18:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] snapshot_file for this snap is: volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.c2b375b7-e746-4908-b0b0-b050cf8862af {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:18:03 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e189da0c-0182-4739-9748-9a06e9ac6ab5]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:18:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.c2b375b7-e746-4908-b0b0-b050cf8862af {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:03 devstack sudo[98597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.c2b375b7-e746-4908-b0b0-b050cf8862af
Nov 05 19:18:04 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:04 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.c2b375b7-e746-4908-b0b0-b050cf8862af" returned: 0 in 0.617s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:18:04 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b8626a-002d-4528-abe2-7b7c4f171dfa]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:18:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:04 devstack sudo[98616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f
Nov 05 19:18:04 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:18:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:18:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:18:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:18:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:18:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:18:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:05 devstack sudo[98665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:18:05 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:05 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f" returned: 0 in 0.971s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.c2b375b7-e746-4908-b0b0-b050cf8862af {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:05 devstack sudo[98672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.c2b375b7-e746-4908-b0b0-b050cf8862af
Nov 05 19:18:05 devstack sudo[98672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:06 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.747s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:06 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:18:06 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:18:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread count: 28 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 19:18:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread info: [<_MainThread(MainThread, started 126882883072128)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126882770872512)>, <Thread(Thread-3 (stat_writer), started daemon 126882769837376)>, <Thread(Rabbit-heartbeat, started daemon 126882768896256)>, <Thread(Thread-5 (_runner), started daemon 126882768980928)>, <Thread(Thread-7 (_runner), started daemon 126882767016448)>, <Thread(fd_logger, started daemon 126882764561216)>, <Thread(privsep_reader, started daemon 126882764568576)>, <Thread(tpool_thread_0, started daemon 126882759292608)>, <Thread(tpool_thread_1, started daemon 126882750899904)>, <Thread(tpool_thread_2, started daemon 126882742507200)>, <Thread(tpool_thread_3, started daemon 126882734114496)>, <Thread(tpool_thread_4, started daemon 126882725721792)>, <Thread(tpool_thread_5, started daemon 126882717329088)>, <Thread(tpool_thread_6, started daemon 126882708920000)>, <Thread(tpool_thread_7, started daemon 126882700510912)>, <Thread(tpool_thread_8, started daemon 126882692101824)>, <Thread(tpool_thread_9, started daemon 126882683692736)>, <Thread(tpool_thread_10, started daemon 126882675283648)>, <Thread(tpool_thread_11, started daemon 126882666874560)>, <Thread(tpool_thread_12, started daemon 126882658465472)>, <Thread(tpool_thread_13, started daemon 126882650056384)>, <Thread(tpool_thread_14, started daemon 126882641647296)>, <Thread(tpool_thread_15, started daemon 126882633238208)>, <Thread(tpool_thread_16, started daemon 126882624829120)>, <Thread(tpool_thread_17, started daemon 126882616420032)>, <Thread(tpool_thread_18, started daemon 126882608010944)>, <Thread(tpool_thread_19, started daemon 126882599601856)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 19:18:06 devstack sudo[98672]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.c2b375b7-e746-4908-b0b0-b050cf8862af" returned: 0 in 0.683s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.c2b375b7-e746-4908-b0b0-b050cf8862af {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:06 devstack sudo[98684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.c2b375b7-e746-4908-b0b0-b050cf8862af
Nov 05 19:18:06 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:07 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f.c2b375b7-e746-4908-b0b0-b050cf8862af" returned: 0 in 0.775s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Lock "cinder-quobyte-c2b375b7-e746-4908-b0b0-b050cf8862af" released by "_delete_snapshot" :: held 3.358s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:18:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Lock "cinder-quobyte-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f" released by "delete_snapshot" :: held 3.391s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:18:07 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Created reservations ['5858588f-5d22-4c45-89bc-3cdf809a40ea', '9aa8dd60-e4fd-4b39-a6af-758eb6489052', 'ddcfd498-9af0-4fe9-b299-5f41322adda0', '1ca2e8c1-dd67-4197-a89b-d74cc8d83e26'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:18:07 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Delete snapshot completed successfully.
Nov 05 19:18:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Lock "cinder-c2b375b7-e746-4908-b0b0-b050cf8862af-delete_snapshot" released by "delete_snapshot" :: held 3.744s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:18:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Snapshots deleted, issuing volume delete {{(pid=87184) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Nov 05 19:18:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Acquiring lock "cinder-quobyte-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:18:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Lock "cinder-quobyte-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f" acquired by "delete_volume" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:18:07 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ed2a5b-4814-4389-a312-dc765edad813]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:18:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:07 devstack sudo[98692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f
Nov 05 19:18:07 devstack sudo[98692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:08 devstack sudo[98692]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f" returned: 0 in 0.557s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:08 devstack sudo[98709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f
Nov 05 19:18:08 devstack sudo[98709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:08 devstack sudo[98709]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f" returned: 0 in 0.567s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Lock "cinder-quobyte-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f" released by "delete_volume" :: held 1.273s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:18:08 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Created reservations ['89cf2080-5836-40fa-99db-1442a2f0ca63', '1d472ba5-bc7b-48f8-b618-80f568278586', '1a91f0e7-3383-44a2-b3e3-bf9db4253ff1', '913255a4-2336-4ccb-ab53-2667e1b15389'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:18:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:18:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:18:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:18:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:18:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:18:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:09 devstack sudo[98718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:18:09 devstack sudo[98718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:09 devstack sudo[98718]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.292s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:09 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:18:09 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Deleted volume successfully.
Nov 05 19:18:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2e78275e-920b-445e-8057-983d913c216a tempest-VolumesDeleteCascade-2046550965 None] Lock "cinder-dfc5687c-c4f9-4f16-ac2a-3e71af9f729f-delete_volume" released by "delete_volume" :: held 10.012s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:18:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-be64efbb-64e5-4246-ba07-afb30001de20 tempest-VolumesActionsTest-2059143216 None] Acquiring lock "cinder-a4d2d6a8-1b4c-4e76-94a5-6934fff57484" by "attach_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:18:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-be64efbb-64e5-4246-ba07-afb30001de20 tempest-VolumesActionsTest-2059143216 None] Lock "cinder-a4d2d6a8-1b4c-4e76-94a5-6934fff57484" acquired by "attach_volume" :: waited 0.032s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:18:10 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-be64efbb-64e5-4246-ba07-afb30001de20 tempest-VolumesActionsTest-2059143216 None] Attaching volume a4d2d6a8-1b4c-4e76-94a5-6934fff57484 to instance 957c1ec7-c4c7-4344-a901-935072f933a6 at mountpoint /dev/vdb on host None.
Nov 05 19:18:10 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-be64efbb-64e5-4246-ba07-afb30001de20 tempest-VolumesActionsTest-2059143216 None] Attach volume completed successfully.
Nov 05 19:18:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-be64efbb-64e5-4246-ba07-afb30001de20 tempest-VolumesActionsTest-2059143216 None] Lock "cinder-a4d2d6a8-1b4c-4e76-94a5-6934fff57484" released by "attach_volume" :: held 0.147s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:18:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c6a3e753-164e-42e2-8f8d-2b09a9034ae1 tempest-VolumesActionsTest-2059143216 None] Acquiring lock "cinder-a4d2d6a8-1b4c-4e76-94a5-6934fff57484-detach_volume" by "detach_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:18:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c6a3e753-164e-42e2-8f8d-2b09a9034ae1 tempest-VolumesActionsTest-2059143216 None] Lock "cinder-a4d2d6a8-1b4c-4e76-94a5-6934fff57484-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:18:10 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-c6a3e753-164e-42e2-8f8d-2b09a9034ae1 tempest-VolumesActionsTest-2059143216 None] Detaching volume a4d2d6a8-1b4c-4e76-94a5-6934fff57484 from instance 957c1ec7-c4c7-4344-a901-935072f933a6.
Nov 05 19:18:10 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-c6a3e753-164e-42e2-8f8d-2b09a9034ae1 tempest-VolumesActionsTest-2059143216 None] Detach volume completed successfully.
Nov 05 19:18:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c6a3e753-164e-42e2-8f8d-2b09a9034ae1 tempest-VolumesActionsTest-2059143216 None] Lock "cinder-a4d2d6a8-1b4c-4e76-94a5-6934fff57484-detach_volume" released by "detach_volume" :: held 0.108s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:18:11 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2e643fc-e894-46cb-9637-d413332bb2e0 tempest-VolumesDeleteCascade-2046550965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:18:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e2e643fc-e894-46cb-9637-d413332bb2e0 tempest-VolumesDeleteCascade-2046550965 None] Flow 'volume_create_manager' (1c6ea52b-86d4-4b68-9556-1927af957a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:18:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e2e643fc-e894-46cb-9637-d413332bb2e0 tempest-VolumesDeleteCascade-2046550965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21dbee16-c396-40cc-87b3-cb99b6a32740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:18:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e2e643fc-e894-46cb-9637-d413332bb2e0 tempest-VolumesDeleteCascade-2046550965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21dbee16-c396-40cc-87b3-cb99b6a32740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1855657284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb7de5e1-9346-426b-a947-2bdd35dea72f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48f6ed00672a4db4be8715a188e1077d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:18:11Z,use_quota=True,user_id='3c21ea053b724e50bc8bee7aebb509aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:18:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e2e643fc-e894-46cb-9637-d413332bb2e0 tempest-VolumesDeleteCascade-2046550965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d60f077f-c8ef-455d-920c-55ec8a72c7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:18:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e2e643fc-e894-46cb-9637-d413332bb2e0 tempest-VolumesDeleteCascade-2046550965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d60f077f-c8ef-455d-920c-55ec8a72c7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:18:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e2e643fc-e894-46cb-9637-d413332bb2e0 tempest-VolumesDeleteCascade-2046550965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a5e01c1-ac7d-4663-97c7-9e23729eedd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:18:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e2e643fc-e894-46cb-9637-d413332bb2e0 tempest-VolumesDeleteCascade-2046550965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a5e01c1-ac7d-4663-97c7-9e23729eedd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb7de5e1-9346-426b-a947-2bdd35dea72f', 'volume_name': 'volume-cb7de5e1-9346-426b-a947-2bdd35dea72f', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:18:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e2e643fc-e894-46cb-9637-d413332bb2e0 tempest-VolumesDeleteCascade-2046550965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b23ff573-993a-4ab5-89bf-072ef1765315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:18:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e2e643fc-e894-46cb-9637-d413332bb2e0 tempest-VolumesDeleteCascade-2046550965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b23ff573-993a-4ab5-89bf-072ef1765315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:18:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e2e643fc-e894-46cb-9637-d413332bb2e0 tempest-VolumesDeleteCascade-2046550965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb1cba99-1840-4759-af04-b2359c01689a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:18:11 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-e2e643fc-e894-46cb-9637-d413332bb2e0 tempest-VolumesDeleteCascade-2046550965 None] Volume cb7de5e1-9346-426b-a947-2bdd35dea72f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb7de5e1-9346-426b-a947-2bdd35dea72f', 'volume_size': 1}
Nov 05 19:18:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e2e643fc-e894-46cb-9637-d413332bb2e0 tempest-VolumesDeleteCascade-2046550965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:18:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e2e643fc-e894-46cb-9637-d413332bb2e0 tempest-VolumesDeleteCascade-2046550965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:18:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e2e643fc-e894-46cb-9637-d413332bb2e0 tempest-VolumesDeleteCascade-2046550965 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1855657284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb7de5e1-9346-426b-a947-2bdd35dea72f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48f6ed00672a4db4be8715a188e1077d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:18:11Z,use_quota=True,user_id='3c21ea053b724e50bc8bee7aebb509aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:18:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-e2e643fc-e894-46cb-9637-d413332bb2e0 tempest-VolumesDeleteCascade-2046550965 None] Creating volume cb7de5e1-9346-426b-a947-2bdd35dea72f {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:18:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e2e643fc-e894-46cb-9637-d413332bb2e0 tempest-VolumesDeleteCascade-2046550965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:18:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e2e643fc-e894-46cb-9637-d413332bb2e0 tempest-VolumesDeleteCascade-2046550965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:18:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e2e643fc-e894-46cb-9637-d413332bb2e0 tempest-VolumesDeleteCascade-2046550965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:18:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e2e643fc-e894-46cb-9637-d413332bb2e0 tempest-VolumesDeleteCascade-2046550965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:18:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e2e643fc-e894-46cb-9637-d413332bb2e0 tempest-VolumesDeleteCascade-2046550965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:18:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e2e643fc-e894-46cb-9637-d413332bb2e0 tempest-VolumesDeleteCascade-2046550965 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:18:11 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-e2e643fc-e894-46cb-9637-d413332bb2e0 tempest-VolumesDeleteCascade-2046550965 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:18:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e2e643fc-e894-46cb-9637-d413332bb2e0 tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:11 devstack sudo[98735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f 1073741824
Nov 05 19:18:11 devstack sudo[98735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:12 devstack sudo[98735]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e2e643fc-e894-46cb-9637-d413332bb2e0 tempest-VolumesDeleteCascade-2046550965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f 1073741824" returned: 0 in 0.925s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e2e643fc-e894-46cb-9637-d413332bb2e0 tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:12 devstack sudo[98781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f
Nov 05 19:18:12 devstack sudo[98781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:13 devstack sudo[98781]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e2e643fc-e894-46cb-9637-d413332bb2e0 tempest-VolumesDeleteCascade-2046550965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f" returned: 0 in 0.432s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e2e643fc-e894-46cb-9637-d413332bb2e0 tempest-VolumesDeleteCascade-2046550965 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:18:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e2e643fc-e894-46cb-9637-d413332bb2e0 tempest-VolumesDeleteCascade-2046550965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:18:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e2e643fc-e894-46cb-9637-d413332bb2e0 tempest-VolumesDeleteCascade-2046550965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb1cba99-1840-4759-af04-b2359c01689a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb7de5e1-9346-426b-a947-2bdd35dea72f', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:18:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e2e643fc-e894-46cb-9637-d413332bb2e0 tempest-VolumesDeleteCascade-2046550965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4570072e-ddad-478b-83a5-2732aeedc384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:18:13 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-e2e643fc-e894-46cb-9637-d413332bb2e0 tempest-VolumesDeleteCascade-2046550965 None] Volume volume-cb7de5e1-9346-426b-a947-2bdd35dea72f (cb7de5e1-9346-426b-a947-2bdd35dea72f): created successfully
Nov 05 19:18:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e2e643fc-e894-46cb-9637-d413332bb2e0 tempest-VolumesDeleteCascade-2046550965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4570072e-ddad-478b-83a5-2732aeedc384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:18:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e2e643fc-e894-46cb-9637-d413332bb2e0 tempest-VolumesDeleteCascade-2046550965 None] Flow 'volume_create_manager' (1c6ea52b-86d4-4b68-9556-1927af957a0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:18:13 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-e2e643fc-e894-46cb-9637-d413332bb2e0 tempest-VolumesDeleteCascade-2046550965 None] Created volume successfully.
Nov 05 19:18:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ab7a5f44-d00d-49d1-9f99-3ffc8809be18 tempest-VolumesDeleteCascade-2046550965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:18:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ab7a5f44-d00d-49d1-9f99-3ffc8809be18 tempest-VolumesDeleteCascade-2046550965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:18:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-ab7a5f44-d00d-49d1-9f99-3ffc8809be18 tempest-VolumesDeleteCascade-2046550965 None] Creating offline snapshot 5451e587-d139-4e8d-a347-d86b2b548bed of volume cb7de5e1-9346-426b-a947-2bdd35dea72f {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:18:13 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a86467f-2147-4e13-a883-8d51fdb315b9]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:18:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ab7a5f44-d00d-49d1-9f99-3ffc8809be18 tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:13 devstack sudo[98819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f
Nov 05 19:18:13 devstack sudo[98819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:14 devstack sudo[98819]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ab7a5f44-d00d-49d1-9f99-3ffc8809be18 tempest-VolumesDeleteCascade-2046550965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f" returned: 0 in 0.841s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ab7a5f44-d00d-49d1-9f99-3ffc8809be18 tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f.5451e587-d139-4e8d-a347-d86b2b548bed 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:14 devstack sudo[98830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f.5451e587-d139-4e8d-a347-d86b2b548bed 1G
Nov 05 19:18:14 devstack sudo[98830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:15 devstack sudo[98830]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ab7a5f44-d00d-49d1-9f99-3ffc8809be18 tempest-VolumesDeleteCascade-2046550965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f.5451e587-d139-4e8d-a347-d86b2b548bed 1G" returned: 0 in 0.828s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ab7a5f44-d00d-49d1-9f99-3ffc8809be18 tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb7de5e1-9346-426b-a947-2bdd35dea72f -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f.5451e587-d139-4e8d-a347-d86b2b548bed {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:15 devstack sudo[98835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb7de5e1-9346-426b-a947-2bdd35dea72f -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f.5451e587-d139-4e8d-a347-d86b2b548bed
Nov 05 19:18:15 devstack sudo[98835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:16 devstack sudo[98835]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ab7a5f44-d00d-49d1-9f99-3ffc8809be18 tempest-VolumesDeleteCascade-2046550965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb7de5e1-9346-426b-a947-2bdd35dea72f -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f.5451e587-d139-4e8d-a347-d86b2b548bed" returned: 0 in 0.663s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:16 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-ab7a5f44-d00d-49d1-9f99-3ffc8809be18 tempest-VolumesDeleteCascade-2046550965 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f.5451e587-d139-4e8d-a347-d86b2b548bed is being set with open permissions: ugo+rw
Nov 05 19:18:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ab7a5f44-d00d-49d1-9f99-3ffc8809be18 tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f.5451e587-d139-4e8d-a347-d86b2b548bed {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:16 devstack sudo[98840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f.5451e587-d139-4e8d-a347-d86b2b548bed
Nov 05 19:18:16 devstack sudo[98840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:16 devstack sudo[98840]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ab7a5f44-d00d-49d1-9f99-3ffc8809be18 tempest-VolumesDeleteCascade-2046550965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f.5451e587-d139-4e8d-a347-d86b2b548bed" returned: 0 in 0.287s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ab7a5f44-d00d-49d1-9f99-3ffc8809be18 tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:16 devstack sudo[98843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f.info
Nov 05 19:18:16 devstack sudo[98843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:16 devstack sudo[98843]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ab7a5f44-d00d-49d1-9f99-3ffc8809be18 tempest-VolumesDeleteCascade-2046550965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f.info" returned: 0 in 0.465s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:16 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-ab7a5f44-d00d-49d1-9f99-3ffc8809be18 tempest-VolumesDeleteCascade-2046550965 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f.info is being set with open permissions: ugo+rw
Nov 05 19:18:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ab7a5f44-d00d-49d1-9f99-3ffc8809be18 tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:16 devstack sudo[98846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f.info
Nov 05 19:18:16 devstack sudo[98846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:17 devstack sudo[98846]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ab7a5f44-d00d-49d1-9f99-3ffc8809be18 tempest-VolumesDeleteCascade-2046550965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f.info" returned: 0 in 0.485s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ab7a5f44-d00d-49d1-9f99-3ffc8809be18 tempest-VolumesDeleteCascade-2046550965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.757s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:18:17 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-ab7a5f44-d00d-49d1-9f99-3ffc8809be18 tempest-VolumesDeleteCascade-2046550965 None] Create snapshot completed successfully
Nov 05 19:18:18 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:18:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Flow 'volume_create_manager' (66a43bae-4d59-473c-a30f-85bfa6286edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:18:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9caea88-29b8-4fd0-8864-60b8b4e48fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:18:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9caea88-29b8-4fd0-8864-60b8b4e48fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:18:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1635911881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16571bea-fcca-4c6d-8dd3-db6b1de5422f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48f6ed00672a4db4be8715a188e1077d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:18:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5451e587-d139-4e8d-a347-d86b2b548bed,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:18:19Z,use_quota=True,user_id='3c21ea053b724e50bc8bee7aebb509aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:18:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (224cc3f7-64f0-4d35-a404-4bc22263ea72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:18:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (224cc3f7-64f0-4d35-a404-4bc22263ea72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:18:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f011b24-e9e0-4b09-ab11-20b6a7bd290f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:18:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f011b24-e9e0-4b09-ab11-20b6a7bd290f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '16571bea-fcca-4c6d-8dd3-db6b1de5422f', 'volume_name': 'volume-16571bea-fcca-4c6d-8dd3-db6b1de5422f', 'volume_size': 1, 'snapshot_id': '5451e587-d139-4e8d-a347-d86b2b548bed'}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:18:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6442d9e7-5c06-44cb-ac44-768c0423e7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:18:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6442d9e7-5c06-44cb-ac44-768c0423e7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:18:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (362f5325-21ab-4e4c-9a82-71ffdcc97cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:18:18 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Volume 16571bea-fcca-4c6d-8dd3-db6b1de5422f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-16571bea-fcca-4c6d-8dd3-db6b1de5422f', 'volume_size': 1, 'snapshot_id': '5451e587-d139-4e8d-a347-d86b2b548bed'}
Nov 05 19:18:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:18:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:18:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Acquiring lock "cinder-quobyte-5451e587-d139-4e8d-a347-d86b2b548bed-16571bea-fcca-4c6d-8dd3-db6b1de5422f" by "_create_volume_from_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:18:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Lock "cinder-quobyte-5451e587-d139-4e8d-a347-d86b2b548bed-16571bea-fcca-4c6d-8dd3-db6b1de5422f" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:18:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Creating volume 16571bea-fcca-4c6d-8dd3-db6b1de5422f from snapshot 5451e587-d139-4e8d-a347-d86b2b548bed {{(pid=87184) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 19:18:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:18:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:18:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:18:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:18:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:18:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:18:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Acquiring lock "cinder-quobyte-16571bea-fcca-4c6d-8dd3-db6b1de5422f" by "_copy_volume_from_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:18:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Lock "cinder-quobyte-16571bea-fcca-4c6d-8dd3-db6b1de5422f" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:18:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] snapshot: 5451e587-d139-4e8d-a347-d86b2b548bed, volume: 16571bea-fcca-4c6d-8dd3-db6b1de5422f,  {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 19:18:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:18:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:18:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:18:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:18:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:18:19 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9841e7-043b-494d-a4e9-45290412f798]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:18:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f.5451e587-d139-4e8d-a347-d86b2b548bed {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:19 devstack sudo[98856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f.5451e587-d139-4e8d-a347-d86b2b548bed
Nov 05 19:18:19 devstack sudo[98856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:19 devstack sudo[98856]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f.5451e587-d139-4e8d-a347-d86b2b548bed" returned: 0 in 0.747s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb7de5e1-9346-426b-a947-2bdd35dea72f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:18:19 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a763b56a-0d08-4930-8985-bddcdf869359]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:18:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:20 devstack sudo[98861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f
Nov 05 19:18:20 devstack sudo[98861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:20 devstack sudo[98861]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f" returned: 0 in 0.564s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 19:18:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Creating direct copy from snapshot {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 19:18:20 devstack cinder-volume[87184]: DEBUG cinder.utils [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Path /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-16571bea-fcca-4c6d-8dd3-db6b1de5422f not found in is_blk_device check {{(pid=87184) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 19:18:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-16571bea-fcca-4c6d-8dd3-db6b1de5422f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:20 devstack sudo[98866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-16571bea-fcca-4c6d-8dd3-db6b1de5422f
Nov 05 19:18:20 devstack sudo[98866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:27 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:18:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Flow 'volume_create_manager' (7d6e938c-0d25-4d8d-8381-3359be0b1e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:18:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dff991e0-b317-4472-8999-d322a790fedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:18:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dff991e0-b317-4472-8999-d322a790fedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b4ff25c-155c-489b-b791-6d7865d6c08f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5e18f1224c44b88a6b9b57246ce2144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:18:27Z,use_quota=True,user_id='11668ee24c81487ba1c4153aa7884591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f8115d2-7657-4dc1-b26f-2c92279a7a88),volume_type_id=3f8115d2-7657-4dc1-b26f-2c92279a7a88)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:18:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd3fa2b-2937-4f83-a503-991adc014f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:18:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd3fa2b-2937-4f83-a503-991adc014f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:18:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52b36312-bbc6-4b44-9a08-aa28ee3b7cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:18:27 devstack cinder-volume[87184]: DEBUG cinder.image.glance [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Creating Keystone auth plugin from conf {{(pid=87184) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 19:18:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52b36312-bbc6-4b44-9a08-aa28ee3b7cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9b4ff25c-155c-489b-b791-6d7865d6c08f', 'volume_name': 'volume-9b4ff25c-155c-489b-b791-6d7865d6c08f', 'volume_size': 1, 'image_id': '08b03707-2a75-4c84-9e1d-44584c1daec4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08b03707-2a75-4c84-9e1d-44584c1daec4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b0fcd5e449a3815c48abdf497bd33b82', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e5e18f1224c44b88a6b9b57246ce2144', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4e26f8860a34b985c505a5001c028102b7eea34c89ac39bddfd4afd8794f2a454e1de7a0739d81ddcbe5e052af3e9380a6fe2f4431d563457995c57466295533', 'id': '08b03707-2a75-4c84-9e1d-44584c1daec4', 'created_at': datetime.datetime(2026, 11, 5, 18, 18, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 18, 18, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08b03707-2a75-4c84-9e1d-44584c1daec4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x736627b89e50>}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:18:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef797514-e700-483c-b1ef-96cf3b06b0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:18:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef797514-e700-483c-b1ef-96cf3b06b0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:18:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c4899b3-fb06-4f68-9196-c88dfc19e074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:18:27 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Volume 9b4ff25c-155c-489b-b791-6d7865d6c08f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9b4ff25c-155c-489b-b791-6d7865d6c08f', 'volume_size': 1, 'image_id': '08b03707-2a75-4c84-9e1d-44584c1daec4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08b03707-2a75-4c84-9e1d-44584c1daec4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b0fcd5e449a3815c48abdf497bd33b82', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e5e18f1224c44b88a6b9b57246ce2144', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4e26f8860a34b985c505a5001c028102b7eea34c89ac39bddfd4afd8794f2a454e1de7a0739d81ddcbe5e052af3e9380a6fe2f4431d563457995c57466295533', 'id': '08b03707-2a75-4c84-9e1d-44584c1daec4', 'created_at': datetime.datetime(2026, 11, 5, 18, 18, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 18, 18, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08b03707-2a75-4c84-9e1d-44584c1daec4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x736627b89e50>}
Nov 05 19:18:27 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Trying to clone 9b4ff25c-155c-489b-b791-6d7865d6c08f from image 08b03707-2a75-4c84-9e1d-44584c1daec4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/08b03707-2a75-4c84-9e1d-44584c1daec4', 'metadata': {}}]). {{(pid=87184) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 19:18:28 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_08b03707-2a75-4c84-9e1d-44584c1daec4_ofxxww88devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 19:18:28 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Image download 0.00 MB at 0.00 MB/s
Nov 05 19:18:28 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9ead4a-eb74-4fd5-be8c-f10b3df34602]: (4, 'raw') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:18:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08b03707-2a75-4c84-9e1d-44584c1daec4_ofxxww88devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:28 devstack sudo[98938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08b03707-2a75-4c84-9e1d-44584c1daec4_ofxxww88devstack@QuobyteHD
Nov 05 19:18:28 devstack sudo[98938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:29 devstack sudo[98938]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08b03707-2a75-4c84-9e1d-44584c1daec4_ofxxww88devstack@QuobyteHD" returned: 0 in 0.729s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08b03707-2a75-4c84-9e1d-44584c1daec4_ofxxww88devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:29 devstack sudo[98978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08b03707-2a75-4c84-9e1d-44584c1daec4_ofxxww88devstack@QuobyteHD
Nov 05 19:18:29 devstack sudo[98978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:30 devstack sudo[98978]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08b03707-2a75-4c84-9e1d-44584c1daec4_ofxxww88devstack@QuobyteHD" returned: 1 in 1.191s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08b03707-2a75-4c84-9e1d-44584c1daec4_ofxxww88devstack@QuobyteHD' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 19:18:30 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Temporary image 08b03707-2a75-4c84-9e1d-44584c1daec4 is fetched for user 11668ee24c81487ba1c4153aa7884591. {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 19:18:30 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e608f52-164e-4833-8351-da9895ebc4b8]: (4, 'raw') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:18:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08b03707-2a75-4c84-9e1d-44584c1daec4_ofxxww88devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:30 devstack sudo[99003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08b03707-2a75-4c84-9e1d-44584c1daec4_ofxxww88devstack@QuobyteHD
Nov 05 19:18:30 devstack sudo[99003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:31 devstack sudo[99003]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08b03707-2a75-4c84-9e1d-44584c1daec4_ofxxww88devstack@QuobyteHD" returned: 0 in 1.350s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08b03707-2a75-4c84-9e1d-44584c1daec4_ofxxww88devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:32 devstack sudo[99007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08b03707-2a75-4c84-9e1d-44584c1daec4_ofxxww88devstack@QuobyteHD
Nov 05 19:18:32 devstack sudo[99007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:32 devstack sudo[98866]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:32 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cb536817-2b7e-4206-8ad0-1b6b62ec4d6b tempest-VolumesActionsTest-2059143216 None] Acquiring lock "cinder-a4d2d6a8-1b4c-4e76-94a5-6934fff57484" by "attach_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:18:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-16571bea-fcca-4c6d-8dd3-db6b1de5422f" returned: 0 in 11.822s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:32 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Image conversion details: src /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f, size 1024.00 MB, duration 11.82 sec, destination /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-16571bea-fcca-4c6d-8dd3-db6b1de5422f {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 19:18:32 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Converted 1024.00 MB image at 86.61 MB/s
Nov 05 19:18:32 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-16571bea-fcca-4c6d-8dd3-db6b1de5422f is being set with open permissions: ugo+rw
Nov 05 19:18:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-16571bea-fcca-4c6d-8dd3-db6b1de5422f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:32 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cb536817-2b7e-4206-8ad0-1b6b62ec4d6b tempest-VolumesActionsTest-2059143216 None] Lock "cinder-a4d2d6a8-1b4c-4e76-94a5-6934fff57484" acquired by "attach_volume" :: waited 0.044s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:18:32 devstack sudo[99009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-16571bea-fcca-4c6d-8dd3-db6b1de5422f
Nov 05 19:18:32 devstack sudo[99009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:32 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-cb536817-2b7e-4206-8ad0-1b6b62ec4d6b tempest-VolumesActionsTest-2059143216 None] Attaching volume a4d2d6a8-1b4c-4e76-94a5-6934fff57484 to instance 8072db03-1887-4ff3-bd5a-ac4b5fd01188 at mountpoint /dev/vdb on host None.
Nov 05 19:18:32 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-cb536817-2b7e-4206-8ad0-1b6b62ec4d6b tempest-VolumesActionsTest-2059143216 None] Attach volume completed successfully.
Nov 05 19:18:32 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cb536817-2b7e-4206-8ad0-1b6b62ec4d6b tempest-VolumesActionsTest-2059143216 None] Lock "cinder-a4d2d6a8-1b4c-4e76-94a5-6934fff57484" released by "attach_volume" :: held 0.139s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:18:32 devstack sudo[99007]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08b03707-2a75-4c84-9e1d-44584c1daec4_ofxxww88devstack@QuobyteHD" returned: 1 in 0.458s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08b03707-2a75-4c84-9e1d-44584c1daec4_ofxxww88devstack@QuobyteHD' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 19:18:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:18:32 devstack sudo[99009]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-16571bea-fcca-4c6d-8dd3-db6b1de5422f" returned: 0 in 0.321s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:32 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Lock "cinder-quobyte-16571bea-fcca-4c6d-8dd3-db6b1de5422f" released by "_copy_volume_from_snapshot" :: held 13.622s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:18:32 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Lock "cinder-quobyte-5451e587-d139-4e8d-a347-d86b2b548bed-16571bea-fcca-4c6d-8dd3-db6b1de5422f" released by "_create_volume_from_snapshot" :: held 13.707s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:18:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.732s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:18:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.205s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:18:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b4ff25c-155c-489b-b791-6d7865d6c08f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5e18f1224c44b88a6b9b57246ce2144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:18:27Z,use_quota=True,user_id='11668ee24c81487ba1c4153aa7884591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f8115d2-7657-4dc1-b26f-2c92279a7a88),volume_type_id=3f8115d2-7657-4dc1-b26f-2c92279a7a88)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:18:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Creating volume 9b4ff25c-155c-489b-b791-6d7865d6c08f {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:18:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:18:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:18:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:18:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:18:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:18:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:18:32 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:18:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9b4ff25c-155c-489b-b791-6d7865d6c08f 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:32 devstack sudo[99015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9b4ff25c-155c-489b-b791-6d7865d6c08f 1073741824
Nov 05 19:18:32 devstack sudo[99015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (362f5325-21ab-4e4c-9a82-71ffdcc97cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16571bea-fcca-4c6d-8dd3-db6b1de5422f', 'volume_size': 1, 'snapshot_id': '5451e587-d139-4e8d-a347-d86b2b548bed'}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:18:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f55d8fe-fa71-4ad9-ac1f-f82a611c9722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:18:32 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Volume volume-16571bea-fcca-4c6d-8dd3-db6b1de5422f (16571bea-fcca-4c6d-8dd3-db6b1de5422f): created successfully
Nov 05 19:18:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f55d8fe-fa71-4ad9-ac1f-f82a611c9722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:18:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Flow 'volume_create_manager' (66a43bae-4d59-473c-a30f-85bfa6286edd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:18:32 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-93c2805e-996c-4156-9ba9-c9f7dbd111fa tempest-VolumesDeleteCascade-2046550965 None] Created volume successfully.
Nov 05 19:18:32 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-17b50d98-8d52-42b2-8b97-2898337e2420 tempest-VolumesActionsTest-2059143216 None] Acquiring lock "cinder-a4d2d6a8-1b4c-4e76-94a5-6934fff57484-detach_volume" by "detach_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:18:32 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-17b50d98-8d52-42b2-8b97-2898337e2420 tempest-VolumesActionsTest-2059143216 None] Lock "cinder-a4d2d6a8-1b4c-4e76-94a5-6934fff57484-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:18:32 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-17b50d98-8d52-42b2-8b97-2898337e2420 tempest-VolumesActionsTest-2059143216 None] Detaching volume a4d2d6a8-1b4c-4e76-94a5-6934fff57484 from instance 8072db03-1887-4ff3-bd5a-ac4b5fd01188.
Nov 05 19:18:32 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-17b50d98-8d52-42b2-8b97-2898337e2420 tempest-VolumesActionsTest-2059143216 None] Detach volume completed successfully.
Nov 05 19:18:32 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-17b50d98-8d52-42b2-8b97-2898337e2420 tempest-VolumesActionsTest-2059143216 None] Lock "cinder-a4d2d6a8-1b4c-4e76-94a5-6934fff57484-detach_volume" released by "detach_volume" :: held 0.094s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:18:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] Acquiring lock "cinder-cb7de5e1-9346-426b-a947-2bdd35dea72f-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:18:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] Lock "cinder-cb7de5e1-9346-426b-a947-2bdd35dea72f-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:18:33 devstack sudo[99015]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9b4ff25c-155c-489b-b791-6d7865d6c08f 1073741824" returned: 0 in 0.824s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] Performing cascade delete. {{(pid=87184) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Nov 05 19:18:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] Acquiring lock "cinder-5451e587-d139-4e8d-a347-d86b2b548bed-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:18:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9b4ff25c-155c-489b-b791-6d7865d6c08f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] Lock "cinder-5451e587-d139-4e8d-a347-d86b2b548bed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:18:33 devstack sudo[99023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9b4ff25c-155c-489b-b791-6d7865d6c08f
Nov 05 19:18:33 devstack sudo[99023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] Acquiring lock "cinder-quobyte-cb7de5e1-9346-426b-a947-2bdd35dea72f" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:18:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] Lock "cinder-quobyte-cb7de5e1-9346-426b-a947-2bdd35dea72f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:18:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] Acquiring lock "cinder-quobyte-5451e587-d139-4e8d-a347-d86b2b548bed" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:18:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] Lock "cinder-quobyte-5451e587-d139-4e8d-a347-d86b2b548bed" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:18:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] Deleting offline snapshot 5451e587-d139-4e8d-a347-d86b2b548bed of volume cb7de5e1-9346-426b-a947-2bdd35dea72f {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:18:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] snapshot_file for this snap is: volume-cb7de5e1-9346-426b-a947-2bdd35dea72f.5451e587-d139-4e8d-a347-d86b2b548bed {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:18:33 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6acbc9-2652-493f-b550-15fa4a798088]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:18:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f.5451e587-d139-4e8d-a347-d86b2b548bed {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:33 devstack sudo[99026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f.5451e587-d139-4e8d-a347-d86b2b548bed
Nov 05 19:18:33 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:34 devstack sudo[99023]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9b4ff25c-155c-489b-b791-6d7865d6c08f" returned: 0 in 0.558s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:18:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.498s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:18:34 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Attempting download of 08b03707-2a75-4c84-9e1d-44584c1daec4 ((None, [{'url': 'file:///opt/stack/data/glance/images/08b03707-2a75-4c84-9e1d-44584c1daec4', 'metadata': {}}])) to volume 9b4ff25c-155c-489b-b791-6d7865d6c08f. {{(pid=87184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 19:18:34 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb64dc9-75ea-46d1-aa66-5347c976898f]: (4, 'raw') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:18:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08b03707-2a75-4c84-9e1d-44584c1daec4_hfh6xe38 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:34 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f.5451e587-d139-4e8d-a347-d86b2b548bed" returned: 0 in 0.746s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb7de5e1-9346-426b-a947-2bdd35dea72f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:18:34 devstack sudo[99047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08b03707-2a75-4c84-9e1d-44584c1daec4_hfh6xe38
Nov 05 19:18:34 devstack sudo[99047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:34 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[852aa830-7643-466b-a791-2fbf8dd4ca87]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:18:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:34 devstack sudo[99053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f
Nov 05 19:18:34 devstack sudo[99053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:34 devstack sudo[99047]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08b03707-2a75-4c84-9e1d-44584c1daec4_hfh6xe38" returned: 0 in 0.504s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08b03707-2a75-4c84-9e1d-44584c1daec4_hfh6xe38 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:35 devstack sudo[99057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08b03707-2a75-4c84-9e1d-44584c1daec4_hfh6xe38
Nov 05 19:18:35 devstack sudo[99057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:35 devstack sudo[99057]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08b03707-2a75-4c84-9e1d-44584c1daec4_hfh6xe38" returned: 1 in 0.528s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08b03707-2a75-4c84-9e1d-44584c1daec4_hfh6xe38' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 19:18:35 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a821a683-6db0-4565-b5f8-82b82353e5e9]: (4, 'raw') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:18:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08b03707-2a75-4c84-9e1d-44584c1daec4_ofxxww88devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:35 devstack sudo[99053]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f" returned: 0 in 0.851s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f.5451e587-d139-4e8d-a347-d86b2b548bed {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:35 devstack sudo[99066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f.5451e587-d139-4e8d-a347-d86b2b548bed
Nov 05 19:18:35 devstack sudo[99066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:35 devstack sudo[99065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08b03707-2a75-4c84-9e1d-44584c1daec4_ofxxww88devstack@QuobyteHD
Nov 05 19:18:35 devstack sudo[99065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:35 devstack sudo[99065]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08b03707-2a75-4c84-9e1d-44584c1daec4_ofxxww88devstack@QuobyteHD" returned: 0 in 0.591s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08b03707-2a75-4c84-9e1d-44584c1daec4_ofxxww88devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:35 devstack sudo[99066]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f.5451e587-d139-4e8d-a347-d86b2b548bed" returned: 0 in 0.581s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f.5451e587-d139-4e8d-a347-d86b2b548bed {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:36 devstack sudo[99078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f.5451e587-d139-4e8d-a347-d86b2b548bed
Nov 05 19:18:36 devstack sudo[99078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:36 devstack sudo[99077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08b03707-2a75-4c84-9e1d-44584c1daec4_ofxxww88devstack@QuobyteHD
Nov 05 19:18:36 devstack sudo[99077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:36 devstack sudo[99078]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f.5451e587-d139-4e8d-a347-d86b2b548bed" returned: 0 in 0.281s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] Lock "cinder-quobyte-5451e587-d139-4e8d-a347-d86b2b548bed" released by "_delete_snapshot" :: held 2.609s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:18:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] Lock "cinder-quobyte-cb7de5e1-9346-426b-a947-2bdd35dea72f" released by "delete_snapshot" :: held 2.650s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:18:36 devstack sudo[99077]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08b03707-2a75-4c84-9e1d-44584c1daec4_ofxxww88devstack@QuobyteHD" returned: 1 in 0.415s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08b03707-2a75-4c84-9e1d-44584c1daec4_ofxxww88devstack@QuobyteHD' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 19:18:36 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] 08b03707-2a75-4c84-9e1d-44584c1daec4 was raw, converting to qcow2 {{(pid=87184) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 19:18:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_08b03707-2a75-4c84-9e1d-44584c1daec4_ofxxww88devstack@QuobyteHD /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9b4ff25c-155c-489b-b791-6d7865d6c08f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:36 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] Created reservations ['f23607e6-012f-418e-863b-8c974604733b', '64d74708-c5ef-4186-9996-5010aeefa9b1', '97a71d1e-b2de-4210-8c25-ffd987b9655c', 'f04dae98-535b-45de-a336-ca0292b8961c'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:18:36 devstack sudo[99085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_08b03707-2a75-4c84-9e1d-44584c1daec4_ofxxww88devstack@QuobyteHD /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9b4ff25c-155c-489b-b791-6d7865d6c08f
Nov 05 19:18:36 devstack sudo[99085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:36 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] Delete snapshot completed successfully.
Nov 05 19:18:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] Lock "cinder-5451e587-d139-4e8d-a347-d86b2b548bed-delete_snapshot" released by "delete_snapshot" :: held 2.847s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:18:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] Snapshots deleted, issuing volume delete {{(pid=87184) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Nov 05 19:18:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] Acquiring lock "cinder-quobyte-cb7de5e1-9346-426b-a947-2bdd35dea72f" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:18:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] Lock "cinder-quobyte-cb7de5e1-9346-426b-a947-2bdd35dea72f" acquired by "delete_volume" :: waited 0.017s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:18:36 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd4a71d-8c6e-42c4-b148-324fe81a9df0]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:18:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:36 devstack sudo[99087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f
Nov 05 19:18:36 devstack sudo[99087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:36 devstack sudo[99085]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_08b03707-2a75-4c84-9e1d-44584c1daec4_ofxxww88devstack@QuobyteHD /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9b4ff25c-155c-489b-b791-6d7865d6c08f" returned: 0 in 0.550s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:36 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_08b03707-2a75-4c84-9e1d-44584c1daec4_ofxxww88devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9b4ff25c-155c-489b-b791-6d7865d6c08f {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 19:18:36 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Converted 0.00 MB image at 0.00 MB/s
Nov 05 19:18:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9b4ff25c-155c-489b-b791-6d7865d6c08f 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:36 devstack sudo[99094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9b4ff25c-155c-489b-b791-6d7865d6c08f 1G
Nov 05 19:18:36 devstack sudo[99094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:37 devstack sudo[99087]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f" returned: 0 in 0.481s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:37 devstack sudo[99099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f
Nov 05 19:18:37 devstack sudo[99099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:37 devstack sudo[99094]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9b4ff25c-155c-489b-b791-6d7865d6c08f 1G" returned: 0 in 0.420s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:37 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Downloaded image 08b03707-2a75-4c84-9e1d-44584c1daec4 ((None, [{'url': 'file:///opt/stack/data/glance/images/08b03707-2a75-4c84-9e1d-44584c1daec4', 'metadata': {}}])) to volume 9b4ff25c-155c-489b-b791-6d7865d6c08f successfully. {{(pid=87184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 19:18:37 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Temporary image 08b03707-2a75-4c84-9e1d-44584c1daec4 for user 11668ee24c81487ba1c4153aa7884591 is deleted. {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 19:18:37 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Marking volume 9b4ff25c-155c-489b-b791-6d7865d6c08f as bootable. {{(pid=87184) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 19:18:37 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Copying metadata from image 08b03707-2a75-4c84-9e1d-44584c1daec4 to 9b4ff25c-155c-489b-b791-6d7865d6c08f. {{(pid=87184) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 19:18:37 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Creating volume glance metadata for volume 9b4ff25c-155c-489b-b791-6d7865d6c08f backed by image 08b03707-2a75-4c84-9e1d-44584c1daec4 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '08b03707-2a75-4c84-9e1d-44584c1daec4', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'b0fcd5e449a3815c48abdf497bd33b82', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87184) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 19:18:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb7de5e1-9346-426b-a947-2bdd35dea72f" returned: 0 in 0.331s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:37 devstack sudo[99099]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] Lock "cinder-quobyte-cb7de5e1-9346-426b-a947-2bdd35dea72f" released by "delete_volume" :: held 0.932s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:18:37 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] Created reservations ['f8b1901f-d267-4750-b9c5-fa41a7b83bc9', '736012c6-d811-43bc-8f86-6f4731f3e221', '81fadeb7-e3df-4736-a466-cf9be1e062f3', '8eb57ed1-33e4-4fcd-b007-c6af4012ba8a'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:18:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c4899b3-fb06-4f68-9196-c88dfc19e074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b4ff25c-155c-489b-b791-6d7865d6c08f', 'volume_size': 1, 'image_id': '08b03707-2a75-4c84-9e1d-44584c1daec4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08b03707-2a75-4c84-9e1d-44584c1daec4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b0fcd5e449a3815c48abdf497bd33b82', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e5e18f1224c44b88a6b9b57246ce2144', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4e26f8860a34b985c505a5001c028102b7eea34c89ac39bddfd4afd8794f2a454e1de7a0739d81ddcbe5e052af3e9380a6fe2f4431d563457995c57466295533', 'id': '08b03707-2a75-4c84-9e1d-44584c1daec4', 'created_at': datetime.datetime(2026, 11, 5, 18, 18, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 18, 18, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08b03707-2a75-4c84-9e1d-44584c1daec4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x736627b89e50>}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:18:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47de46f8-d935-49e0-8fb6-509c29467663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:18:37 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Volume volume-9b4ff25c-155c-489b-b791-6d7865d6c08f (9b4ff25c-155c-489b-b791-6d7865d6c08f): created successfully
Nov 05 19:18:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47de46f8-d935-49e0-8fb6-509c29467663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:18:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Flow 'volume_create_manager' (7d6e938c-0d25-4d8d-8381-3359be0b1e1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:18:37 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-ac57a439-dd4a-497a-be80-0a8629d6c698 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Created volume successfully.
Nov 05 19:18:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:18:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:18:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:18:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:18:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:18:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:37 devstack sudo[99107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:18:37 devstack sudo[99107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:37 devstack sudo[99107]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.316s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:37 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:18:37 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] Deleted volume successfully.
Nov 05 19:18:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-dd9ee3d4-680e-4c92-8079-088cc9068f32 tempest-VolumesDeleteCascade-2046550965 None] Lock "cinder-cb7de5e1-9346-426b-a947-2bdd35dea72f-delete_volume" released by "delete_volume" :: held 4.549s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:18:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-47a45ef5-5da2-493f-b73c-f3f4b5d00807 tempest-VolumesDeleteCascade-2046550965 None] Acquiring lock "cinder-16571bea-fcca-4c6d-8dd3-db6b1de5422f-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:18:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-47a45ef5-5da2-493f-b73c-f3f4b5d00807 tempest-VolumesDeleteCascade-2046550965 None] Lock "cinder-16571bea-fcca-4c6d-8dd3-db6b1de5422f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:18:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-abef645c-988c-48b1-919b-d25619301f19 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Acquiring lock "cinder-9b4ff25c-155c-489b-b791-6d7865d6c08f-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:18:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-47a45ef5-5da2-493f-b73c-f3f4b5d00807 tempest-VolumesDeleteCascade-2046550965 None] Acquiring lock "cinder-quobyte-16571bea-fcca-4c6d-8dd3-db6b1de5422f" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:18:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-abef645c-988c-48b1-919b-d25619301f19 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Lock "cinder-9b4ff25c-155c-489b-b791-6d7865d6c08f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:18:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-47a45ef5-5da2-493f-b73c-f3f4b5d00807 tempest-VolumesDeleteCascade-2046550965 None] Lock "cinder-quobyte-16571bea-fcca-4c6d-8dd3-db6b1de5422f" acquired by "delete_volume" :: waited 0.037s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:18:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-abef645c-988c-48b1-919b-d25619301f19 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Acquiring lock "cinder-quobyte-9b4ff25c-155c-489b-b791-6d7865d6c08f" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:18:38 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[03767029-a1dd-4863-950c-71fc59c428f9]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:18:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-47a45ef5-5da2-493f-b73c-f3f4b5d00807 tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-16571bea-fcca-4c6d-8dd3-db6b1de5422f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-abef645c-988c-48b1-919b-d25619301f19 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Lock "cinder-quobyte-9b4ff25c-155c-489b-b791-6d7865d6c08f" acquired by "delete_volume" :: waited 0.038s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:18:38 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0241bc9-df88-4768-91a0-2ea34ffb2adb]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:18:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-abef645c-988c-48b1-919b-d25619301f19 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9b4ff25c-155c-489b-b791-6d7865d6c08f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3ee5ec26-3c1f-40ab-9ebb-543997b1f7d8 tempest-VolumesActionsTest-2059143216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:18:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3ee5ec26-3c1f-40ab-9ebb-543997b1f7d8 tempest-VolumesActionsTest-2059143216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:18:38 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[91299434-41dc-41bd-a15f-21253e037fda]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:18:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3ee5ec26-3c1f-40ab-9ebb-543997b1f7d8 tempest-VolumesActionsTest-2059143216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4d2d6a8-1b4c-4e76-94a5-6934fff57484 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:38 devstack sudo[99113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-16571bea-fcca-4c6d-8dd3-db6b1de5422f
Nov 05 19:18:38 devstack sudo[99113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:38 devstack sudo[99114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9b4ff25c-155c-489b-b791-6d7865d6c08f
Nov 05 19:18:38 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:38 devstack sudo[99118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4d2d6a8-1b4c-4e76-94a5-6934fff57484
Nov 05 19:18:38 devstack sudo[99118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:38 devstack sudo[99113]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-47a45ef5-5da2-493f-b73c-f3f4b5d00807 tempest-VolumesDeleteCascade-2046550965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-16571bea-fcca-4c6d-8dd3-db6b1de5422f" returned: 0 in 0.552s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:38 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-47a45ef5-5da2-493f-b73c-f3f4b5d00807 tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-16571bea-fcca-4c6d-8dd3-db6b1de5422f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-abef645c-988c-48b1-919b-d25619301f19 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9b4ff25c-155c-489b-b791-6d7865d6c08f" returned: 0 in 0.507s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-abef645c-988c-48b1-919b-d25619301f19 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9b4ff25c-155c-489b-b791-6d7865d6c08f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:38 devstack sudo[99140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-16571bea-fcca-4c6d-8dd3-db6b1de5422f
Nov 05 19:18:38 devstack sudo[99140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:38 devstack sudo[99142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9b4ff25c-155c-489b-b791-6d7865d6c08f
Nov 05 19:18:38 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:39 devstack sudo[99118]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3ee5ec26-3c1f-40ab-9ebb-543997b1f7d8 tempest-VolumesActionsTest-2059143216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4d2d6a8-1b4c-4e76-94a5-6934fff57484" returned: 0 in 0.531s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:39 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f213db-0aa4-4b55-acf9-e60c6d082419]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:18:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3ee5ec26-3c1f-40ab-9ebb-543997b1f7d8 tempest-VolumesActionsTest-2059143216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4d2d6a8-1b4c-4e76-94a5-6934fff57484 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-154892fb-02e8-4c5e-8f2a-7fa32a7a2b83 req-582b509b-e55a-4285-99ae-a2423f8e1f67 tempest-TestServerVolumeAttachmentScenario-2143879364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:18:39 devstack sudo[99148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4d2d6a8-1b4c-4e76-94a5-6934fff57484
Nov 05 19:18:39 devstack sudo[99148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:39 devstack sudo[99140]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-47a45ef5-5da2-493f-b73c-f3f4b5d00807 tempest-VolumesDeleteCascade-2046550965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-16571bea-fcca-4c6d-8dd3-db6b1de5422f" returned: 0 in 0.301s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-47a45ef5-5da2-493f-b73c-f3f4b5d00807 tempest-VolumesDeleteCascade-2046550965 None] Lock "cinder-quobyte-16571bea-fcca-4c6d-8dd3-db6b1de5422f" released by "delete_volume" :: held 0.932s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:18:39 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-abef645c-988c-48b1-919b-d25619301f19 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9b4ff25c-155c-489b-b791-6d7865d6c08f" returned: 0 in 0.313s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-abef645c-988c-48b1-919b-d25619301f19 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Lock "cinder-quobyte-9b4ff25c-155c-489b-b791-6d7865d6c08f" released by "delete_volume" :: held 0.875s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:18:39 devstack cinder-volume[87184]: WARNING cinder.quota [None req-abef645c-988c-48b1-919b-d25619301f19 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Nov 05 19:18:39 devstack cinder-volume[87184]: WARNING cinder.quota [None req-abef645c-988c-48b1-919b-d25619301f19 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Nov 05 19:18:39 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-47a45ef5-5da2-493f-b73c-f3f4b5d00807 tempest-VolumesDeleteCascade-2046550965 None] Created reservations ['b61484e6-d62a-4020-9e50-74fc8bfc7235', '0e34fd4c-c7e9-4b79-a977-7ac1444dcac2', '3ddefab7-cda4-4bb2-b787-72b6d57eb248', '230682ec-ba98-42c5-9a42-52f199d42e01'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:18:39 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-abef645c-988c-48b1-919b-d25619301f19 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Created reservations ['d6dba919-ec0b-4114-87f5-246704aec3aa', 'b6aa2bae-44fa-421b-ba20-fc74503f6f07', 'f90eee60-d09b-4d77-8c78-5b8b0cd8f3bf', 'c8527229-3fa5-447e-ae78-0fc04eebb134'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:18:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-47a45ef5-5da2-493f-b73c-f3f4b5d00807 tempest-VolumesDeleteCascade-2046550965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:18:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-47a45ef5-5da2-493f-b73c-f3f4b5d00807 tempest-VolumesDeleteCascade-2046550965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:18:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-47a45ef5-5da2-493f-b73c-f3f4b5d00807 tempest-VolumesDeleteCascade-2046550965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:18:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-47a45ef5-5da2-493f-b73c-f3f4b5d00807 tempest-VolumesDeleteCascade-2046550965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:18:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-47a45ef5-5da2-493f-b73c-f3f4b5d00807 tempest-VolumesDeleteCascade-2046550965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:18:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-47a45ef5-5da2-493f-b73c-f3f4b5d00807 tempest-VolumesDeleteCascade-2046550965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:39 devstack sudo[99154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:18:39 devstack sudo[99154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-abef645c-988c-48b1-919b-d25619301f19 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:18:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-abef645c-988c-48b1-919b-d25619301f19 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:18:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-abef645c-988c-48b1-919b-d25619301f19 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:18:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-abef645c-988c-48b1-919b-d25619301f19 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:18:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-abef645c-988c-48b1-919b-d25619301f19 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:18:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-abef645c-988c-48b1-919b-d25619301f19 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:39 devstack sudo[99157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:18:39 devstack sudo[99157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:39 devstack sudo[99148]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3ee5ec26-3c1f-40ab-9ebb-543997b1f7d8 tempest-VolumesActionsTest-2059143216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4d2d6a8-1b4c-4e76-94a5-6934fff57484" returned: 0 in 0.505s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3ee5ec26-3c1f-40ab-9ebb-543997b1f7d8 tempest-VolumesActionsTest-2059143216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4d2d6a8-1b4c-4e76-94a5-6934fff57484 /opt/stack/data/cinder/conversion/a4d2d6a8-1b4c-4e76-94a5-6934fff57484.temp_image.b7888c48-63ac-41b6-a78b-9c913a613739bybg2jwt.img {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:39 devstack sudo[99159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4d2d6a8-1b4c-4e76-94a5-6934fff57484 /opt/stack/data/cinder/conversion/a4d2d6a8-1b4c-4e76-94a5-6934fff57484.temp_image.b7888c48-63ac-41b6-a78b-9c913a613739bybg2jwt.img
Nov 05 19:18:39 devstack sudo[99159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:39 devstack sudo[99154]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-47a45ef5-5da2-493f-b73c-f3f4b5d00807 tempest-VolumesDeleteCascade-2046550965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.366s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:39 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-47a45ef5-5da2-493f-b73c-f3f4b5d00807 tempest-VolumesDeleteCascade-2046550965 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:18:39 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-47a45ef5-5da2-493f-b73c-f3f4b5d00807 tempest-VolumesDeleteCascade-2046550965 None] Deleted volume successfully.
Nov 05 19:18:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-47a45ef5-5da2-493f-b73c-f3f4b5d00807 tempest-VolumesDeleteCascade-2046550965 None] Lock "cinder-16571bea-fcca-4c6d-8dd3-db6b1de5422f-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:18:39 devstack sudo[99157]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-abef645c-988c-48b1-919b-d25619301f19 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.400s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:39 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-abef645c-988c-48b1-919b-d25619301f19 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:18:39 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-abef645c-988c-48b1-919b-d25619301f19 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Deleted volume successfully.
Nov 05 19:18:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-abef645c-988c-48b1-919b-d25619301f19 tempest-VolumeAndVolumeTypeFromImageTest-226817241 None] Lock "cinder-9b4ff25c-155c-489b-b791-6d7865d6c08f-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:18:47 devstack sudo[99159]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3ee5ec26-3c1f-40ab-9ebb-543997b1f7d8 tempest-VolumesActionsTest-2059143216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4d2d6a8-1b4c-4e76-94a5-6934fff57484 /opt/stack/data/cinder/conversion/a4d2d6a8-1b4c-4e76-94a5-6934fff57484.temp_image.b7888c48-63ac-41b6-a78b-9c913a613739bybg2jwt.img" returned: 0 in 8.362s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:47 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[49912e2f-ba5c-485f-b38d-f536d0633fa9]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:18:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3ee5ec26-3c1f-40ab-9ebb-543997b1f7d8 tempest-VolumesActionsTest-2059143216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4d2d6a8-1b4c-4e76-94a5-6934fff57484 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:18:48 devstack sudo[99217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4d2d6a8-1b4c-4e76-94a5-6934fff57484
Nov 05 19:18:48 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:18:48 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root
Nov 05 19:18:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3ee5ec26-3c1f-40ab-9ebb-543997b1f7d8 tempest-VolumesActionsTest-2059143216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4d2d6a8-1b4c-4e76-94a5-6934fff57484" returned: 0 in 0.709s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:18:48 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-3ee5ec26-3c1f-40ab-9ebb-543997b1f7d8 tempest-VolumesActionsTest-2059143216 None] Image conversion details: src /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4d2d6a8-1b4c-4e76-94a5-6934fff57484, size 1024.00 MB, duration 8.36 sec, destination /opt/stack/data/cinder/conversion/a4d2d6a8-1b4c-4e76-94a5-6934fff57484.temp_image.b7888c48-63ac-41b6-a78b-9c913a613739bybg2jwt.img {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 19:18:48 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-3ee5ec26-3c1f-40ab-9ebb-543997b1f7d8 tempest-VolumesActionsTest-2059143216 None] Converted 1024.00 MB image at 122.44 MB/s
Nov 05 19:18:48 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:UPDATE=87,cinder:SELECT=94,cinder:INSERT=24,cinder:DELETE=8 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:18:48 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=80,cinder:UPDATE=91,cinder:INSERT=31,cinder:DELETE=7 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:18:48 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-3ee5ec26-3c1f-40ab-9ebb-543997b1f7d8 tempest-VolumesActionsTest-2059143216 None] b7888c48-63ac-41b6-a78b-9c913a613739 was raw, no need to convert to raw {{(pid=87184) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Nov 05 19:18:49 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-066f4b7c-aeb3-41de-b989-541bafef0373 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:18:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-066f4b7c-aeb3-41de-b989-541bafef0373 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Flow 'volume_create_manager' (4ad80118-4d40-41d4-93a7-0430549a2cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:18:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-066f4b7c-aeb3-41de-b989-541bafef0373 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2907dc49-7cd6-4085-94ce-8fe8a9691241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:18:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-066f4b7c-aeb3-41de-b989-541bafef0373 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2907dc49-7cd6-4085-94ce-8fe8a9691241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-407118224',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e7fe4ee-7cb4-4cf4-8df0-b21b9679411d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31e3c3dac4bc45f984cf69f6b2c5d89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:18:50Z,use_quota=True,user_id='785ef48a003945cfa58b4a7e84c99caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:18:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-066f4b7c-aeb3-41de-b989-541bafef0373 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b72e04aa-5584-4760-9bda-140ba3f68aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:18:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-066f4b7c-aeb3-41de-b989-541bafef0373 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b72e04aa-5584-4760-9bda-140ba3f68aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:18:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-066f4b7c-aeb3-41de-b989-541bafef0373 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c27a61-65a6-40fb-a1c4-bf3afa54502c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:18:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-066f4b7c-aeb3-41de-b989-541bafef0373 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c27a61-65a6-40fb-a1c4-bf3afa54502c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e7fe4ee-7cb4-4cf4-8df0-b21b9679411d', 'volume_name': 'volume-3e7fe4ee-7cb4-4cf4-8df0-b21b9679411d', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:18:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-066f4b7c-aeb3-41de-b989-541bafef0373 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26fb53ad-6af6-42ca-b75a-08d43f1356d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:18:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-066f4b7c-aeb3-41de-b989-541bafef0373 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26fb53ad-6af6-42ca-b75a-08d43f1356d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:18:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-066f4b7c-aeb3-41de-b989-541bafef0373 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76fab99c-4117-4ee1-8b4a-225885a38c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:18:49 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-066f4b7c-aeb3-41de-b989-541bafef0373 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Volume 3e7fe4ee-7cb4-4cf4-8df0-b21b9679411d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e7fe4ee-7cb4-4cf4-8df0-b21b9679411d', 'volume_size': 1}
Nov 05 19:18:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-066f4b7c-aeb3-41de-b989-541bafef0373 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:18:50 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-59967ea7-14f2-4622-85b7-c4184820939e tempest-VolumesTransfersTest-1149999727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:18:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-59967ea7-14f2-4622-85b7-c4184820939e tempest-VolumesTransfersTest-1149999727 None] Flow 'volume_create_manager' (9c936a95-dd50-4d26-a3c1-2cd8940a49b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:18:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-59967ea7-14f2-4622-85b7-c4184820939e tempest-VolumesTransfersTest-1149999727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddbc47e1-cf24-4de8-9ffc-492e1e462674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:18:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-59967ea7-14f2-4622-85b7-c4184820939e tempest-VolumesTransfersTest-1149999727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddbc47e1-cf24-4de8-9ffc-492e1e462674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:18:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1315464395',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08888765-f35e-4dcb-bee4-2b09d1bde662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fca3ec2cca5849d8a1da8291465d6d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:18:50Z,use_quota=True,user_id='0393751964e24d42900cc8ba6db3ff26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:18:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-59967ea7-14f2-4622-85b7-c4184820939e tempest-VolumesTransfersTest-1149999727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec52e0c8-200e-44ba-a6e9-0da44b8bb100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:18:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-59967ea7-14f2-4622-85b7-c4184820939e tempest-VolumesTransfersTest-1149999727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec52e0c8-200e-44ba-a6e9-0da44b8bb100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:18:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-59967ea7-14f2-4622-85b7-c4184820939e tempest-VolumesTransfersTest-1149999727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebfdc1ba-fb66-48b9-a28d-1547f3a672a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:18:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-59967ea7-14f2-4622-85b7-c4184820939e tempest-VolumesTransfersTest-1149999727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebfdc1ba-fb66-48b9-a28d-1547f3a672a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08888765-f35e-4dcb-bee4-2b09d1bde662', 'volume_name': 'volume-08888765-f35e-4dcb-bee4-2b09d1bde662', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:18:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-59967ea7-14f2-4622-85b7-c4184820939e tempest-VolumesTransfersTest-1149999727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f8a7615-ba33-4ae4-bcff-c6607fe27388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:18:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-59967ea7-14f2-4622-85b7-c4184820939e tempest-VolumesTransfersTest-1149999727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f8a7615-ba33-4ae4-bcff-c6607fe27388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:18:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-59967ea7-14f2-4622-85b7-c4184820939e tempest-VolumesTransfersTest-1149999727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5391faa9-9134-4abe-aea3-fd381ce474b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:18:50 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-59967ea7-14f2-4622-85b7-c4184820939e tempest-VolumesTransfersTest-1149999727 None] Volume 08888765-f35e-4dcb-bee4-2b09d1bde662: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08888765-f35e-4dcb-bee4-2b09d1bde662', 'volume_size': 1}
Nov 05 19:18:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-59967ea7-14f2-4622-85b7-c4184820939e tempest-VolumesTransfersTest-1149999727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:19:00 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:19:00 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=3 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:19:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:19:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:19:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:19:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:19:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:19:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:19:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:05 devstack sudo[99227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:19:05 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:05 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.283s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:05 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:19:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:19:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread count: 28 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 19:19:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread info: [<_MainThread(MainThread, started 126882883072128)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126882770872512)>, <Thread(Thread-3 (stat_writer), started daemon 126882769837376)>, <Thread(Rabbit-heartbeat, started daemon 126882768896256)>, <Thread(Thread-5 (_runner), started daemon 126882768980928)>, <Thread(Thread-7 (_runner), started daemon 126882767016448)>, <Thread(fd_logger, started daemon 126882764561216)>, <Thread(privsep_reader, started daemon 126882764568576)>, <Thread(tpool_thread_0, started daemon 126882759292608)>, <Thread(tpool_thread_1, started daemon 126882750899904)>, <Thread(tpool_thread_2, started daemon 126882742507200)>, <Thread(tpool_thread_3, started daemon 126882734114496)>, <Thread(tpool_thread_4, started daemon 126882725721792)>, <Thread(tpool_thread_5, started daemon 126882717329088)>, <Thread(tpool_thread_6, started daemon 126882708920000)>, <Thread(tpool_thread_7, started daemon 126882700510912)>, <Thread(tpool_thread_8, started daemon 126882692101824)>, <Thread(tpool_thread_9, started daemon 126882683692736)>, <Thread(tpool_thread_10, started daemon 126882675283648)>, <Thread(tpool_thread_11, started daemon 126882666874560)>, <Thread(tpool_thread_12, started daemon 126882658465472)>, <Thread(tpool_thread_13, started daemon 126882650056384)>, <Thread(tpool_thread_14, started daemon 126882641647296)>, <Thread(tpool_thread_15, started daemon 126882633238208)>, <Thread(tpool_thread_16, started daemon 126882624829120)>, <Thread(tpool_thread_17, started daemon 126882616420032)>, <Thread(tpool_thread_18, started daemon 126882608010944)>, <Thread(tpool_thread_19, started daemon 126882599601856)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 19:19:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3ee5ec26-3c1f-40ab-9ebb-543997b1f7d8 tempest-VolumesActionsTest-2059143216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.021s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:19:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3ee5ec26-3c1f-40ab-9ebb-543997b1f7d8 tempest-VolumesActionsTest-2059143216 None] Uploaded volume to glance image-id: b7888c48-63ac-41b6-a78b-9c913a613739. {{(pid=87184) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 05 19:19:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-154892fb-02e8-4c5e-8f2a-7fa32a7a2b83 req-582b509b-e55a-4285-99ae-a2423f8e1f67 tempest-TestServerVolumeAttachmentScenario-2143879364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 28.403s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:19:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-154892fb-02e8-4c5e-8f2a-7fa32a7a2b83 req-582b509b-e55a-4285-99ae-a2423f8e1f67 tempest-TestServerVolumeAttachmentScenario-2143879364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:19:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-066f4b7c-aeb3-41de-b989-541bafef0373 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.832s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:19:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-066f4b7c-aeb3-41de-b989-541bafef0373 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-407118224',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e7fe4ee-7cb4-4cf4-8df0-b21b9679411d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31e3c3dac4bc45f984cf69f6b2c5d89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:18:50Z,use_quota=True,user_id='785ef48a003945cfa58b4a7e84c99caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:19:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-066f4b7c-aeb3-41de-b989-541bafef0373 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Creating volume 3e7fe4ee-7cb4-4cf4-8df0-b21b9679411d {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:19:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-066f4b7c-aeb3-41de-b989-541bafef0373 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:19:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-066f4b7c-aeb3-41de-b989-541bafef0373 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:19:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-066f4b7c-aeb3-41de-b989-541bafef0373 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:19:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-066f4b7c-aeb3-41de-b989-541bafef0373 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:19:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-066f4b7c-aeb3-41de-b989-541bafef0373 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:19:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-066f4b7c-aeb3-41de-b989-541bafef0373 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:19:07 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-066f4b7c-aeb3-41de-b989-541bafef0373 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:19:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-066f4b7c-aeb3-41de-b989-541bafef0373 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3e7fe4ee-7cb4-4cf4-8df0-b21b9679411d 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:07 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-3ee5ec26-3c1f-40ab-9ebb-543997b1f7d8 tempest-VolumesActionsTest-2059143216 None] Copy volume to image completed successfully.
Nov 05 19:19:07 devstack sudo[99231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3e7fe4ee-7cb4-4cf4-8df0-b21b9679411d 1073741824
Nov 05 19:19:07 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-154892fb-02e8-4c5e-8f2a-7fa32a7a2b83 req-582b509b-e55a-4285-99ae-a2423f8e1f67 tempest-TestServerVolumeAttachmentScenario-2143879364 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec', 'name': 'volume-576ab429-1b58-4421-84cf-7c34ed96bf14', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '39c552af-1126-4d2d-bf0e-59bac729d70b', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 19:19:07 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-154892fb-02e8-4c5e-8f2a-7fa32a7a2b83 req-582b509b-e55a-4285-99ae-a2423f8e1f67 tempest-TestServerVolumeAttachmentScenario-2143879364 None] attachment_update completed successfully.
Nov 05 19:19:08 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-066f4b7c-aeb3-41de-b989-541bafef0373 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3e7fe4ee-7cb4-4cf4-8df0-b21b9679411d 1073741824" returned: 0 in 0.510s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-066f4b7c-aeb3-41de-b989-541bafef0373 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3e7fe4ee-7cb4-4cf4-8df0-b21b9679411d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:08 devstack sudo[99652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3e7fe4ee-7cb4-4cf4-8df0-b21b9679411d
Nov 05 19:19:08 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:08 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-066f4b7c-aeb3-41de-b989-541bafef0373 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3e7fe4ee-7cb4-4cf4-8df0-b21b9679411d" returned: 0 in 0.320s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-066f4b7c-aeb3-41de-b989-541bafef0373 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:19:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-066f4b7c-aeb3-41de-b989-541bafef0373 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:19:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-59967ea7-14f2-4622-85b7-c4184820939e tempest-VolumesTransfersTest-1149999727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.019s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:19:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-59967ea7-14f2-4622-85b7-c4184820939e tempest-VolumesTransfersTest-1149999727 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:18:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1315464395',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08888765-f35e-4dcb-bee4-2b09d1bde662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fca3ec2cca5849d8a1da8291465d6d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:18:50Z,use_quota=True,user_id='0393751964e24d42900cc8ba6db3ff26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:19:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-59967ea7-14f2-4622-85b7-c4184820939e tempest-VolumesTransfersTest-1149999727 None] Creating volume 08888765-f35e-4dcb-bee4-2b09d1bde662 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:19:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-59967ea7-14f2-4622-85b7-c4184820939e tempest-VolumesTransfersTest-1149999727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:19:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-59967ea7-14f2-4622-85b7-c4184820939e tempest-VolumesTransfersTest-1149999727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:19:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-59967ea7-14f2-4622-85b7-c4184820939e tempest-VolumesTransfersTest-1149999727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:19:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-59967ea7-14f2-4622-85b7-c4184820939e tempest-VolumesTransfersTest-1149999727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:19:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-59967ea7-14f2-4622-85b7-c4184820939e tempest-VolumesTransfersTest-1149999727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:19:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-59967ea7-14f2-4622-85b7-c4184820939e tempest-VolumesTransfersTest-1149999727 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:19:08 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-59967ea7-14f2-4622-85b7-c4184820939e tempest-VolumesTransfersTest-1149999727 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:19:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-59967ea7-14f2-4622-85b7-c4184820939e tempest-VolumesTransfersTest-1149999727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-08888765-f35e-4dcb-bee4-2b09d1bde662 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-066f4b7c-aeb3-41de-b989-541bafef0373 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76fab99c-4117-4ee1-8b4a-225885a38c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e7fe4ee-7cb4-4cf4-8df0-b21b9679411d', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:08 devstack sudo[99655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-08888765-f35e-4dcb-bee4-2b09d1bde662 1073741824
Nov 05 19:19:08 devstack sudo[99655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-066f4b7c-aeb3-41de-b989-541bafef0373 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88bfa0bd-546c-4b63-a81f-e4ec69d0adab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:08 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-066f4b7c-aeb3-41de-b989-541bafef0373 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Volume volume-3e7fe4ee-7cb4-4cf4-8df0-b21b9679411d (3e7fe4ee-7cb4-4cf4-8df0-b21b9679411d): created successfully
Nov 05 19:19:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-066f4b7c-aeb3-41de-b989-541bafef0373 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88bfa0bd-546c-4b63-a81f-e4ec69d0adab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-066f4b7c-aeb3-41de-b989-541bafef0373 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Flow 'volume_create_manager' (4ad80118-4d40-41d4-93a7-0430549a2cbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:19:08 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-066f4b7c-aeb3-41de-b989-541bafef0373 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Created volume successfully.
Nov 05 19:19:08 devstack sudo[99655]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-59967ea7-14f2-4622-85b7-c4184820939e tempest-VolumesTransfersTest-1149999727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-08888765-f35e-4dcb-bee4-2b09d1bde662 1073741824" returned: 0 in 0.490s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-59967ea7-14f2-4622-85b7-c4184820939e tempest-VolumesTransfersTest-1149999727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-08888765-f35e-4dcb-bee4-2b09d1bde662 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:09 devstack sudo[99661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-08888765-f35e-4dcb-bee4-2b09d1bde662
Nov 05 19:19:09 devstack sudo[99661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f104c1ca-58ec-449d-a861-e8a8cf20dfc4 tempest-VolumesActionsTest-2059143216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:19:09 devstack sudo[99661]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-59967ea7-14f2-4622-85b7-c4184820939e tempest-VolumesTransfersTest-1149999727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-08888765-f35e-4dcb-bee4-2b09d1bde662" returned: 0 in 0.288s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-59967ea7-14f2-4622-85b7-c4184820939e tempest-VolumesTransfersTest-1149999727 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:19:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-59967ea7-14f2-4622-85b7-c4184820939e tempest-VolumesTransfersTest-1149999727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:19:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f104c1ca-58ec-449d-a861-e8a8cf20dfc4 tempest-VolumesActionsTest-2059143216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.112s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:19:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-59967ea7-14f2-4622-85b7-c4184820939e tempest-VolumesTransfersTest-1149999727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5391faa9-9134-4abe-aea3-fd381ce474b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08888765-f35e-4dcb-bee4-2b09d1bde662', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-59967ea7-14f2-4622-85b7-c4184820939e tempest-VolumesTransfersTest-1149999727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3b17f80-1a1d-408f-91b8-e6c6a1fd7ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:09 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[422a56de-0c5d-47db-8f76-8b2ff7d1192a]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:19:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f104c1ca-58ec-449d-a861-e8a8cf20dfc4 tempest-VolumesActionsTest-2059143216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4d2d6a8-1b4c-4e76-94a5-6934fff57484 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:09 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-59967ea7-14f2-4622-85b7-c4184820939e tempest-VolumesTransfersTest-1149999727 None] Volume volume-08888765-f35e-4dcb-bee4-2b09d1bde662 (08888765-f35e-4dcb-bee4-2b09d1bde662): created successfully
Nov 05 19:19:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-59967ea7-14f2-4622-85b7-c4184820939e tempest-VolumesTransfersTest-1149999727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3b17f80-1a1d-408f-91b8-e6c6a1fd7ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-59967ea7-14f2-4622-85b7-c4184820939e tempest-VolumesTransfersTest-1149999727 None] Flow 'volume_create_manager' (9c936a95-dd50-4d26-a3c1-2cd8940a49b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:19:09 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-59967ea7-14f2-4622-85b7-c4184820939e tempest-VolumesTransfersTest-1149999727 None] Created volume successfully.
Nov 05 19:19:09 devstack sudo[99664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4d2d6a8-1b4c-4e76-94a5-6934fff57484
Nov 05 19:19:09 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:09 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f104c1ca-58ec-449d-a861-e8a8cf20dfc4 tempest-VolumesActionsTest-2059143216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4d2d6a8-1b4c-4e76-94a5-6934fff57484" returned: 0 in 0.405s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:09 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[300638f1-c335-47b6-b6a8-1a3b2806d3ad]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:19:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f104c1ca-58ec-449d-a861-e8a8cf20dfc4 tempest-VolumesActionsTest-2059143216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4d2d6a8-1b4c-4e76-94a5-6934fff57484 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:09 devstack sudo[99669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4d2d6a8-1b4c-4e76-94a5-6934fff57484
Nov 05 19:19:09 devstack sudo[99669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:10 devstack sudo[99669]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f104c1ca-58ec-449d-a861-e8a8cf20dfc4 tempest-VolumesActionsTest-2059143216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4d2d6a8-1b4c-4e76-94a5-6934fff57484" returned: 0 in 0.433s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f104c1ca-58ec-449d-a861-e8a8cf20dfc4 tempest-VolumesActionsTest-2059143216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4d2d6a8-1b4c-4e76-94a5-6934fff57484 /opt/stack/data/cinder/conversion/a4d2d6a8-1b4c-4e76-94a5-6934fff57484.temp_image.26c732c4-a703-4cea-afa1-08a5fc2fc360og8f_1fs.img {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:10 devstack sudo[99674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4d2d6a8-1b4c-4e76-94a5-6934fff57484 /opt/stack/data/cinder/conversion/a4d2d6a8-1b4c-4e76-94a5-6934fff57484.temp_image.26c732c4-a703-4cea-afa1-08a5fc2fc360og8f_1fs.img
Nov 05 19:19:10 devstack sudo[99674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:10 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-33087972-cfc8-447a-b43a-3188acea6fbc tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:19:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-33087972-cfc8-447a-b43a-3188acea6fbc tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Flow 'volume_create_manager' (614e7a58-aafa-44c3-8e01-2dbe42992b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:19:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-33087972-cfc8-447a-b43a-3188acea6fbc tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12754f68-ced9-437e-be12-aa3df3dbb136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-33087972-cfc8-447a-b43a-3188acea6fbc tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12754f68-ced9-437e-be12-aa3df3dbb136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-293446299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea22e12-941e-4e6a-a285-70be1e0c92f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31e3c3dac4bc45f984cf69f6b2c5d89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:19:10Z,use_quota=True,user_id='785ef48a003945cfa58b4a7e84c99caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-33087972-cfc8-447a-b43a-3188acea6fbc tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36f8b144-69b2-4cf1-b782-bdd612c72b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-33087972-cfc8-447a-b43a-3188acea6fbc tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36f8b144-69b2-4cf1-b782-bdd612c72b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-33087972-cfc8-447a-b43a-3188acea6fbc tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac9fbe66-1a72-4c54-b823-022fe6a961bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-33087972-cfc8-447a-b43a-3188acea6fbc tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac9fbe66-1a72-4c54-b823-022fe6a961bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eea22e12-941e-4e6a-a285-70be1e0c92f3', 'volume_name': 'volume-eea22e12-941e-4e6a-a285-70be1e0c92f3', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-33087972-cfc8-447a-b43a-3188acea6fbc tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb982064-fbd5-4dd9-990b-fdbb33ce2fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-33087972-cfc8-447a-b43a-3188acea6fbc tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb982064-fbd5-4dd9-990b-fdbb33ce2fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-33087972-cfc8-447a-b43a-3188acea6fbc tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (842d4a5f-ab8c-4ff0-8d12-322a0c034384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:10 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-33087972-cfc8-447a-b43a-3188acea6fbc tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Volume eea22e12-941e-4e6a-a285-70be1e0c92f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eea22e12-941e-4e6a-a285-70be1e0c92f3', 'volume_size': 1}
Nov 05 19:19:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-33087972-cfc8-447a-b43a-3188acea6fbc tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:19:10 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-92e22b9b-d7c6-4145-89a7-315580e22a4a tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:19:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-92e22b9b-d7c6-4145-89a7-315580e22a4a tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Flow 'volume_create_manager' (0cdf9ed4-9b10-409c-beea-74a1442f5008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:19:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-92e22b9b-d7c6-4145-89a7-315580e22a4a tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9faaebdb-56b0-4b92-90e9-b5c3631b4b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-92e22b9b-d7c6-4145-89a7-315580e22a4a tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9faaebdb-56b0-4b92-90e9-b5c3631b4b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1305345671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96f5a2a8-3478-4df0-9323-b839baf97491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31e3c3dac4bc45f984cf69f6b2c5d89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:19:11Z,use_quota=True,user_id='785ef48a003945cfa58b4a7e84c99caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-92e22b9b-d7c6-4145-89a7-315580e22a4a tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bf5dbd6-0c14-4f41-bfe0-0c48661d707f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-92e22b9b-d7c6-4145-89a7-315580e22a4a tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bf5dbd6-0c14-4f41-bfe0-0c48661d707f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-92e22b9b-d7c6-4145-89a7-315580e22a4a tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d230b79-58d5-489c-92a4-3dc7851d80a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-92e22b9b-d7c6-4145-89a7-315580e22a4a tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d230b79-58d5-489c-92a4-3dc7851d80a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96f5a2a8-3478-4df0-9323-b839baf97491', 'volume_name': 'volume-96f5a2a8-3478-4df0-9323-b839baf97491', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-92e22b9b-d7c6-4145-89a7-315580e22a4a tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02ae81e3-c747-466e-a652-018cdf95389d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-92e22b9b-d7c6-4145-89a7-315580e22a4a tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02ae81e3-c747-466e-a652-018cdf95389d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-92e22b9b-d7c6-4145-89a7-315580e22a4a tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d05185f-c9db-4e47-b55e-735f96ee49ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:10 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-92e22b9b-d7c6-4145-89a7-315580e22a4a tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Volume 96f5a2a8-3478-4df0-9323-b839baf97491: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96f5a2a8-3478-4df0-9323-b839baf97491', 'volume_size': 1}
Nov 05 19:19:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-92e22b9b-d7c6-4145-89a7-315580e22a4a tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:19:11 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd8ac0d0-0670-4755-ae74-6c0c7e0cc65d tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:19:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dd8ac0d0-0670-4755-ae74-6c0c7e0cc65d tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Flow 'volume_create_manager' (bc211775-4003-4e47-907b-46d32df616ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:19:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dd8ac0d0-0670-4755-ae74-6c0c7e0cc65d tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ed7a4ac-fe67-430d-bcdd-e0a1511a94c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dd8ac0d0-0670-4755-ae74-6c0c7e0cc65d tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ed7a4ac-fe67-430d-bcdd-e0a1511a94c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-664430727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd5a56a9-990e-4f00-928f-5d6a2e4960bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31e3c3dac4bc45f984cf69f6b2c5d89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:19:12Z,use_quota=True,user_id='785ef48a003945cfa58b4a7e84c99caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dd8ac0d0-0670-4755-ae74-6c0c7e0cc65d tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9fa62a4-bc50-40fa-ab59-4a38a49af570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dd8ac0d0-0670-4755-ae74-6c0c7e0cc65d tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9fa62a4-bc50-40fa-ab59-4a38a49af570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dd8ac0d0-0670-4755-ae74-6c0c7e0cc65d tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (066a7008-d950-4646-8d1e-9fb976dbe668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dd8ac0d0-0670-4755-ae74-6c0c7e0cc65d tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (066a7008-d950-4646-8d1e-9fb976dbe668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd5a56a9-990e-4f00-928f-5d6a2e4960bf', 'volume_name': 'volume-dd5a56a9-990e-4f00-928f-5d6a2e4960bf', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dd8ac0d0-0670-4755-ae74-6c0c7e0cc65d tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52439cfc-b0ba-4101-bf09-639d7719f615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dd8ac0d0-0670-4755-ae74-6c0c7e0cc65d tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52439cfc-b0ba-4101-bf09-639d7719f615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dd8ac0d0-0670-4755-ae74-6c0c7e0cc65d tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c703acb1-f0d9-48e8-bcbf-58e2ad5cd7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:12 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-dd8ac0d0-0670-4755-ae74-6c0c7e0cc65d tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Volume dd5a56a9-990e-4f00-928f-5d6a2e4960bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd5a56a9-990e-4f00-928f-5d6a2e4960bf', 'volume_size': 1}
Nov 05 19:19:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dd8ac0d0-0670-4755-ae74-6c0c7e0cc65d tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:19:12 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-4333ab40-88f4-4ff7-b426-2c95a7ccc17f tempest-VolumesTransfersTest-2082468600 None] Transfer volume completed successfully.
Nov 05 19:19:12 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-dae8bf17-30c8-4792-8d74-d8a4d20f6409 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:19:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dae8bf17-30c8-4792-8d74-d8a4d20f6409 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Flow 'volume_create_manager' (4f1824c2-676e-4dc3-abcc-16928ba6e2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:19:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dae8bf17-30c8-4792-8d74-d8a4d20f6409 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (045429a4-ace9-4130-bcf5-f77e483c3115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dae8bf17-30c8-4792-8d74-d8a4d20f6409 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (045429a4-ace9-4130-bcf5-f77e483c3115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1611095452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afd63d1b-27af-497e-b568-17d44f8b881c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31e3c3dac4bc45f984cf69f6b2c5d89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:19:13Z,use_quota=True,user_id='785ef48a003945cfa58b4a7e84c99caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dae8bf17-30c8-4792-8d74-d8a4d20f6409 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e159afb-3d27-466e-801d-6917c79d5c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dae8bf17-30c8-4792-8d74-d8a4d20f6409 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e159afb-3d27-466e-801d-6917c79d5c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dae8bf17-30c8-4792-8d74-d8a4d20f6409 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a19f2cde-0ea1-4e2d-90b9-46b839e66494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dae8bf17-30c8-4792-8d74-d8a4d20f6409 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a19f2cde-0ea1-4e2d-90b9-46b839e66494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afd63d1b-27af-497e-b568-17d44f8b881c', 'volume_name': 'volume-afd63d1b-27af-497e-b568-17d44f8b881c', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dae8bf17-30c8-4792-8d74-d8a4d20f6409 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e24b811e-b846-439c-8985-511e1f7cb396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dae8bf17-30c8-4792-8d74-d8a4d20f6409 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e24b811e-b846-439c-8985-511e1f7cb396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dae8bf17-30c8-4792-8d74-d8a4d20f6409 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85bac9f3-8e96-444b-889e-7f907d227d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:12 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-dae8bf17-30c8-4792-8d74-d8a4d20f6409 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Volume afd63d1b-27af-497e-b568-17d44f8b881c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afd63d1b-27af-497e-b568-17d44f8b881c', 'volume_size': 1}
Nov 05 19:19:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dae8bf17-30c8-4792-8d74-d8a4d20f6409 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:19:13 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb36358f-59b1-4c09-9f8f-c9d8994119bb tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:19:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bb36358f-59b1-4c09-9f8f-c9d8994119bb tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Flow 'volume_create_manager' (630a826e-f689-4b05-8f3a-5f5c6ee70a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:19:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bb36358f-59b1-4c09-9f8f-c9d8994119bb tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a631a4a5-22aa-4c8f-85ac-7fee57c52ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:13 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bb36358f-59b1-4c09-9f8f-c9d8994119bb tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a631a4a5-22aa-4c8f-85ac-7fee57c52ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-20620919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60431121-5b2f-483c-ad23-0616d54ca009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31e3c3dac4bc45f984cf69f6b2c5d89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:19:14Z,use_quota=True,user_id='785ef48a003945cfa58b4a7e84c99caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bb36358f-59b1-4c09-9f8f-c9d8994119bb tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ba630c9-4bed-4be0-b431-d6f7c24d6e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bb36358f-59b1-4c09-9f8f-c9d8994119bb tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ba630c9-4bed-4be0-b431-d6f7c24d6e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bb36358f-59b1-4c09-9f8f-c9d8994119bb tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd202779-c32c-49ec-af3d-7d274a7f6a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bb36358f-59b1-4c09-9f8f-c9d8994119bb tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd202779-c32c-49ec-af3d-7d274a7f6a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60431121-5b2f-483c-ad23-0616d54ca009', 'volume_name': 'volume-60431121-5b2f-483c-ad23-0616d54ca009', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bb36358f-59b1-4c09-9f8f-c9d8994119bb tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82d760ba-4d8d-40f3-993f-97085c0b31fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bb36358f-59b1-4c09-9f8f-c9d8994119bb tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82d760ba-4d8d-40f3-993f-97085c0b31fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bb36358f-59b1-4c09-9f8f-c9d8994119bb tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5925926-7c8f-4cf2-a4cd-65fe66df7272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:14 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-bb36358f-59b1-4c09-9f8f-c9d8994119bb tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Volume 60431121-5b2f-483c-ad23-0616d54ca009: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60431121-5b2f-483c-ad23-0616d54ca009', 'volume_size': 1}
Nov 05 19:19:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bb36358f-59b1-4c09-9f8f-c9d8994119bb tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:19:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bee0921d-677c-4102-8eb9-1a9a0de0b1c6 tempest-VolumesTransfersTest-1709885445 None] Acquiring lock "cinder-08888765-f35e-4dcb-bee4-2b09d1bde662-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:19:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bee0921d-677c-4102-8eb9-1a9a0de0b1c6 tempest-VolumesTransfersTest-1709885445 None] Lock "cinder-08888765-f35e-4dcb-bee4-2b09d1bde662-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:19:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bee0921d-677c-4102-8eb9-1a9a0de0b1c6 tempest-VolumesTransfersTest-1709885445 None] Acquiring lock "cinder-quobyte-08888765-f35e-4dcb-bee4-2b09d1bde662" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:19:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bee0921d-677c-4102-8eb9-1a9a0de0b1c6 tempest-VolumesTransfersTest-1709885445 None] Lock "cinder-quobyte-08888765-f35e-4dcb-bee4-2b09d1bde662" acquired by "delete_volume" :: waited 0.069s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:19:14 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87c3f83-53a3-48e4-92c0-c810b406b0e8]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:19:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bee0921d-677c-4102-8eb9-1a9a0de0b1c6 tempest-VolumesTransfersTest-1709885445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-08888765-f35e-4dcb-bee4-2b09d1bde662 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:14 devstack sudo[99689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-08888765-f35e-4dcb-bee4-2b09d1bde662
Nov 05 19:19:14 devstack sudo[99689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:15 devstack sudo[99689]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bee0921d-677c-4102-8eb9-1a9a0de0b1c6 tempest-VolumesTransfersTest-1709885445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-08888765-f35e-4dcb-bee4-2b09d1bde662" returned: 0 in 1.136s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bee0921d-677c-4102-8eb9-1a9a0de0b1c6 tempest-VolumesTransfersTest-1709885445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-08888765-f35e-4dcb-bee4-2b09d1bde662 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:15 devstack sudo[99703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-08888765-f35e-4dcb-bee4-2b09d1bde662
Nov 05 19:19:15 devstack sudo[99703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-dac910fc-d110-42a9-9d7c-4caa71f7f3b3 req-53a4b039-7db3-4adb-b5a4-ad0f945a1801 tempest-TestServerVolumeAttachmentScenario-2143879364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:19:15 devstack sudo[99703]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bee0921d-677c-4102-8eb9-1a9a0de0b1c6 tempest-VolumesTransfersTest-1709885445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-08888765-f35e-4dcb-bee4-2b09d1bde662" returned: 0 in 0.510s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bee0921d-677c-4102-8eb9-1a9a0de0b1c6 tempest-VolumesTransfersTest-1709885445 None] Lock "cinder-quobyte-08888765-f35e-4dcb-bee4-2b09d1bde662" released by "delete_volume" :: held 1.738s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:19:16 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-bee0921d-677c-4102-8eb9-1a9a0de0b1c6 tempest-VolumesTransfersTest-1709885445 None] Created reservations ['6671ea48-8c03-416b-9084-056f50692916', '6d9249d1-f6fd-4eab-9980-4bd7bfee3532', 'ddb21982-e91d-4e73-8a87-371f1d4a22f1', 'b9add396-28b5-42f1-ac17-e8a476fcee91'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:19:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bee0921d-677c-4102-8eb9-1a9a0de0b1c6 tempest-VolumesTransfersTest-1709885445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:19:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bee0921d-677c-4102-8eb9-1a9a0de0b1c6 tempest-VolumesTransfersTest-1709885445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:19:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bee0921d-677c-4102-8eb9-1a9a0de0b1c6 tempest-VolumesTransfersTest-1709885445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:19:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bee0921d-677c-4102-8eb9-1a9a0de0b1c6 tempest-VolumesTransfersTest-1709885445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:19:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bee0921d-677c-4102-8eb9-1a9a0de0b1c6 tempest-VolumesTransfersTest-1709885445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:19:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bee0921d-677c-4102-8eb9-1a9a0de0b1c6 tempest-VolumesTransfersTest-1709885445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:16 devstack sudo[99706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:19:16 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:16 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bee0921d-677c-4102-8eb9-1a9a0de0b1c6 tempest-VolumesTransfersTest-1709885445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.567s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:16 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-bee0921d-677c-4102-8eb9-1a9a0de0b1c6 tempest-VolumesTransfersTest-1709885445 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:19:16 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-bee0921d-677c-4102-8eb9-1a9a0de0b1c6 tempest-VolumesTransfersTest-1709885445 None] Deleted volume successfully.
Nov 05 19:19:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-bee0921d-677c-4102-8eb9-1a9a0de0b1c6 tempest-VolumesTransfersTest-1709885445 None] Lock "cinder-08888765-f35e-4dcb-bee4-2b09d1bde662-delete_volume" released by "delete_volume" :: held 2.828s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:19:17 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5045539-7c00-4795-9ab5-44293d54c75d tempest-VolumesTransfersTest-1149999727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:19:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f5045539-7c00-4795-9ab5-44293d54c75d tempest-VolumesTransfersTest-1149999727 None] Flow 'volume_create_manager' (ea726dc3-28c5-4437-a872-3c07e01fd0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:19:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f5045539-7c00-4795-9ab5-44293d54c75d tempest-VolumesTransfersTest-1149999727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0109758-06a5-432a-b8d4-278478447405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f5045539-7c00-4795-9ab5-44293d54c75d tempest-VolumesTransfersTest-1149999727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0109758-06a5-432a-b8d4-278478447405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1028557837',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff70229b-fedc-44be-96da-17381281c355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fca3ec2cca5849d8a1da8291465d6d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:19:17Z,use_quota=True,user_id='0393751964e24d42900cc8ba6db3ff26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f5045539-7c00-4795-9ab5-44293d54c75d tempest-VolumesTransfersTest-1149999727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f51e47e7-2cce-4c89-ace0-098c61c9a3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f5045539-7c00-4795-9ab5-44293d54c75d tempest-VolumesTransfersTest-1149999727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f51e47e7-2cce-4c89-ace0-098c61c9a3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f5045539-7c00-4795-9ab5-44293d54c75d tempest-VolumesTransfersTest-1149999727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5aa1d8e-e4c5-41af-ac5a-cf211b5dc35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f5045539-7c00-4795-9ab5-44293d54c75d tempest-VolumesTransfersTest-1149999727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5aa1d8e-e4c5-41af-ac5a-cf211b5dc35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff70229b-fedc-44be-96da-17381281c355', 'volume_name': 'volume-ff70229b-fedc-44be-96da-17381281c355', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f5045539-7c00-4795-9ab5-44293d54c75d tempest-VolumesTransfersTest-1149999727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (562468e4-5b77-4415-9f57-1050125aefb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f5045539-7c00-4795-9ab5-44293d54c75d tempest-VolumesTransfersTest-1149999727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (562468e4-5b77-4415-9f57-1050125aefb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f5045539-7c00-4795-9ab5-44293d54c75d tempest-VolumesTransfersTest-1149999727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3309bd5-ab05-409e-ae54-3578818b8dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:17 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-f5045539-7c00-4795-9ab5-44293d54c75d tempest-VolumesTransfersTest-1149999727 None] Volume ff70229b-fedc-44be-96da-17381281c355: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff70229b-fedc-44be-96da-17381281c355', 'volume_size': 1}
Nov 05 19:19:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f5045539-7c00-4795-9ab5-44293d54c75d tempest-VolumesTransfersTest-1149999727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:19:18 devstack sudo[99674]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f104c1ca-58ec-449d-a861-e8a8cf20dfc4 tempest-VolumesActionsTest-2059143216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4d2d6a8-1b4c-4e76-94a5-6934fff57484 /opt/stack/data/cinder/conversion/a4d2d6a8-1b4c-4e76-94a5-6934fff57484.temp_image.26c732c4-a703-4cea-afa1-08a5fc2fc360og8f_1fs.img" returned: 0 in 8.405s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:18 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7806fd10-e9b6-4a73-b7f1-b73e1c003059]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:19:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f104c1ca-58ec-449d-a861-e8a8cf20dfc4 tempest-VolumesActionsTest-2059143216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4d2d6a8-1b4c-4e76-94a5-6934fff57484 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:18 devstack sudo[99710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4d2d6a8-1b4c-4e76-94a5-6934fff57484
Nov 05 19:19:18 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:19 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f104c1ca-58ec-449d-a861-e8a8cf20dfc4 tempest-VolumesActionsTest-2059143216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4d2d6a8-1b4c-4e76-94a5-6934fff57484" returned: 0 in 0.514s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:19 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-f104c1ca-58ec-449d-a861-e8a8cf20dfc4 tempest-VolumesActionsTest-2059143216 None] Image conversion details: src /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4d2d6a8-1b4c-4e76-94a5-6934fff57484, size 1024.00 MB, duration 8.41 sec, destination /opt/stack/data/cinder/conversion/a4d2d6a8-1b4c-4e76-94a5-6934fff57484.temp_image.26c732c4-a703-4cea-afa1-08a5fc2fc360og8f_1fs.img {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 19:19:19 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-f104c1ca-58ec-449d-a861-e8a8cf20dfc4 tempest-VolumesActionsTest-2059143216 None] Converted 1024.00 MB image at 121.82 MB/s
Nov 05 19:19:19 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-f104c1ca-58ec-449d-a861-e8a8cf20dfc4 tempest-VolumesActionsTest-2059143216 None] 26c732c4-a703-4cea-afa1-08a5fc2fc360 was raw, converting to qcow2 {{(pid=87184) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}}
Nov 05 19:19:19 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2ed8c9-bf1e-4eda-8b45-ba042eb62d25]: (4, 'raw') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:19:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f104c1ca-58ec-449d-a861-e8a8cf20dfc4 tempest-VolumesActionsTest-2059143216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a4d2d6a8-1b4c-4e76-94a5-6934fff57484.temp_image.26c732c4-a703-4cea-afa1-08a5fc2fc360og8f_1fs.img {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:19 devstack sudo[99715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a4d2d6a8-1b4c-4e76-94a5-6934fff57484.temp_image.26c732c4-a703-4cea-afa1-08a5fc2fc360og8f_1fs.img
Nov 05 19:19:19 devstack sudo[99715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:19 devstack sudo[99715]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f104c1ca-58ec-449d-a861-e8a8cf20dfc4 tempest-VolumesActionsTest-2059143216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a4d2d6a8-1b4c-4e76-94a5-6934fff57484.temp_image.26c732c4-a703-4cea-afa1-08a5fc2fc360og8f_1fs.img" returned: 0 in 0.313s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f104c1ca-58ec-449d-a861-e8a8cf20dfc4 tempest-VolumesActionsTest-2059143216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a4d2d6a8-1b4c-4e76-94a5-6934fff57484.temp_image.26c732c4-a703-4cea-afa1-08a5fc2fc360og8f_1fs.img {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:19 devstack sudo[99719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a4d2d6a8-1b4c-4e76-94a5-6934fff57484.temp_image.26c732c4-a703-4cea-afa1-08a5fc2fc360og8f_1fs.img
Nov 05 19:19:19 devstack sudo[99719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:19 devstack sudo[99719]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f104c1ca-58ec-449d-a861-e8a8cf20dfc4 tempest-VolumesActionsTest-2059143216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a4d2d6a8-1b4c-4e76-94a5-6934fff57484.temp_image.26c732c4-a703-4cea-afa1-08a5fc2fc360og8f_1fs.img" returned: 1 in 0.312s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f104c1ca-58ec-449d-a861-e8a8cf20dfc4 tempest-VolumesActionsTest-2059143216 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a4d2d6a8-1b4c-4e76-94a5-6934fff57484.temp_image.26c732c4-a703-4cea-afa1-08a5fc2fc360og8f_1fs.img' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 19:19:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f104c1ca-58ec-449d-a861-e8a8cf20dfc4 tempest-VolumesActionsTest-2059143216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a4d2d6a8-1b4c-4e76-94a5-6934fff57484.temp_image.26c732c4-a703-4cea-afa1-08a5fc2fc360og8f_1fs.img /opt/stack/data/cinder/conversion/vol_upload_9upi37nb {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:19 devstack sudo[99724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a4d2d6a8-1b4c-4e76-94a5-6934fff57484.temp_image.26c732c4-a703-4cea-afa1-08a5fc2fc360og8f_1fs.img /opt/stack/data/cinder/conversion/vol_upload_9upi37nb
Nov 05 19:19:19 devstack sudo[99724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:19 devstack sudo[99724]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f104c1ca-58ec-449d-a861-e8a8cf20dfc4 tempest-VolumesActionsTest-2059143216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a4d2d6a8-1b4c-4e76-94a5-6934fff57484.temp_image.26c732c4-a703-4cea-afa1-08a5fc2fc360og8f_1fs.img /opt/stack/data/cinder/conversion/vol_upload_9upi37nb" returned: 0 in 0.250s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:20 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-f104c1ca-58ec-449d-a861-e8a8cf20dfc4 tempest-VolumesActionsTest-2059143216 None] Image conversion details: src /opt/stack/data/cinder/conversion/a4d2d6a8-1b4c-4e76-94a5-6934fff57484.temp_image.26c732c4-a703-4cea-afa1-08a5fc2fc360og8f_1fs.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_9upi37nb {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 19:19:20 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-f104c1ca-58ec-449d-a861-e8a8cf20dfc4 tempest-VolumesActionsTest-2059143216 None] Converted 1024.00 MB image at 1024.00 MB/s
Nov 05 19:19:20 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a23dabb-5f18-44e2-aa23-2dcbc2f0aad2]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:19:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f104c1ca-58ec-449d-a861-e8a8cf20dfc4 tempest-VolumesActionsTest-2059143216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_9upi37nb {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:20 devstack sudo[99729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_9upi37nb
Nov 05 19:19:20 devstack sudo[99729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:20 devstack sudo[99729]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f104c1ca-58ec-449d-a861-e8a8cf20dfc4 tempest-VolumesActionsTest-2059143216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_9upi37nb" returned: 0 in 0.311s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f104c1ca-58ec-449d-a861-e8a8cf20dfc4 tempest-VolumesActionsTest-2059143216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.225s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:19:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f104c1ca-58ec-449d-a861-e8a8cf20dfc4 tempest-VolumesActionsTest-2059143216 None] Uploaded volume to glance image-id: 26c732c4-a703-4cea-afa1-08a5fc2fc360. {{(pid=87184) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 05 19:19:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-33087972-cfc8-447a-b43a-3188acea6fbc tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.204s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:19:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-33087972-cfc8-447a-b43a-3188acea6fbc tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-293446299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea22e12-941e-4e6a-a285-70be1e0c92f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31e3c3dac4bc45f984cf69f6b2c5d89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:19:10Z,use_quota=True,user_id='785ef48a003945cfa58b4a7e84c99caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:19:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-33087972-cfc8-447a-b43a-3188acea6fbc tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Creating volume eea22e12-941e-4e6a-a285-70be1e0c92f3 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:19:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-33087972-cfc8-447a-b43a-3188acea6fbc tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:19:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-33087972-cfc8-447a-b43a-3188acea6fbc tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:19:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-33087972-cfc8-447a-b43a-3188acea6fbc tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:19:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-33087972-cfc8-447a-b43a-3188acea6fbc tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:19:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-33087972-cfc8-447a-b43a-3188acea6fbc tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:19:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-33087972-cfc8-447a-b43a-3188acea6fbc tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:19:21 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-33087972-cfc8-447a-b43a-3188acea6fbc tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:19:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-33087972-cfc8-447a-b43a-3188acea6fbc tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-eea22e12-941e-4e6a-a285-70be1e0c92f3 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:21 devstack sudo[99734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-eea22e12-941e-4e6a-a285-70be1e0c92f3 1073741824
Nov 05 19:19:21 devstack sudo[99734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:21 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f104c1ca-58ec-449d-a861-e8a8cf20dfc4 tempest-VolumesActionsTest-2059143216 None] Copy volume to image completed successfully.
Nov 05 19:19:21 devstack sudo[99734]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-33087972-cfc8-447a-b43a-3188acea6fbc tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-eea22e12-941e-4e6a-a285-70be1e0c92f3 1073741824" returned: 0 in 0.466s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-33087972-cfc8-447a-b43a-3188acea6fbc tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-eea22e12-941e-4e6a-a285-70be1e0c92f3 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:22 devstack sudo[99740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-eea22e12-941e-4e6a-a285-70be1e0c92f3
Nov 05 19:19:22 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:22 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-33087972-cfc8-447a-b43a-3188acea6fbc tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-eea22e12-941e-4e6a-a285-70be1e0c92f3" returned: 0 in 0.247s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-33087972-cfc8-447a-b43a-3188acea6fbc tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:19:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-33087972-cfc8-447a-b43a-3188acea6fbc tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:19:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-92e22b9b-d7c6-4145-89a7-315580e22a4a tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.489s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:19:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-92e22b9b-d7c6-4145-89a7-315580e22a4a tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1305345671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96f5a2a8-3478-4df0-9323-b839baf97491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31e3c3dac4bc45f984cf69f6b2c5d89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:19:11Z,use_quota=True,user_id='785ef48a003945cfa58b4a7e84c99caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:19:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-92e22b9b-d7c6-4145-89a7-315580e22a4a tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Creating volume 96f5a2a8-3478-4df0-9323-b839baf97491 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:19:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-92e22b9b-d7c6-4145-89a7-315580e22a4a tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:19:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-92e22b9b-d7c6-4145-89a7-315580e22a4a tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:19:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-92e22b9b-d7c6-4145-89a7-315580e22a4a tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:19:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-92e22b9b-d7c6-4145-89a7-315580e22a4a tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:19:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-92e22b9b-d7c6-4145-89a7-315580e22a4a tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:19:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-92e22b9b-d7c6-4145-89a7-315580e22a4a tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:19:22 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-92e22b9b-d7c6-4145-89a7-315580e22a4a tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:19:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-92e22b9b-d7c6-4145-89a7-315580e22a4a tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-96f5a2a8-3478-4df0-9323-b839baf97491 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-33087972-cfc8-447a-b43a-3188acea6fbc tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (842d4a5f-ab8c-4ff0-8d12-322a0c034384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eea22e12-941e-4e6a-a285-70be1e0c92f3', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-33087972-cfc8-447a-b43a-3188acea6fbc tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d66466dc-8fae-4e1f-afce-d9f905e531bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:22 devstack sudo[99743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-96f5a2a8-3478-4df0-9323-b839baf97491 1073741824
Nov 05 19:19:22 devstack sudo[99743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:22 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-33087972-cfc8-447a-b43a-3188acea6fbc tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Volume volume-eea22e12-941e-4e6a-a285-70be1e0c92f3 (eea22e12-941e-4e6a-a285-70be1e0c92f3): created successfully
Nov 05 19:19:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-33087972-cfc8-447a-b43a-3188acea6fbc tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d66466dc-8fae-4e1f-afce-d9f905e531bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-33087972-cfc8-447a-b43a-3188acea6fbc tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Flow 'volume_create_manager' (614e7a58-aafa-44c3-8e01-2dbe42992b07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:19:22 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-33087972-cfc8-447a-b43a-3188acea6fbc tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Created volume successfully.
Nov 05 19:19:22 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8b8432bd-398c-43f0-be37-3f4570efd058 tempest-VolumesActionsTest-2059143216 None] Acquiring lock "cinder-a4d2d6a8-1b4c-4e76-94a5-6934fff57484-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:19:22 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8b8432bd-398c-43f0-be37-3f4570efd058 tempest-VolumesActionsTest-2059143216 None] Lock "cinder-a4d2d6a8-1b4c-4e76-94a5-6934fff57484-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:19:22 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8b8432bd-398c-43f0-be37-3f4570efd058 tempest-VolumesActionsTest-2059143216 None] Acquiring lock "cinder-quobyte-a4d2d6a8-1b4c-4e76-94a5-6934fff57484" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:19:22 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8b8432bd-398c-43f0-be37-3f4570efd058 tempest-VolumesActionsTest-2059143216 None] Lock "cinder-quobyte-a4d2d6a8-1b4c-4e76-94a5-6934fff57484" acquired by "delete_volume" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:19:22 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d728178a-16c2-4c62-87df-95c28ab88134]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:19:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8b8432bd-398c-43f0-be37-3f4570efd058 tempest-VolumesActionsTest-2059143216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4d2d6a8-1b4c-4e76-94a5-6934fff57484 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:22 devstack sudo[99748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4d2d6a8-1b4c-4e76-94a5-6934fff57484
Nov 05 19:19:22 devstack sudo[99748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:22 devstack sudo[99743]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-92e22b9b-d7c6-4145-89a7-315580e22a4a tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-96f5a2a8-3478-4df0-9323-b839baf97491 1073741824" returned: 0 in 0.501s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-92e22b9b-d7c6-4145-89a7-315580e22a4a tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-96f5a2a8-3478-4df0-9323-b839baf97491 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:22 devstack sudo[99751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-96f5a2a8-3478-4df0-9323-b839baf97491
Nov 05 19:19:22 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:22 devstack sudo[99748]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8b8432bd-398c-43f0-be37-3f4570efd058 tempest-VolumesActionsTest-2059143216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4d2d6a8-1b4c-4e76-94a5-6934fff57484" returned: 0 in 0.399s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8b8432bd-398c-43f0-be37-3f4570efd058 tempest-VolumesActionsTest-2059143216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4d2d6a8-1b4c-4e76-94a5-6934fff57484 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:22 devstack sudo[99756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4d2d6a8-1b4c-4e76-94a5-6934fff57484
Nov 05 19:19:22 devstack sudo[99756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:23 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-92e22b9b-d7c6-4145-89a7-315580e22a4a tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-96f5a2a8-3478-4df0-9323-b839baf97491" returned: 0 in 0.284s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-92e22b9b-d7c6-4145-89a7-315580e22a4a tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-92e22b9b-d7c6-4145-89a7-315580e22a4a tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dd8ac0d0-0670-4755-ae74-6c0c7e0cc65d tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.953s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dd8ac0d0-0670-4755-ae74-6c0c7e0cc65d tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-664430727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd5a56a9-990e-4f00-928f-5d6a2e4960bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31e3c3dac4bc45f984cf69f6b2c5d89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:19:12Z,use_quota=True,user_id='785ef48a003945cfa58b4a7e84c99caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-dd8ac0d0-0670-4755-ae74-6c0c7e0cc65d tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Creating volume dd5a56a9-990e-4f00-928f-5d6a2e4960bf {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dd8ac0d0-0670-4755-ae74-6c0c7e0cc65d tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dd8ac0d0-0670-4755-ae74-6c0c7e0cc65d tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dd8ac0d0-0670-4755-ae74-6c0c7e0cc65d tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dd8ac0d0-0670-4755-ae74-6c0c7e0cc65d tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dd8ac0d0-0670-4755-ae74-6c0c7e0cc65d tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dd8ac0d0-0670-4755-ae74-6c0c7e0cc65d tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:19:23 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-dd8ac0d0-0670-4755-ae74-6c0c7e0cc65d tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd8ac0d0-0670-4755-ae74-6c0c7e0cc65d tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dd5a56a9-990e-4f00-928f-5d6a2e4960bf 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-92e22b9b-d7c6-4145-89a7-315580e22a4a tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d05185f-c9db-4e47-b55e-735f96ee49ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96f5a2a8-3478-4df0-9323-b839baf97491', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-92e22b9b-d7c6-4145-89a7-315580e22a4a tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec06da2f-1d71-40bb-87d9-a5b337a9379d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:23 devstack sudo[99759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dd5a56a9-990e-4f00-928f-5d6a2e4960bf 1073741824
Nov 05 19:19:23 devstack sudo[99759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:23 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-92e22b9b-d7c6-4145-89a7-315580e22a4a tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Volume volume-96f5a2a8-3478-4df0-9323-b839baf97491 (96f5a2a8-3478-4df0-9323-b839baf97491): created successfully
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-92e22b9b-d7c6-4145-89a7-315580e22a4a tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec06da2f-1d71-40bb-87d9-a5b337a9379d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-92e22b9b-d7c6-4145-89a7-315580e22a4a tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Flow 'volume_create_manager' (0cdf9ed4-9b10-409c-beea-74a1442f5008) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:19:23 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-92e22b9b-d7c6-4145-89a7-315580e22a4a tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Created volume successfully.
Nov 05 19:19:23 devstack sudo[99756]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8b8432bd-398c-43f0-be37-3f4570efd058 tempest-VolumesActionsTest-2059143216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a4d2d6a8-1b4c-4e76-94a5-6934fff57484" returned: 0 in 0.251s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8b8432bd-398c-43f0-be37-3f4570efd058 tempest-VolumesActionsTest-2059143216 None] Lock "cinder-quobyte-a4d2d6a8-1b4c-4e76-94a5-6934fff57484" released by "delete_volume" :: held 0.688s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-8b8432bd-398c-43f0-be37-3f4570efd058 tempest-VolumesActionsTest-2059143216 None] Created reservations ['0bf72de0-2e49-4d07-99d7-11882e522eee', 'a16ada02-0bef-490a-9613-a057a976c8c2', '25ec578b-723f-4840-a2d0-088c88ebe8ec', 'b278976f-07bd-4485-8c35-e9365668fcc0'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8b8432bd-398c-43f0-be37-3f4570efd058 tempest-VolumesActionsTest-2059143216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8b8432bd-398c-43f0-be37-3f4570efd058 tempest-VolumesActionsTest-2059143216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8b8432bd-398c-43f0-be37-3f4570efd058 tempest-VolumesActionsTest-2059143216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8b8432bd-398c-43f0-be37-3f4570efd058 tempest-VolumesActionsTest-2059143216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8b8432bd-398c-43f0-be37-3f4570efd058 tempest-VolumesActionsTest-2059143216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8b8432bd-398c-43f0-be37-3f4570efd058 tempest-VolumesActionsTest-2059143216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:23 devstack sudo[99763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:19:23 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:23 devstack sudo[99759]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd8ac0d0-0670-4755-ae74-6c0c7e0cc65d tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dd5a56a9-990e-4f00-928f-5d6a2e4960bf 1073741824" returned: 0 in 0.482s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:23 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8b8432bd-398c-43f0-be37-3f4570efd058 tempest-VolumesActionsTest-2059143216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.264s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-8b8432bd-398c-43f0-be37-3f4570efd058 tempest-VolumesActionsTest-2059143216 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:19:23 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-8b8432bd-398c-43f0-be37-3f4570efd058 tempest-VolumesActionsTest-2059143216 None] Deleted volume successfully.
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd8ac0d0-0670-4755-ae74-6c0c7e0cc65d tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dd5a56a9-990e-4f00-928f-5d6a2e4960bf {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8b8432bd-398c-43f0-be37-3f4570efd058 tempest-VolumesActionsTest-2059143216 None] Lock "cinder-a4d2d6a8-1b4c-4e76-94a5-6934fff57484-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:19:23 devstack sudo[99768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dd5a56a9-990e-4f00-928f-5d6a2e4960bf
Nov 05 19:19:23 devstack sudo[99768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:23 devstack sudo[99768]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dd8ac0d0-0670-4755-ae74-6c0c7e0cc65d tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dd5a56a9-990e-4f00-928f-5d6a2e4960bf" returned: 0 in 0.276s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dd8ac0d0-0670-4755-ae74-6c0c7e0cc65d tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dd8ac0d0-0670-4755-ae74-6c0c7e0cc65d tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dae8bf17-30c8-4792-8d74-d8a4d20f6409 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.017s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dae8bf17-30c8-4792-8d74-d8a4d20f6409 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1611095452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afd63d1b-27af-497e-b568-17d44f8b881c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31e3c3dac4bc45f984cf69f6b2c5d89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:19:13Z,use_quota=True,user_id='785ef48a003945cfa58b4a7e84c99caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-dae8bf17-30c8-4792-8d74-d8a4d20f6409 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Creating volume afd63d1b-27af-497e-b568-17d44f8b881c {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dae8bf17-30c8-4792-8d74-d8a4d20f6409 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dae8bf17-30c8-4792-8d74-d8a4d20f6409 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dae8bf17-30c8-4792-8d74-d8a4d20f6409 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dae8bf17-30c8-4792-8d74-d8a4d20f6409 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dae8bf17-30c8-4792-8d74-d8a4d20f6409 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dae8bf17-30c8-4792-8d74-d8a4d20f6409 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:19:23 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-dae8bf17-30c8-4792-8d74-d8a4d20f6409 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dae8bf17-30c8-4792-8d74-d8a4d20f6409 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-afd63d1b-27af-497e-b568-17d44f8b881c 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:23 devstack sudo[99771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-afd63d1b-27af-497e-b568-17d44f8b881c 1073741824
Nov 05 19:19:23 devstack sudo[99771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dd8ac0d0-0670-4755-ae74-6c0c7e0cc65d tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c703acb1-f0d9-48e8-bcbf-58e2ad5cd7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd5a56a9-990e-4f00-928f-5d6a2e4960bf', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dd8ac0d0-0670-4755-ae74-6c0c7e0cc65d tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4fa58eb-c56d-4498-9009-d21881bdca03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:24 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-dd8ac0d0-0670-4755-ae74-6c0c7e0cc65d tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Volume volume-dd5a56a9-990e-4f00-928f-5d6a2e4960bf (dd5a56a9-990e-4f00-928f-5d6a2e4960bf): created successfully
Nov 05 19:19:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dd8ac0d0-0670-4755-ae74-6c0c7e0cc65d tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4fa58eb-c56d-4498-9009-d21881bdca03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dd8ac0d0-0670-4755-ae74-6c0c7e0cc65d tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Flow 'volume_create_manager' (bc211775-4003-4e47-907b-46d32df616ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:19:24 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-dd8ac0d0-0670-4755-ae74-6c0c7e0cc65d tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Created volume successfully.
Nov 05 19:19:24 devstack sudo[99771]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dae8bf17-30c8-4792-8d74-d8a4d20f6409 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-afd63d1b-27af-497e-b568-17d44f8b881c 1073741824" returned: 0 in 0.501s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dae8bf17-30c8-4792-8d74-d8a4d20f6409 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-afd63d1b-27af-497e-b568-17d44f8b881c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:24 devstack sudo[99777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-afd63d1b-27af-497e-b568-17d44f8b881c
Nov 05 19:19:24 devstack sudo[99777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:24 devstack sudo[99777]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-dae8bf17-30c8-4792-8d74-d8a4d20f6409 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-afd63d1b-27af-497e-b568-17d44f8b881c" returned: 0 in 0.251s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-dae8bf17-30c8-4792-8d74-d8a4d20f6409 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:19:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-dae8bf17-30c8-4792-8d74-d8a4d20f6409 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:19:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bb36358f-59b1-4c09-9f8f-c9d8994119bb tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.654s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:19:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bb36358f-59b1-4c09-9f8f-c9d8994119bb tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-20620919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60431121-5b2f-483c-ad23-0616d54ca009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31e3c3dac4bc45f984cf69f6b2c5d89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:19:14Z,use_quota=True,user_id='785ef48a003945cfa58b4a7e84c99caa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:19:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-bb36358f-59b1-4c09-9f8f-c9d8994119bb tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Creating volume 60431121-5b2f-483c-ad23-0616d54ca009 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:19:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bb36358f-59b1-4c09-9f8f-c9d8994119bb tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:19:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bb36358f-59b1-4c09-9f8f-c9d8994119bb tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:19:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bb36358f-59b1-4c09-9f8f-c9d8994119bb tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:19:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bb36358f-59b1-4c09-9f8f-c9d8994119bb tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:19:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bb36358f-59b1-4c09-9f8f-c9d8994119bb tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:19:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bb36358f-59b1-4c09-9f8f-c9d8994119bb tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:19:24 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-bb36358f-59b1-4c09-9f8f-c9d8994119bb tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:19:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bb36358f-59b1-4c09-9f8f-c9d8994119bb tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-60431121-5b2f-483c-ad23-0616d54ca009 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dae8bf17-30c8-4792-8d74-d8a4d20f6409 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85bac9f3-8e96-444b-889e-7f907d227d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afd63d1b-27af-497e-b568-17d44f8b881c', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dae8bf17-30c8-4792-8d74-d8a4d20f6409 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (500ecb62-6562-4cd1-b92e-a15990e36a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:24 devstack sudo[99780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-60431121-5b2f-483c-ad23-0616d54ca009 1073741824
Nov 05 19:19:24 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:24 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-dae8bf17-30c8-4792-8d74-d8a4d20f6409 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Volume volume-afd63d1b-27af-497e-b568-17d44f8b881c (afd63d1b-27af-497e-b568-17d44f8b881c): created successfully
Nov 05 19:19:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dae8bf17-30c8-4792-8d74-d8a4d20f6409 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (500ecb62-6562-4cd1-b92e-a15990e36a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-dae8bf17-30c8-4792-8d74-d8a4d20f6409 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Flow 'volume_create_manager' (4f1824c2-676e-4dc3-abcc-16928ba6e2a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:19:24 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-dae8bf17-30c8-4792-8d74-d8a4d20f6409 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Created volume successfully.
Nov 05 19:19:25 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bb36358f-59b1-4c09-9f8f-c9d8994119bb tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-60431121-5b2f-483c-ad23-0616d54ca009 1073741824" returned: 0 in 0.578s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bb36358f-59b1-4c09-9f8f-c9d8994119bb tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-60431121-5b2f-483c-ad23-0616d54ca009 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:25 devstack sudo[99787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-60431121-5b2f-483c-ad23-0616d54ca009
Nov 05 19:19:25 devstack sudo[99787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:25 devstack sudo[99787]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bb36358f-59b1-4c09-9f8f-c9d8994119bb tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-60431121-5b2f-483c-ad23-0616d54ca009" returned: 0 in 0.256s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bb36358f-59b1-4c09-9f8f-c9d8994119bb tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:19:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bb36358f-59b1-4c09-9f8f-c9d8994119bb tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:19:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-dac910fc-d110-42a9-9d7c-4caa71f7f3b3 req-53a4b039-7db3-4adb-b5a4-ad0f945a1801 tempest-TestServerVolumeAttachmentScenario-2143879364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:19:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-dac910fc-d110-42a9-9d7c-4caa71f7f3b3 req-53a4b039-7db3-4adb-b5a4-ad0f945a1801 tempest-TestServerVolumeAttachmentScenario-2143879364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:19:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f5045539-7c00-4795-9ab5-44293d54c75d tempest-VolumesTransfersTest-1149999727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.981s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:19:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f5045539-7c00-4795-9ab5-44293d54c75d tempest-VolumesTransfersTest-1149999727 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1028557837',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff70229b-fedc-44be-96da-17381281c355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fca3ec2cca5849d8a1da8291465d6d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:19:17Z,use_quota=True,user_id='0393751964e24d42900cc8ba6db3ff26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:19:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-f5045539-7c00-4795-9ab5-44293d54c75d tempest-VolumesTransfersTest-1149999727 None] Creating volume ff70229b-fedc-44be-96da-17381281c355 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:19:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f5045539-7c00-4795-9ab5-44293d54c75d tempest-VolumesTransfersTest-1149999727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:19:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f5045539-7c00-4795-9ab5-44293d54c75d tempest-VolumesTransfersTest-1149999727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:19:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f5045539-7c00-4795-9ab5-44293d54c75d tempest-VolumesTransfersTest-1149999727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:19:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f5045539-7c00-4795-9ab5-44293d54c75d tempest-VolumesTransfersTest-1149999727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:19:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f5045539-7c00-4795-9ab5-44293d54c75d tempest-VolumesTransfersTest-1149999727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:19:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f5045539-7c00-4795-9ab5-44293d54c75d tempest-VolumesTransfersTest-1149999727 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:19:25 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-f5045539-7c00-4795-9ab5-44293d54c75d tempest-VolumesTransfersTest-1149999727 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:19:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f5045539-7c00-4795-9ab5-44293d54c75d tempest-VolumesTransfersTest-1149999727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ff70229b-fedc-44be-96da-17381281c355 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bb36358f-59b1-4c09-9f8f-c9d8994119bb tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5925926-7c8f-4cf2-a4cd-65fe66df7272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60431121-5b2f-483c-ad23-0616d54ca009', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:25 devstack sudo[99790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ff70229b-fedc-44be-96da-17381281c355 1073741824
Nov 05 19:19:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bb36358f-59b1-4c09-9f8f-c9d8994119bb tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b80c216-a4ac-4b16-b8a4-e7e363516cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:25 devstack sudo[99790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:25 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-bb36358f-59b1-4c09-9f8f-c9d8994119bb tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Volume volume-60431121-5b2f-483c-ad23-0616d54ca009 (60431121-5b2f-483c-ad23-0616d54ca009): created successfully
Nov 05 19:19:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bb36358f-59b1-4c09-9f8f-c9d8994119bb tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b80c216-a4ac-4b16-b8a4-e7e363516cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bb36358f-59b1-4c09-9f8f-c9d8994119bb tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Flow 'volume_create_manager' (630a826e-f689-4b05-8f3a-5f5c6ee70a86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:19:25 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-bb36358f-59b1-4c09-9f8f-c9d8994119bb tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Created volume successfully.
Nov 05 19:19:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-dac910fc-d110-42a9-9d7c-4caa71f7f3b3 req-53a4b039-7db3-4adb-b5a4-ad0f945a1801 tempest-TestServerVolumeAttachmentScenario-2143879364 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec', 'name': 'volume-dabe7fcc-6013-41b0-aa53-a8ee0cf89454', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0b836737-38f9-453d-9d49-f493b29bda92', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 19:19:25 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-dac910fc-d110-42a9-9d7c-4caa71f7f3b3 req-53a4b039-7db3-4adb-b5a4-ad0f945a1801 tempest-TestServerVolumeAttachmentScenario-2143879364 None] attachment_update completed successfully.
Nov 05 19:19:26 devstack sudo[99790]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f5045539-7c00-4795-9ab5-44293d54c75d tempest-VolumesTransfersTest-1149999727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ff70229b-fedc-44be-96da-17381281c355 1073741824" returned: 0 in 0.568s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f5045539-7c00-4795-9ab5-44293d54c75d tempest-VolumesTransfersTest-1149999727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ff70229b-fedc-44be-96da-17381281c355 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:26 devstack sudo[99800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ff70229b-fedc-44be-96da-17381281c355
Nov 05 19:19:26 devstack sudo[99800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-918b1a02-448b-4b0e-82c4-b63ab3cd191c tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Acquiring lock "cinder-60431121-5b2f-483c-ad23-0616d54ca009-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:19:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-918b1a02-448b-4b0e-82c4-b63ab3cd191c tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "cinder-60431121-5b2f-483c-ad23-0616d54ca009-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:19:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-918b1a02-448b-4b0e-82c4-b63ab3cd191c tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Acquiring lock "cinder-quobyte-60431121-5b2f-483c-ad23-0616d54ca009" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:19:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-918b1a02-448b-4b0e-82c4-b63ab3cd191c tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "cinder-quobyte-60431121-5b2f-483c-ad23-0616d54ca009" acquired by "delete_volume" :: waited 0.017s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:19:26 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee9b333-bddf-488a-af03-9ce3e282e7fa]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:19:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-918b1a02-448b-4b0e-82c4-b63ab3cd191c tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-60431121-5b2f-483c-ad23-0616d54ca009 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:26 devstack sudo[99800]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f5045539-7c00-4795-9ab5-44293d54c75d tempest-VolumesTransfersTest-1149999727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ff70229b-fedc-44be-96da-17381281c355" returned: 0 in 0.309s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f5045539-7c00-4795-9ab5-44293d54c75d tempest-VolumesTransfersTest-1149999727 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:19:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f5045539-7c00-4795-9ab5-44293d54c75d tempest-VolumesTransfersTest-1149999727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:19:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f5045539-7c00-4795-9ab5-44293d54c75d tempest-VolumesTransfersTest-1149999727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3309bd5-ab05-409e-ae54-3578818b8dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff70229b-fedc-44be-96da-17381281c355', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f5045539-7c00-4795-9ab5-44293d54c75d tempest-VolumesTransfersTest-1149999727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fc4bb30-a5c8-4034-af43-c13590feda27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:26 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-f5045539-7c00-4795-9ab5-44293d54c75d tempest-VolumesTransfersTest-1149999727 None] Volume volume-ff70229b-fedc-44be-96da-17381281c355 (ff70229b-fedc-44be-96da-17381281c355): created successfully
Nov 05 19:19:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f5045539-7c00-4795-9ab5-44293d54c75d tempest-VolumesTransfersTest-1149999727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fc4bb30-a5c8-4034-af43-c13590feda27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f5045539-7c00-4795-9ab5-44293d54c75d tempest-VolumesTransfersTest-1149999727 None] Flow 'volume_create_manager' (ea726dc3-28c5-4437-a872-3c07e01fd0fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:19:26 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f5045539-7c00-4795-9ab5-44293d54c75d tempest-VolumesTransfersTest-1149999727 None] Created volume successfully.
Nov 05 19:19:26 devstack sudo[99803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-60431121-5b2f-483c-ad23-0616d54ca009
Nov 05 19:19:26 devstack sudo[99803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:26 devstack sudo[99803]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-918b1a02-448b-4b0e-82c4-b63ab3cd191c tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-60431121-5b2f-483c-ad23-0616d54ca009" returned: 0 in 0.359s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-918b1a02-448b-4b0e-82c4-b63ab3cd191c tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-60431121-5b2f-483c-ad23-0616d54ca009 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:26 devstack sudo[99808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-60431121-5b2f-483c-ad23-0616d54ca009
Nov 05 19:19:26 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:27 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-918b1a02-448b-4b0e-82c4-b63ab3cd191c tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-60431121-5b2f-483c-ad23-0616d54ca009" returned: 0 in 0.275s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-918b1a02-448b-4b0e-82c4-b63ab3cd191c tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "cinder-quobyte-60431121-5b2f-483c-ad23-0616d54ca009" released by "delete_volume" :: held 0.724s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:19:27 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-918b1a02-448b-4b0e-82c4-b63ab3cd191c tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Created reservations ['d3e7b012-161f-4f3b-bf3f-9f86a4c4dd2f', '1b5a9798-d8fb-48cd-bd47-6f41534cc6e1', '16465418-470f-46e1-9350-4e0d66ba100d', 'f76dbff3-256a-4dfd-85ea-96bcd29d98d5'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:19:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-918b1a02-448b-4b0e-82c4-b63ab3cd191c tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:19:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-918b1a02-448b-4b0e-82c4-b63ab3cd191c tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:19:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-918b1a02-448b-4b0e-82c4-b63ab3cd191c tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:19:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-918b1a02-448b-4b0e-82c4-b63ab3cd191c tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:19:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-918b1a02-448b-4b0e-82c4-b63ab3cd191c tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:19:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-918b1a02-448b-4b0e-82c4-b63ab3cd191c tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:27 devstack sudo[99812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:19:27 devstack sudo[99812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c035536f-9c40-4735-a189-ac0e356de5ed tempest-VolumesTransfersTest-1709885445 None] Acquiring lock "cinder-ff70229b-fedc-44be-96da-17381281c355-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:19:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c035536f-9c40-4735-a189-ac0e356de5ed tempest-VolumesTransfersTest-1709885445 None] Lock "cinder-ff70229b-fedc-44be-96da-17381281c355-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:19:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c035536f-9c40-4735-a189-ac0e356de5ed tempest-VolumesTransfersTest-1709885445 None] Acquiring lock "cinder-quobyte-ff70229b-fedc-44be-96da-17381281c355" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:19:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c035536f-9c40-4735-a189-ac0e356de5ed tempest-VolumesTransfersTest-1709885445 None] Lock "cinder-quobyte-ff70229b-fedc-44be-96da-17381281c355" acquired by "delete_volume" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:19:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0c56c53b-e613-47cf-bb2c-2b4f2af6bdd0 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Acquiring lock "cinder-afd63d1b-27af-497e-b568-17d44f8b881c-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:19:27 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[54cab37a-11da-4f06-9b91-7bb5340acf3b]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:19:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c035536f-9c40-4735-a189-ac0e356de5ed tempest-VolumesTransfersTest-1709885445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ff70229b-fedc-44be-96da-17381281c355 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0c56c53b-e613-47cf-bb2c-2b4f2af6bdd0 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "cinder-afd63d1b-27af-497e-b568-17d44f8b881c-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:19:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0c56c53b-e613-47cf-bb2c-2b4f2af6bdd0 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Acquiring lock "cinder-quobyte-afd63d1b-27af-497e-b568-17d44f8b881c" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:19:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0c56c53b-e613-47cf-bb2c-2b4f2af6bdd0 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "cinder-quobyte-afd63d1b-27af-497e-b568-17d44f8b881c" acquired by "delete_volume" :: waited 0.031s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:19:27 devstack sudo[99812]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:27 devstack sudo[99814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ff70229b-fedc-44be-96da-17381281c355
Nov 05 19:19:27 devstack sudo[99814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-918b1a02-448b-4b0e-82c4-b63ab3cd191c tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.470s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:27 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-918b1a02-448b-4b0e-82c4-b63ab3cd191c tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:19:27 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-918b1a02-448b-4b0e-82c4-b63ab3cd191c tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Deleted volume successfully.
Nov 05 19:19:27 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6c75da-dbd9-41ac-9520-c6ac2111b050]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:19:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0c56c53b-e613-47cf-bb2c-2b4f2af6bdd0 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-afd63d1b-27af-497e-b568-17d44f8b881c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:28 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-918b1a02-448b-4b0e-82c4-b63ab3cd191c tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "cinder-60431121-5b2f-483c-ad23-0616d54ca009-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:19:28 devstack sudo[99841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-afd63d1b-27af-497e-b568-17d44f8b881c
Nov 05 19:19:28 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:28 devstack sudo[99814]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c035536f-9c40-4735-a189-ac0e356de5ed tempest-VolumesTransfersTest-1709885445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ff70229b-fedc-44be-96da-17381281c355" returned: 0 in 0.546s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c035536f-9c40-4735-a189-ac0e356de5ed tempest-VolumesTransfersTest-1709885445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ff70229b-fedc-44be-96da-17381281c355 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:28 devstack sudo[99846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ff70229b-fedc-44be-96da-17381281c355
Nov 05 19:19:28 devstack sudo[99846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:28 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0c56c53b-e613-47cf-bb2c-2b4f2af6bdd0 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-afd63d1b-27af-497e-b568-17d44f8b881c" returned: 0 in 0.571s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0c56c53b-e613-47cf-bb2c-2b4f2af6bdd0 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-afd63d1b-27af-497e-b568-17d44f8b881c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:28 devstack sudo[99853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-afd63d1b-27af-497e-b568-17d44f8b881c
Nov 05 19:19:28 devstack sudo[99853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:28 devstack sudo[99846]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c035536f-9c40-4735-a189-ac0e356de5ed tempest-VolumesTransfersTest-1709885445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ff70229b-fedc-44be-96da-17381281c355" returned: 0 in 0.332s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:28 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c035536f-9c40-4735-a189-ac0e356de5ed tempest-VolumesTransfersTest-1709885445 None] Lock "cinder-quobyte-ff70229b-fedc-44be-96da-17381281c355" released by "delete_volume" :: held 0.966s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:19:28 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-16ab378c-1ef7-44b7-8233-6b9c2704b591 req-d568832c-587e-4fb0-ba4a-9dc77aafafff tempest-TestServerVolumeAttachmentScenario-2143879364 None] Terminate volume connection completed successfully.
Nov 05 19:19:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-16ab378c-1ef7-44b7-8233-6b9c2704b591 req-d568832c-587e-4fb0-ba4a-9dc77aafafff tempest-TestServerVolumeAttachmentScenario-2143879364 None] Deleting attachment 0b836737-38f9-453d-9d49-f493b29bda92. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 19:19:28 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-c035536f-9c40-4735-a189-ac0e356de5ed tempest-VolumesTransfersTest-1709885445 None] Created reservations ['55ee6933-6ac1-473c-8420-d97b7b4fd484', '682f5645-23f8-4994-b1d0-cbaac1fd3f26', 'b2111e4b-23a9-4391-945b-cf33fb10b570', 'bf59361f-1dad-4ec2-878b-57f63f3c7fdd'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:19:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c035536f-9c40-4735-a189-ac0e356de5ed tempest-VolumesTransfersTest-1709885445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:19:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c035536f-9c40-4735-a189-ac0e356de5ed tempest-VolumesTransfersTest-1709885445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:19:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c035536f-9c40-4735-a189-ac0e356de5ed tempest-VolumesTransfersTest-1709885445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:19:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c035536f-9c40-4735-a189-ac0e356de5ed tempest-VolumesTransfersTest-1709885445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:19:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c035536f-9c40-4735-a189-ac0e356de5ed tempest-VolumesTransfersTest-1709885445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:19:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c035536f-9c40-4735-a189-ac0e356de5ed tempest-VolumesTransfersTest-1709885445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:28 devstack sudo[99853]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0c56c53b-e613-47cf-bb2c-2b4f2af6bdd0 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-afd63d1b-27af-497e-b568-17d44f8b881c" returned: 0 in 0.418s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:28 devstack sudo[99858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:19:28 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:28 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0c56c53b-e613-47cf-bb2c-2b4f2af6bdd0 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "cinder-quobyte-afd63d1b-27af-497e-b568-17d44f8b881c" released by "delete_volume" :: held 1.095s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:19:29 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-0c56c53b-e613-47cf-bb2c-2b4f2af6bdd0 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Created reservations ['a6eccf84-6b5a-44e9-bc70-a37c74dca010', '02f3fa0a-808a-437a-8684-fa9963811c7b', 'cc75589a-81fc-406a-bff7-a3f3b064c928', '323756c7-5e20-4b96-842a-0167b793dbb7'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:19:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0c56c53b-e613-47cf-bb2c-2b4f2af6bdd0 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:19:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0c56c53b-e613-47cf-bb2c-2b4f2af6bdd0 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:19:29 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0c56c53b-e613-47cf-bb2c-2b4f2af6bdd0 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:19:29 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0c56c53b-e613-47cf-bb2c-2b4f2af6bdd0 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:19:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0c56c53b-e613-47cf-bb2c-2b4f2af6bdd0 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:19:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0c56c53b-e613-47cf-bb2c-2b4f2af6bdd0 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:29 devstack sudo[99860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:19:29 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:29 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c035536f-9c40-4735-a189-ac0e356de5ed tempest-VolumesTransfersTest-1709885445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.292s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:29 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-c035536f-9c40-4735-a189-ac0e356de5ed tempest-VolumesTransfersTest-1709885445 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:19:29 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-c035536f-9c40-4735-a189-ac0e356de5ed tempest-VolumesTransfersTest-1709885445 None] Deleted volume successfully.
Nov 05 19:19:29 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c035536f-9c40-4735-a189-ac0e356de5ed tempest-VolumesTransfersTest-1709885445 None] Lock "cinder-ff70229b-fedc-44be-96da-17381281c355-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:19:29 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0c56c53b-e613-47cf-bb2c-2b4f2af6bdd0 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.256s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:29 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-0c56c53b-e613-47cf-bb2c-2b4f2af6bdd0 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:19:29 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-0c56c53b-e613-47cf-bb2c-2b4f2af6bdd0 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Deleted volume successfully.
Nov 05 19:19:29 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0c56c53b-e613-47cf-bb2c-2b4f2af6bdd0 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "cinder-afd63d1b-27af-497e-b568-17d44f8b881c-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:19:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3295305d-29fb-49c9-80f0-889bafd157d2 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Acquiring lock "cinder-dd5a56a9-990e-4f00-928f-5d6a2e4960bf-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:19:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3295305d-29fb-49c9-80f0-889bafd157d2 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "cinder-dd5a56a9-990e-4f00-928f-5d6a2e4960bf-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:19:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3295305d-29fb-49c9-80f0-889bafd157d2 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Acquiring lock "cinder-quobyte-dd5a56a9-990e-4f00-928f-5d6a2e4960bf" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:19:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3295305d-29fb-49c9-80f0-889bafd157d2 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "cinder-quobyte-dd5a56a9-990e-4f00-928f-5d6a2e4960bf" acquired by "delete_volume" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:19:30 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c32b09-830e-4642-a2ea-fbd237bdb50b]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:19:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3295305d-29fb-49c9-80f0-889bafd157d2 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dd5a56a9-990e-4f00-928f-5d6a2e4960bf {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:30 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-db8f4e81-7a88-4d07-94a0-b66868e61986 req-f63e7af2-2b20-4630-a2fd-8623585cd518 tempest-TestServerVolumeAttachmentScenario-2143879364 None] Terminate volume connection completed successfully.
Nov 05 19:19:30 devstack sudo[99865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dd5a56a9-990e-4f00-928f-5d6a2e4960bf
Nov 05 19:19:30 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-db8f4e81-7a88-4d07-94a0-b66868e61986 req-f63e7af2-2b20-4630-a2fd-8623585cd518 tempest-TestServerVolumeAttachmentScenario-2143879364 None] Deleting attachment 39c552af-1126-4d2d-bf0e-59bac729d70b. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 19:19:30 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3295305d-29fb-49c9-80f0-889bafd157d2 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dd5a56a9-990e-4f00-928f-5d6a2e4960bf" returned: 0 in 0.433s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3295305d-29fb-49c9-80f0-889bafd157d2 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dd5a56a9-990e-4f00-928f-5d6a2e4960bf {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:30 devstack sudo[99872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dd5a56a9-990e-4f00-928f-5d6a2e4960bf
Nov 05 19:19:30 devstack sudo[99872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:31 devstack sudo[99872]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3295305d-29fb-49c9-80f0-889bafd157d2 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dd5a56a9-990e-4f00-928f-5d6a2e4960bf" returned: 0 in 0.348s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3295305d-29fb-49c9-80f0-889bafd157d2 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "cinder-quobyte-dd5a56a9-990e-4f00-928f-5d6a2e4960bf" released by "delete_volume" :: held 0.843s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:19:31 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-3295305d-29fb-49c9-80f0-889bafd157d2 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Created reservations ['df4d250c-4cc4-4832-b2b0-4280959e7e8d', 'b12b964b-e2ef-48cc-a9e1-ee0aa79ca479', '5f9f7a2e-27d5-4237-b642-e46103048278', '427f90ab-fb10-45b8-930b-4410ae25d390'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:19:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3295305d-29fb-49c9-80f0-889bafd157d2 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:19:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3295305d-29fb-49c9-80f0-889bafd157d2 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:19:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3295305d-29fb-49c9-80f0-889bafd157d2 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:19:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3295305d-29fb-49c9-80f0-889bafd157d2 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:19:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3295305d-29fb-49c9-80f0-889bafd157d2 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:19:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3295305d-29fb-49c9-80f0-889bafd157d2 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:31 devstack sudo[99876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:19:31 devstack sudo[99876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6413458a-0e64-462a-92ea-d7ad9b2bd5c6 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Acquiring lock "cinder-96f5a2a8-3478-4df0-9323-b839baf97491-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:19:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6413458a-0e64-462a-92ea-d7ad9b2bd5c6 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "cinder-96f5a2a8-3478-4df0-9323-b839baf97491-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:19:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6413458a-0e64-462a-92ea-d7ad9b2bd5c6 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Acquiring lock "cinder-quobyte-96f5a2a8-3478-4df0-9323-b839baf97491" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:19:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6413458a-0e64-462a-92ea-d7ad9b2bd5c6 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "cinder-quobyte-96f5a2a8-3478-4df0-9323-b839baf97491" acquired by "delete_volume" :: waited 0.037s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:19:31 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fd1314-f1bb-46d5-891b-d2c286815404]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:19:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6413458a-0e64-462a-92ea-d7ad9b2bd5c6 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-96f5a2a8-3478-4df0-9323-b839baf97491 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:31 devstack sudo[99876]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3295305d-29fb-49c9-80f0-889bafd157d2 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.412s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:31 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-3295305d-29fb-49c9-80f0-889bafd157d2 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:19:31 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-3295305d-29fb-49c9-80f0-889bafd157d2 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Deleted volume successfully.
Nov 05 19:19:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3295305d-29fb-49c9-80f0-889bafd157d2 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "cinder-dd5a56a9-990e-4f00-928f-5d6a2e4960bf-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:19:31 devstack sudo[99880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-96f5a2a8-3478-4df0-9323-b839baf97491
Nov 05 19:19:31 devstack sudo[99880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:32 devstack sudo[99880]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6413458a-0e64-462a-92ea-d7ad9b2bd5c6 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-96f5a2a8-3478-4df0-9323-b839baf97491" returned: 0 in 0.624s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6413458a-0e64-462a-92ea-d7ad9b2bd5c6 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-96f5a2a8-3478-4df0-9323-b839baf97491 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:32 devstack sudo[99904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-96f5a2a8-3478-4df0-9323-b839baf97491
Nov 05 19:19:32 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:32 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6413458a-0e64-462a-92ea-d7ad9b2bd5c6 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-96f5a2a8-3478-4df0-9323-b839baf97491" returned: 0 in 0.331s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:32 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6413458a-0e64-462a-92ea-d7ad9b2bd5c6 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "cinder-quobyte-96f5a2a8-3478-4df0-9323-b839baf97491" released by "delete_volume" :: held 1.048s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:19:32 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-6413458a-0e64-462a-92ea-d7ad9b2bd5c6 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Created reservations ['1cf6d7f0-6380-4471-bf8e-a41ce908b26d', '64efdede-4432-4480-9763-cea8601f4d60', 'efb9a372-5e08-49d4-a9e3-0825a91d6977', '10a45906-8c2b-43b4-928d-049de3103d54'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:19:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6413458a-0e64-462a-92ea-d7ad9b2bd5c6 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:19:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6413458a-0e64-462a-92ea-d7ad9b2bd5c6 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:19:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6413458a-0e64-462a-92ea-d7ad9b2bd5c6 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:19:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6413458a-0e64-462a-92ea-d7ad9b2bd5c6 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:19:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6413458a-0e64-462a-92ea-d7ad9b2bd5c6 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:19:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6413458a-0e64-462a-92ea-d7ad9b2bd5c6 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:32 devstack sudo[99907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:19:32 devstack sudo[99907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:33 devstack sudo[99907]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6413458a-0e64-462a-92ea-d7ad9b2bd5c6 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.367s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:33 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-6413458a-0e64-462a-92ea-d7ad9b2bd5c6 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:19:33 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-6413458a-0e64-462a-92ea-d7ad9b2bd5c6 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Deleted volume successfully.
Nov 05 19:19:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6413458a-0e64-462a-92ea-d7ad9b2bd5c6 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "cinder-96f5a2a8-3478-4df0-9323-b839baf97491-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:19:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-114c05d8-a9d3-4ebe-92c7-70b074241c86 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Acquiring lock "cinder-eea22e12-941e-4e6a-a285-70be1e0c92f3-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:19:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-114c05d8-a9d3-4ebe-92c7-70b074241c86 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "cinder-eea22e12-941e-4e6a-a285-70be1e0c92f3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:19:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-114c05d8-a9d3-4ebe-92c7-70b074241c86 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Acquiring lock "cinder-quobyte-eea22e12-941e-4e6a-a285-70be1e0c92f3" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:19:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-114c05d8-a9d3-4ebe-92c7-70b074241c86 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "cinder-quobyte-eea22e12-941e-4e6a-a285-70be1e0c92f3" acquired by "delete_volume" :: waited 0.034s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:19:33 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6c53d3-e640-46fb-a824-98fc13972eeb]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:19:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-114c05d8-a9d3-4ebe-92c7-70b074241c86 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-eea22e12-941e-4e6a-a285-70be1e0c92f3 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:34 devstack sudo[99914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-eea22e12-941e-4e6a-a285-70be1e0c92f3
Nov 05 19:19:34 devstack sudo[99914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:34 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-4019e44b-26b6-4cfa-8e8e-0942f4ee3dbe tempest-VolumesNegativeTest-309175902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:19:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4019e44b-26b6-4cfa-8e8e-0942f4ee3dbe tempest-VolumesNegativeTest-309175902 None] Flow 'volume_create_manager' (fe5f1f7c-2694-43ca-b829-82c810e5c888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:19:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4019e44b-26b6-4cfa-8e8e-0942f4ee3dbe tempest-VolumesNegativeTest-309175902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeddbd1f-546a-4f82-9ccb-2e48ab5e8d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4019e44b-26b6-4cfa-8e8e-0942f4ee3dbe tempest-VolumesNegativeTest-309175902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeddbd1f-546a-4f82-9ccb-2e48ab5e8d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1746394474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdc073a4-4757-4ca6-a570-0824a963f682,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b23d82b20ea24a26911df5d49cfe97c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:19:34Z,use_quota=True,user_id='ee52444245ae4d668494b639408d9a05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4019e44b-26b6-4cfa-8e8e-0942f4ee3dbe tempest-VolumesNegativeTest-309175902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05a746c8-e8e7-490e-88a6-4bf655dae5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4019e44b-26b6-4cfa-8e8e-0942f4ee3dbe tempest-VolumesNegativeTest-309175902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05a746c8-e8e7-490e-88a6-4bf655dae5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4019e44b-26b6-4cfa-8e8e-0942f4ee3dbe tempest-VolumesNegativeTest-309175902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8447c9e-a256-4b75-aef5-ac7280e354f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4019e44b-26b6-4cfa-8e8e-0942f4ee3dbe tempest-VolumesNegativeTest-309175902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8447c9e-a256-4b75-aef5-ac7280e354f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdc073a4-4757-4ca6-a570-0824a963f682', 'volume_name': 'volume-cdc073a4-4757-4ca6-a570-0824a963f682', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4019e44b-26b6-4cfa-8e8e-0942f4ee3dbe tempest-VolumesNegativeTest-309175902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3176344e-fe5c-4a3f-a326-43e18866236a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4019e44b-26b6-4cfa-8e8e-0942f4ee3dbe tempest-VolumesNegativeTest-309175902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3176344e-fe5c-4a3f-a326-43e18866236a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4019e44b-26b6-4cfa-8e8e-0942f4ee3dbe tempest-VolumesNegativeTest-309175902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f149c32c-7fcf-4354-a789-15d9b9cd4126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:34 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-4019e44b-26b6-4cfa-8e8e-0942f4ee3dbe tempest-VolumesNegativeTest-309175902 None] Volume cdc073a4-4757-4ca6-a570-0824a963f682: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdc073a4-4757-4ca6-a570-0824a963f682', 'volume_size': 1}
Nov 05 19:19:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4019e44b-26b6-4cfa-8e8e-0942f4ee3dbe tempest-VolumesNegativeTest-309175902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:19:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4019e44b-26b6-4cfa-8e8e-0942f4ee3dbe tempest-VolumesNegativeTest-309175902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:19:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4019e44b-26b6-4cfa-8e8e-0942f4ee3dbe tempest-VolumesNegativeTest-309175902 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1746394474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdc073a4-4757-4ca6-a570-0824a963f682,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b23d82b20ea24a26911df5d49cfe97c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:19:34Z,use_quota=True,user_id='ee52444245ae4d668494b639408d9a05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:19:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-4019e44b-26b6-4cfa-8e8e-0942f4ee3dbe tempest-VolumesNegativeTest-309175902 None] Creating volume cdc073a4-4757-4ca6-a570-0824a963f682 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:19:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4019e44b-26b6-4cfa-8e8e-0942f4ee3dbe tempest-VolumesNegativeTest-309175902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:19:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4019e44b-26b6-4cfa-8e8e-0942f4ee3dbe tempest-VolumesNegativeTest-309175902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:19:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4019e44b-26b6-4cfa-8e8e-0942f4ee3dbe tempest-VolumesNegativeTest-309175902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:19:34 devstack sudo[99914]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4019e44b-26b6-4cfa-8e8e-0942f4ee3dbe tempest-VolumesNegativeTest-309175902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:19:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4019e44b-26b6-4cfa-8e8e-0942f4ee3dbe tempest-VolumesNegativeTest-309175902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:19:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4019e44b-26b6-4cfa-8e8e-0942f4ee3dbe tempest-VolumesNegativeTest-309175902 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:19:34 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-4019e44b-26b6-4cfa-8e8e-0942f4ee3dbe tempest-VolumesNegativeTest-309175902 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:19:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4019e44b-26b6-4cfa-8e8e-0942f4ee3dbe tempest-VolumesNegativeTest-309175902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cdc073a4-4757-4ca6-a570-0824a963f682 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-114c05d8-a9d3-4ebe-92c7-70b074241c86 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-eea22e12-941e-4e6a-a285-70be1e0c92f3" returned: 0 in 0.484s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-114c05d8-a9d3-4ebe-92c7-70b074241c86 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-eea22e12-941e-4e6a-a285-70be1e0c92f3 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:34 devstack sudo[99920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cdc073a4-4757-4ca6-a570-0824a963f682 1073741824
Nov 05 19:19:34 devstack sudo[99920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:34 devstack sudo[99921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-eea22e12-941e-4e6a-a285-70be1e0c92f3
Nov 05 19:19:34 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:34 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-114c05d8-a9d3-4ebe-92c7-70b074241c86 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-eea22e12-941e-4e6a-a285-70be1e0c92f3" returned: 0 in 0.320s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-114c05d8-a9d3-4ebe-92c7-70b074241c86 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "cinder-quobyte-eea22e12-941e-4e6a-a285-70be1e0c92f3" released by "delete_volume" :: held 0.881s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:19:34 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-114c05d8-a9d3-4ebe-92c7-70b074241c86 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Created reservations ['3e572d34-8db2-4702-a5c6-4722268bf46b', '8ffeee4b-b1e8-4f99-b8ef-46c02a2ed06f', 'a8f8ab9a-38af-4f0d-8506-d06edf4a4bb7', '6534afdd-e2b4-4245-995f-b5a90e8f9c71'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:19:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-114c05d8-a9d3-4ebe-92c7-70b074241c86 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:19:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-114c05d8-a9d3-4ebe-92c7-70b074241c86 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:19:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-114c05d8-a9d3-4ebe-92c7-70b074241c86 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:19:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-114c05d8-a9d3-4ebe-92c7-70b074241c86 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:19:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-114c05d8-a9d3-4ebe-92c7-70b074241c86 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:19:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-114c05d8-a9d3-4ebe-92c7-70b074241c86 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:35 devstack sudo[99920]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4019e44b-26b6-4cfa-8e8e-0942f4ee3dbe tempest-VolumesNegativeTest-309175902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cdc073a4-4757-4ca6-a570-0824a963f682 1073741824" returned: 0 in 0.623s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:35 devstack sudo[99929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:19:35 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4019e44b-26b6-4cfa-8e8e-0942f4ee3dbe tempest-VolumesNegativeTest-309175902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cdc073a4-4757-4ca6-a570-0824a963f682 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:35 devstack sudo[99931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cdc073a4-4757-4ca6-a570-0824a963f682
Nov 05 19:19:35 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:35 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-114c05d8-a9d3-4ebe-92c7-70b074241c86 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.349s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:35 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-114c05d8-a9d3-4ebe-92c7-70b074241c86 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:19:35 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-114c05d8-a9d3-4ebe-92c7-70b074241c86 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Deleted volume successfully.
Nov 05 19:19:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-114c05d8-a9d3-4ebe-92c7-70b074241c86 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "cinder-eea22e12-941e-4e6a-a285-70be1e0c92f3-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:19:35 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4019e44b-26b6-4cfa-8e8e-0942f4ee3dbe tempest-VolumesNegativeTest-309175902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cdc073a4-4757-4ca6-a570-0824a963f682" returned: 0 in 0.322s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4019e44b-26b6-4cfa-8e8e-0942f4ee3dbe tempest-VolumesNegativeTest-309175902 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:19:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4019e44b-26b6-4cfa-8e8e-0942f4ee3dbe tempest-VolumesNegativeTest-309175902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:19:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4019e44b-26b6-4cfa-8e8e-0942f4ee3dbe tempest-VolumesNegativeTest-309175902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f149c32c-7fcf-4354-a789-15d9b9cd4126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdc073a4-4757-4ca6-a570-0824a963f682', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4019e44b-26b6-4cfa-8e8e-0942f4ee3dbe tempest-VolumesNegativeTest-309175902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93e9aab4-d429-44d7-8b94-ab4c34250a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:35 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-4019e44b-26b6-4cfa-8e8e-0942f4ee3dbe tempest-VolumesNegativeTest-309175902 None] Volume volume-cdc073a4-4757-4ca6-a570-0824a963f682 (cdc073a4-4757-4ca6-a570-0824a963f682): created successfully
Nov 05 19:19:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4019e44b-26b6-4cfa-8e8e-0942f4ee3dbe tempest-VolumesNegativeTest-309175902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93e9aab4-d429-44d7-8b94-ab4c34250a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4019e44b-26b6-4cfa-8e8e-0942f4ee3dbe tempest-VolumesNegativeTest-309175902 None] Flow 'volume_create_manager' (fe5f1f7c-2694-43ca-b829-82c810e5c888) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:19:35 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-4019e44b-26b6-4cfa-8e8e-0942f4ee3dbe tempest-VolumesNegativeTest-309175902 None] Created volume successfully.
Nov 05 19:19:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a4d25351-1212-4df8-94a5-550d1f7900cc tempest-TestServerVolumeAttachmentScenario-2143879364 None] Acquiring lock "cinder-dabe7fcc-6013-41b0-aa53-a8ee0cf89454-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:19:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a4d25351-1212-4df8-94a5-550d1f7900cc tempest-TestServerVolumeAttachmentScenario-2143879364 None] Lock "cinder-dabe7fcc-6013-41b0-aa53-a8ee0cf89454-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:19:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a4d25351-1212-4df8-94a5-550d1f7900cc tempest-TestServerVolumeAttachmentScenario-2143879364 None] Acquiring lock "cinder-quobyte-dabe7fcc-6013-41b0-aa53-a8ee0cf89454" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:19:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a4d25351-1212-4df8-94a5-550d1f7900cc tempest-TestServerVolumeAttachmentScenario-2143879364 None] Lock "cinder-quobyte-dabe7fcc-6013-41b0-aa53-a8ee0cf89454" acquired by "delete_volume" :: waited 0.016s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:19:35 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc682cc7-a57d-43df-bfe1-be9758f38000]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:19:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a4d25351-1212-4df8-94a5-550d1f7900cc tempest-TestServerVolumeAttachmentScenario-2143879364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dabe7fcc-6013-41b0-aa53-a8ee0cf89454 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:35 devstack sudo[99937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dabe7fcc-6013-41b0-aa53-a8ee0cf89454
Nov 05 19:19:35 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-af669cdb-0b5a-42c1-a11f-08508479b0b6 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Acquiring lock "cinder-3e7fe4ee-7cb4-4cf4-8df0-b21b9679411d-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:19:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-af669cdb-0b5a-42c1-a11f-08508479b0b6 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "cinder-3e7fe4ee-7cb4-4cf4-8df0-b21b9679411d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:19:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-af669cdb-0b5a-42c1-a11f-08508479b0b6 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Acquiring lock "cinder-quobyte-3e7fe4ee-7cb4-4cf4-8df0-b21b9679411d" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:19:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-af669cdb-0b5a-42c1-a11f-08508479b0b6 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "cinder-quobyte-3e7fe4ee-7cb4-4cf4-8df0-b21b9679411d" acquired by "delete_volume" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:19:36 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a4d25351-1212-4df8-94a5-550d1f7900cc tempest-TestServerVolumeAttachmentScenario-2143879364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dabe7fcc-6013-41b0-aa53-a8ee0cf89454" returned: 0 in 0.433s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a4d25351-1212-4df8-94a5-550d1f7900cc tempest-TestServerVolumeAttachmentScenario-2143879364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dabe7fcc-6013-41b0-aa53-a8ee0cf89454 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:36 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1057fe94-3d26-4db9-9705-05ae88fda57d]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:19:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-af669cdb-0b5a-42c1-a11f-08508479b0b6 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3e7fe4ee-7cb4-4cf4-8df0-b21b9679411d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:36 devstack sudo[99942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dabe7fcc-6013-41b0-aa53-a8ee0cf89454
Nov 05 19:19:36 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:36 devstack sudo[99943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3e7fe4ee-7cb4-4cf4-8df0-b21b9679411d
Nov 05 19:19:36 devstack sudo[99943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:36 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a4d25351-1212-4df8-94a5-550d1f7900cc tempest-TestServerVolumeAttachmentScenario-2143879364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-dabe7fcc-6013-41b0-aa53-a8ee0cf89454" returned: 0 in 0.317s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a4d25351-1212-4df8-94a5-550d1f7900cc tempest-TestServerVolumeAttachmentScenario-2143879364 None] Lock "cinder-quobyte-dabe7fcc-6013-41b0-aa53-a8ee0cf89454" released by "delete_volume" :: held 0.807s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:19:36 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-a4d25351-1212-4df8-94a5-550d1f7900cc tempest-TestServerVolumeAttachmentScenario-2143879364 None] Created reservations ['967161da-e599-4cbf-8c0a-1155c499eeb5', '743c8976-19db-405a-b88c-b2fed71eac37', 'be9bac3f-e228-46de-a01f-9e941edc1950', '8c360c0f-b825-40ef-88ac-f104639f8843'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:19:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a4d25351-1212-4df8-94a5-550d1f7900cc tempest-TestServerVolumeAttachmentScenario-2143879364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:19:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a4d25351-1212-4df8-94a5-550d1f7900cc tempest-TestServerVolumeAttachmentScenario-2143879364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:19:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a4d25351-1212-4df8-94a5-550d1f7900cc tempest-TestServerVolumeAttachmentScenario-2143879364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:19:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a4d25351-1212-4df8-94a5-550d1f7900cc tempest-TestServerVolumeAttachmentScenario-2143879364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:19:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a4d25351-1212-4df8-94a5-550d1f7900cc tempest-TestServerVolumeAttachmentScenario-2143879364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:19:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a4d25351-1212-4df8-94a5-550d1f7900cc tempest-TestServerVolumeAttachmentScenario-2143879364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:36 devstack sudo[99951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:19:36 devstack sudo[99951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:36 devstack sudo[99943]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-af669cdb-0b5a-42c1-a11f-08508479b0b6 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3e7fe4ee-7cb4-4cf4-8df0-b21b9679411d" returned: 0 in 0.556s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-af669cdb-0b5a-42c1-a11f-08508479b0b6 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3e7fe4ee-7cb4-4cf4-8df0-b21b9679411d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:36 devstack sudo[99953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3e7fe4ee-7cb4-4cf4-8df0-b21b9679411d
Nov 05 19:19:36 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-83332730-8c65-479b-b71a-82c0e7f85af3 tempest-TestServerVolumeAttachmentScenario-2143879364 None] Acquiring lock "cinder-576ab429-1b58-4421-84cf-7c34ed96bf14-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:19:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-83332730-8c65-479b-b71a-82c0e7f85af3 tempest-TestServerVolumeAttachmentScenario-2143879364 None] Lock "cinder-576ab429-1b58-4421-84cf-7c34ed96bf14-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:19:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-83332730-8c65-479b-b71a-82c0e7f85af3 tempest-TestServerVolumeAttachmentScenario-2143879364 None] Acquiring lock "cinder-quobyte-576ab429-1b58-4421-84cf-7c34ed96bf14" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:19:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-83332730-8c65-479b-b71a-82c0e7f85af3 tempest-TestServerVolumeAttachmentScenario-2143879364 None] Lock "cinder-quobyte-576ab429-1b58-4421-84cf-7c34ed96bf14" acquired by "delete_volume" :: waited 0.017s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:19:37 devstack sudo[99951]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a4d25351-1212-4df8-94a5-550d1f7900cc tempest-TestServerVolumeAttachmentScenario-2143879364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.365s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:37 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-a4d25351-1212-4df8-94a5-550d1f7900cc tempest-TestServerVolumeAttachmentScenario-2143879364 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:19:37 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-a4d25351-1212-4df8-94a5-550d1f7900cc tempest-TestServerVolumeAttachmentScenario-2143879364 None] Deleted volume successfully.
Nov 05 19:19:37 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee8bcc2-0779-4611-bbd4-cf3e4b79ac6c]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:19:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-83332730-8c65-479b-b71a-82c0e7f85af3 tempest-TestServerVolumeAttachmentScenario-2143879364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-576ab429-1b58-4421-84cf-7c34ed96bf14 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a4d25351-1212-4df8-94a5-550d1f7900cc tempest-TestServerVolumeAttachmentScenario-2143879364 None] Lock "cinder-dabe7fcc-6013-41b0-aa53-a8ee0cf89454-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:19:37 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-af669cdb-0b5a-42c1-a11f-08508479b0b6 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3e7fe4ee-7cb4-4cf4-8df0-b21b9679411d" returned: 0 in 0.408s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-af669cdb-0b5a-42c1-a11f-08508479b0b6 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "cinder-quobyte-3e7fe4ee-7cb4-4cf4-8df0-b21b9679411d" released by "delete_volume" :: held 1.037s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:19:37 devstack sudo[99957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-576ab429-1b58-4421-84cf-7c34ed96bf14
Nov 05 19:19:37 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-af669cdb-0b5a-42c1-a11f-08508479b0b6 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Created reservations ['e9d08bb6-3194-424c-bd5f-a402c909f8b4', '66f65289-30f5-495f-9a65-20a1216ef2eb', 'd4d7bac0-166a-4f3f-937c-9c490bd1547e', 'b9d29679-c89d-46cf-807e-56cdeeee7206'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:19:37 devstack sudo[99957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-af669cdb-0b5a-42c1-a11f-08508479b0b6 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:19:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-af669cdb-0b5a-42c1-a11f-08508479b0b6 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:19:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-af669cdb-0b5a-42c1-a11f-08508479b0b6 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:19:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-af669cdb-0b5a-42c1-a11f-08508479b0b6 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:19:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-af669cdb-0b5a-42c1-a11f-08508479b0b6 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:19:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-af669cdb-0b5a-42c1-a11f-08508479b0b6 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:37 devstack sudo[99963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:19:37 devstack sudo[99963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:37 devstack sudo[99957]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-83332730-8c65-479b-b71a-82c0e7f85af3 tempest-TestServerVolumeAttachmentScenario-2143879364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-576ab429-1b58-4421-84cf-7c34ed96bf14" returned: 0 in 0.601s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-83332730-8c65-479b-b71a-82c0e7f85af3 tempest-TestServerVolumeAttachmentScenario-2143879364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-576ab429-1b58-4421-84cf-7c34ed96bf14 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:37 devstack sudo[99963]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-af669cdb-0b5a-42c1-a11f-08508479b0b6 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.285s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:37 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-af669cdb-0b5a-42c1-a11f-08508479b0b6 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:19:37 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-af669cdb-0b5a-42c1-a11f-08508479b0b6 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Deleted volume successfully.
Nov 05 19:19:37 devstack sudo[99969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-576ab429-1b58-4421-84cf-7c34ed96bf14
Nov 05 19:19:37 devstack sudo[99969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-af669cdb-0b5a-42c1-a11f-08508479b0b6 tempest-CreateVolumesFromSourceVolumeTest-1842267593 None] Lock "cinder-3e7fe4ee-7cb4-4cf4-8df0-b21b9679411d-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:19:38 devstack sudo[99969]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-83332730-8c65-479b-b71a-82c0e7f85af3 tempest-TestServerVolumeAttachmentScenario-2143879364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-576ab429-1b58-4421-84cf-7c34ed96bf14" returned: 0 in 0.345s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-83332730-8c65-479b-b71a-82c0e7f85af3 tempest-TestServerVolumeAttachmentScenario-2143879364 None] Lock "cinder-quobyte-576ab429-1b58-4421-84cf-7c34ed96bf14" released by "delete_volume" :: held 1.012s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:19:38 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-83332730-8c65-479b-b71a-82c0e7f85af3 tempest-TestServerVolumeAttachmentScenario-2143879364 None] Created reservations ['e4f369df-41b4-4733-8bed-6699171e6bf2', '94317084-3bd5-4069-9f35-00bc7f4827f0', 'ad0685fd-3b10-4530-b7ca-54c7afffa141', '6785ede1-0bbe-450a-bc8f-19225c201032'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:19:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-83332730-8c65-479b-b71a-82c0e7f85af3 tempest-TestServerVolumeAttachmentScenario-2143879364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:19:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-83332730-8c65-479b-b71a-82c0e7f85af3 tempest-TestServerVolumeAttachmentScenario-2143879364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:19:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-83332730-8c65-479b-b71a-82c0e7f85af3 tempest-TestServerVolumeAttachmentScenario-2143879364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:19:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-83332730-8c65-479b-b71a-82c0e7f85af3 tempest-TestServerVolumeAttachmentScenario-2143879364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:19:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-83332730-8c65-479b-b71a-82c0e7f85af3 tempest-TestServerVolumeAttachmentScenario-2143879364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:19:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-83332730-8c65-479b-b71a-82c0e7f85af3 tempest-TestServerVolumeAttachmentScenario-2143879364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:38 devstack sudo[99972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:19:38 devstack sudo[99972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:38 devstack sudo[99972]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-83332730-8c65-479b-b71a-82c0e7f85af3 tempest-TestServerVolumeAttachmentScenario-2143879364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.404s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:38 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-83332730-8c65-479b-b71a-82c0e7f85af3 tempest-TestServerVolumeAttachmentScenario-2143879364 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:19:38 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-83332730-8c65-479b-b71a-82c0e7f85af3 tempest-TestServerVolumeAttachmentScenario-2143879364 None] Deleted volume successfully.
Nov 05 19:19:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-83332730-8c65-479b-b71a-82c0e7f85af3 tempest-TestServerVolumeAttachmentScenario-2143879364 None] Lock "cinder-576ab429-1b58-4421-84cf-7c34ed96bf14-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:19:40 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f225f5f-3e4d-42d4-afdc-e61ed5bb6624 tempest-VolumesCloneTest-792670162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:19:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4f225f5f-3e4d-42d4-afdc-e61ed5bb6624 tempest-VolumesCloneTest-792670162 None] Flow 'volume_create_manager' (a623ac20-9c68-4e5f-b327-a6c200e425f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:19:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4f225f5f-3e4d-42d4-afdc-e61ed5bb6624 tempest-VolumesCloneTest-792670162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191b5f6e-0f7e-41a5-8365-b1b75b3abe7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4f225f5f-3e4d-42d4-afdc-e61ed5bb6624 tempest-VolumesCloneTest-792670162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191b5f6e-0f7e-41a5-8365-b1b75b3abe7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1690496302',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ae3b5a595c84030a550d10fd563fa16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:19:40Z,use_quota=True,user_id='6a7b63bade314867b973c44d248e330b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4f225f5f-3e4d-42d4-afdc-e61ed5bb6624 tempest-VolumesCloneTest-792670162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b3779ef-ed0e-4242-99ed-3d4194eb2f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4f225f5f-3e4d-42d4-afdc-e61ed5bb6624 tempest-VolumesCloneTest-792670162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b3779ef-ed0e-4242-99ed-3d4194eb2f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4f225f5f-3e4d-42d4-afdc-e61ed5bb6624 tempest-VolumesCloneTest-792670162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0952c3c4-dc1c-4534-9bc7-878ef96410e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4f225f5f-3e4d-42d4-afdc-e61ed5bb6624 tempest-VolumesCloneTest-792670162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0952c3c4-dc1c-4534-9bc7-878ef96410e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c', 'volume_name': 'volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4f225f5f-3e4d-42d4-afdc-e61ed5bb6624 tempest-VolumesCloneTest-792670162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82772129-c35a-4a67-a007-edab1a0b47f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4f225f5f-3e4d-42d4-afdc-e61ed5bb6624 tempest-VolumesCloneTest-792670162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82772129-c35a-4a67-a007-edab1a0b47f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4f225f5f-3e4d-42d4-afdc-e61ed5bb6624 tempest-VolumesCloneTest-792670162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb0b89af-d3d7-4fa8-b82e-6ccae0eb2228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:40 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-4f225f5f-3e4d-42d4-afdc-e61ed5bb6624 tempest-VolumesCloneTest-792670162 None] Volume de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c', 'volume_size': 1}
Nov 05 19:19:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4f225f5f-3e4d-42d4-afdc-e61ed5bb6624 tempest-VolumesCloneTest-792670162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:19:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4f225f5f-3e4d-42d4-afdc-e61ed5bb6624 tempest-VolumesCloneTest-792670162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:19:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4f225f5f-3e4d-42d4-afdc-e61ed5bb6624 tempest-VolumesCloneTest-792670162 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1690496302',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ae3b5a595c84030a550d10fd563fa16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:19:40Z,use_quota=True,user_id='6a7b63bade314867b973c44d248e330b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:19:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-4f225f5f-3e4d-42d4-afdc-e61ed5bb6624 tempest-VolumesCloneTest-792670162 None] Creating volume de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:19:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4f225f5f-3e4d-42d4-afdc-e61ed5bb6624 tempest-VolumesCloneTest-792670162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:19:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4f225f5f-3e4d-42d4-afdc-e61ed5bb6624 tempest-VolumesCloneTest-792670162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:19:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4f225f5f-3e4d-42d4-afdc-e61ed5bb6624 tempest-VolumesCloneTest-792670162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:19:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4f225f5f-3e4d-42d4-afdc-e61ed5bb6624 tempest-VolumesCloneTest-792670162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:19:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4f225f5f-3e4d-42d4-afdc-e61ed5bb6624 tempest-VolumesCloneTest-792670162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:19:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4f225f5f-3e4d-42d4-afdc-e61ed5bb6624 tempest-VolumesCloneTest-792670162 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:19:40 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-4f225f5f-3e4d-42d4-afdc-e61ed5bb6624 tempest-VolumesCloneTest-792670162 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:19:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4f225f5f-3e4d-42d4-afdc-e61ed5bb6624 tempest-VolumesCloneTest-792670162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:40 devstack sudo[99997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c 1073741824
Nov 05 19:19:40 devstack sudo[99997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:40 devstack sudo[99997]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4f225f5f-3e4d-42d4-afdc-e61ed5bb6624 tempest-VolumesCloneTest-792670162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c 1073741824" returned: 0 in 0.497s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4f225f5f-3e4d-42d4-afdc-e61ed5bb6624 tempest-VolumesCloneTest-792670162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:40 devstack sudo[100003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c
Nov 05 19:19:40 devstack sudo[100003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:41 devstack sudo[100003]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4f225f5f-3e4d-42d4-afdc-e61ed5bb6624 tempest-VolumesCloneTest-792670162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c" returned: 0 in 0.332s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4f225f5f-3e4d-42d4-afdc-e61ed5bb6624 tempest-VolumesCloneTest-792670162 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:19:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4f225f5f-3e4d-42d4-afdc-e61ed5bb6624 tempest-VolumesCloneTest-792670162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:19:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4f225f5f-3e4d-42d4-afdc-e61ed5bb6624 tempest-VolumesCloneTest-792670162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb0b89af-d3d7-4fa8-b82e-6ccae0eb2228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4f225f5f-3e4d-42d4-afdc-e61ed5bb6624 tempest-VolumesCloneTest-792670162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd5c4e23-384f-463d-95bc-ca0c58066c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:41 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-4f225f5f-3e4d-42d4-afdc-e61ed5bb6624 tempest-VolumesCloneTest-792670162 None] Volume volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c (de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c): created successfully
Nov 05 19:19:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4f225f5f-3e4d-42d4-afdc-e61ed5bb6624 tempest-VolumesCloneTest-792670162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd5c4e23-384f-463d-95bc-ca0c58066c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4f225f5f-3e4d-42d4-afdc-e61ed5bb6624 tempest-VolumesCloneTest-792670162 None] Flow 'volume_create_manager' (a623ac20-9c68-4e5f-b327-a6c200e425f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:19:41 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-4f225f5f-3e4d-42d4-afdc-e61ed5bb6624 tempest-VolumesCloneTest-792670162 None] Created volume successfully.
Nov 05 19:19:43 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:19:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Flow 'volume_create_manager' (acc2f44a-c07b-43aa-992f-9e3528e3a6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:19:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de3fc8db-9357-4f1e-9133-c22d1d931c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:43 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-14320642-8641-4af8-9f73-be5318337fe6 tempest-CinderUnicodeTest-71031161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:19:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14320642-8641-4af8-9f73-be5318337fe6 tempest-CinderUnicodeTest-71031161 None] Flow 'volume_create_manager' (40deb7a7-f814-4717-ad24-c01b4bf60a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:19:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14320642-8641-4af8-9f73-be5318337fe6 tempest-CinderUnicodeTest-71031161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (309a7769-05a5-4c86-a57b-9e24e0c8fec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de3fc8db-9357-4f1e-9133-c22d1d931c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1120962644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=654c799f-c16a-4e4d-863a-aeb0d45c9aa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ae3b5a595c84030a550d10fd563fa16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:19:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c,status='creating',terminated_at=None,updated_at=2026-11-05T18:19:43Z,use_quota=True,user_id='6a7b63bade314867b973c44d248e330b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e58a6df5-634a-43ff-b702-fd89795f03ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e58a6df5-634a-43ff-b702-fd89795f03ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8c25b24-6ff3-4c54-8ac4-48c4f78d4cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14320642-8641-4af8-9f73-be5318337fe6 tempest-CinderUnicodeTest-71031161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (309a7769-05a5-4c86-a57b-9e24e0c8fec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:19:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ab1244e-7484-4091-937c-53e68837e78c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66cb280e23984f5e9824416f64b784df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:19:43Z,use_quota=True,user_id='471edfe1f62348518c80c7c5c32c5117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14320642-8641-4af8-9f73-be5318337fe6 tempest-CinderUnicodeTest-71031161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e52c40e1-88db-4315-9543-4aad8488b790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14320642-8641-4af8-9f73-be5318337fe6 tempest-CinderUnicodeTest-71031161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e52c40e1-88db-4315-9543-4aad8488b790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14320642-8641-4af8-9f73-be5318337fe6 tempest-CinderUnicodeTest-71031161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2213ab4a-ca5d-4944-b2e3-6e40df3cfdf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14320642-8641-4af8-9f73-be5318337fe6 tempest-CinderUnicodeTest-71031161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2213ab4a-ca5d-4944-b2e3-6e40df3cfdf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ab1244e-7484-4091-937c-53e68837e78c', 'volume_name': 'volume-0ab1244e-7484-4091-937c-53e68837e78c', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14320642-8641-4af8-9f73-be5318337fe6 tempest-CinderUnicodeTest-71031161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a6b9ca7-4dd5-4566-96e2-93c2519d31cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14320642-8641-4af8-9f73-be5318337fe6 tempest-CinderUnicodeTest-71031161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a6b9ca7-4dd5-4566-96e2-93c2519d31cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14320642-8641-4af8-9f73-be5318337fe6 tempest-CinderUnicodeTest-71031161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e39c4f6b-cd64-42d5-bec8-7c158ebe98be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:43 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-14320642-8641-4af8-9f73-be5318337fe6 tempest-CinderUnicodeTest-71031161 None] Volume 0ab1244e-7484-4091-937c-53e68837e78c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ab1244e-7484-4091-937c-53e68837e78c', 'volume_size': 1}
Nov 05 19:19:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-14320642-8641-4af8-9f73-be5318337fe6 tempest-CinderUnicodeTest-71031161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:19:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-14320642-8641-4af8-9f73-be5318337fe6 tempest-CinderUnicodeTest-71031161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:19:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-14320642-8641-4af8-9f73-be5318337fe6 tempest-CinderUnicodeTest-71031161 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:19:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ab1244e-7484-4091-937c-53e68837e78c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66cb280e23984f5e9824416f64b784df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:19:43Z,use_quota=True,user_id='471edfe1f62348518c80c7c5c32c5117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:19:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-14320642-8641-4af8-9f73-be5318337fe6 tempest-CinderUnicodeTest-71031161 None] Creating volume 0ab1244e-7484-4091-937c-53e68837e78c {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:19:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-14320642-8641-4af8-9f73-be5318337fe6 tempest-CinderUnicodeTest-71031161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:19:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-14320642-8641-4af8-9f73-be5318337fe6 tempest-CinderUnicodeTest-71031161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:19:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-14320642-8641-4af8-9f73-be5318337fe6 tempest-CinderUnicodeTest-71031161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:19:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-14320642-8641-4af8-9f73-be5318337fe6 tempest-CinderUnicodeTest-71031161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:19:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-14320642-8641-4af8-9f73-be5318337fe6 tempest-CinderUnicodeTest-71031161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:19:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-14320642-8641-4af8-9f73-be5318337fe6 tempest-CinderUnicodeTest-71031161 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:19:43 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-14320642-8641-4af8-9f73-be5318337fe6 tempest-CinderUnicodeTest-71031161 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:19:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-14320642-8641-4af8-9f73-be5318337fe6 tempest-CinderUnicodeTest-71031161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ab1244e-7484-4091-937c-53e68837e78c 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8c25b24-6ff3-4c54-8ac4-48c4f78d4cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '654c799f-c16a-4e4d-863a-aeb0d45c9aa2', 'volume_name': 'volume-654c799f-c16a-4e4d-863a-aeb0d45c9aa2', 'volume_size': 2, 'source_volid': 'de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c', 'source_volstatus': 'available'}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:43 devstack sudo[100064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ab1244e-7484-4091-937c-53e68837e78c 1073741824
Nov 05 19:19:43 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4665105-37f0-4c74-8df2-5d3954e1bbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4665105-37f0-4c74-8df2-5d3954e1bbdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66421a23-5dfe-4387-b021-d0feee9ad097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:43 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Volume 654c799f-c16a-4e4d-863a-aeb0d45c9aa2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-654c799f-c16a-4e4d-863a-aeb0d45c9aa2', 'volume_size': 2, 'source_volid': 'de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c', 'source_volstatus': 'available'}
Nov 05 19:19:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:19:44 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-14320642-8641-4af8-9f73-be5318337fe6 tempest-CinderUnicodeTest-71031161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ab1244e-7484-4091-937c-53e68837e78c 1073741824" returned: 0 in 0.872s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-14320642-8641-4af8-9f73-be5318337fe6 tempest-CinderUnicodeTest-71031161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ab1244e-7484-4091-937c-53e68837e78c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:44 devstack sudo[100093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ab1244e-7484-4091-937c-53e68837e78c
Nov 05 19:19:44 devstack sudo[100093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:45 devstack sudo[100093]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-14320642-8641-4af8-9f73-be5318337fe6 tempest-CinderUnicodeTest-71031161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ab1244e-7484-4091-937c-53e68837e78c" returned: 0 in 0.510s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-14320642-8641-4af8-9f73-be5318337fe6 tempest-CinderUnicodeTest-71031161 None] <== create_volume: return (1448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:19:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-14320642-8641-4af8-9f73-be5318337fe6 tempest-CinderUnicodeTest-71031161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.456s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:19:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.320s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:19:45 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Cloning volume de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c to volume 654c799f-c16a-4e4d-863a-aeb0d45c9aa2
Nov 05 19:19:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14320642-8641-4af8-9f73-be5318337fe6 tempest-CinderUnicodeTest-71031161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e39c4f6b-cd64-42d5-bec8-7c158ebe98be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ab1244e-7484-4091-937c-53e68837e78c', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14320642-8641-4af8-9f73-be5318337fe6 tempest-CinderUnicodeTest-71031161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d607111-435b-4fa1-bd13-868c59eb809c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:45 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-14320642-8641-4af8-9f73-be5318337fe6 tempest-CinderUnicodeTest-71031161 None] Volume volume-0ab1244e-7484-4091-937c-53e68837e78c (0ab1244e-7484-4091-937c-53e68837e78c): created successfully
Nov 05 19:19:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14320642-8641-4af8-9f73-be5318337fe6 tempest-CinderUnicodeTest-71031161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d607111-435b-4fa1-bd13-868c59eb809c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14320642-8641-4af8-9f73-be5318337fe6 tempest-CinderUnicodeTest-71031161 None] Flow 'volume_create_manager' (40deb7a7-f814-4717-ad24-c01b4bf60a84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:19:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Creating offline snapshot eacc00e6-849f-452e-a88a-12d88e8a44ca of volume de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:19:45 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-14320642-8641-4af8-9f73-be5318337fe6 tempest-CinderUnicodeTest-71031161 None] Created volume successfully.
Nov 05 19:19:45 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17a5d8b-892e-490c-ba10-c8463b9ec32a]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:19:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:45 devstack sudo[100098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c
Nov 05 19:19:45 devstack sudo[100098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:45 devstack sudo[100098]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c" returned: 0 in 0.503s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c.eacc00e6-849f-452e-a88a-12d88e8a44ca 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:45 devstack sudo[100103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c.eacc00e6-849f-452e-a88a-12d88e8a44ca 1G
Nov 05 19:19:45 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:46 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c.eacc00e6-849f-452e-a88a-12d88e8a44ca 1G" returned: 0 in 0.565s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c.eacc00e6-849f-452e-a88a-12d88e8a44ca {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:46 devstack sudo[100110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c.eacc00e6-849f-452e-a88a-12d88e8a44ca
Nov 05 19:19:46 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:47 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c.eacc00e6-849f-452e-a88a-12d88e8a44ca" returned: 0 in 0.843s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:47 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c.eacc00e6-849f-452e-a88a-12d88e8a44ca is being set with open permissions: ugo+rw
Nov 05 19:19:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c.eacc00e6-849f-452e-a88a-12d88e8a44ca {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:47 devstack sudo[100116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c.eacc00e6-849f-452e-a88a-12d88e8a44ca
Nov 05 19:19:47 devstack sudo[100116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:47 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-3621f72a-52ab-484f-a4df-59968b2f00b0 tempest-CinderUnicodeTest-71031161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:19:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3621f72a-52ab-484f-a4df-59968b2f00b0 tempest-CinderUnicodeTest-71031161 None] Flow 'volume_create_manager' (cfce3439-5b1c-417d-8dab-05095e2a641d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:19:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3621f72a-52ab-484f-a4df-59968b2f00b0 tempest-CinderUnicodeTest-71031161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b280d639-1c06-4b31-84e1-84f5726e5ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3621f72a-52ab-484f-a4df-59968b2f00b0 tempest-CinderUnicodeTest-71031161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b280d639-1c06-4b31-84e1-84f5726e5ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:19:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1639060574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e342b088-dfc8-4964-a266-3fe171068147,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66cb280e23984f5e9824416f64b784df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:19:48Z,use_quota=True,user_id='471edfe1f62348518c80c7c5c32c5117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3621f72a-52ab-484f-a4df-59968b2f00b0 tempest-CinderUnicodeTest-71031161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6fd5697-8e1b-4f31-8f36-b848e2af865f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3621f72a-52ab-484f-a4df-59968b2f00b0 tempest-CinderUnicodeTest-71031161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6fd5697-8e1b-4f31-8f36-b848e2af865f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3621f72a-52ab-484f-a4df-59968b2f00b0 tempest-CinderUnicodeTest-71031161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44ae4083-99fc-4b44-aee9-101f6788ca7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3621f72a-52ab-484f-a4df-59968b2f00b0 tempest-CinderUnicodeTest-71031161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44ae4083-99fc-4b44-aee9-101f6788ca7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e342b088-dfc8-4964-a266-3fe171068147', 'volume_name': 'volume-e342b088-dfc8-4964-a266-3fe171068147', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3621f72a-52ab-484f-a4df-59968b2f00b0 tempest-CinderUnicodeTest-71031161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89621889-e5f2-467d-97ad-f292840eba30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3621f72a-52ab-484f-a4df-59968b2f00b0 tempest-CinderUnicodeTest-71031161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89621889-e5f2-467d-97ad-f292840eba30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:47 devstack sudo[100116]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3621f72a-52ab-484f-a4df-59968b2f00b0 tempest-CinderUnicodeTest-71031161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b702d64-d8aa-4364-a83f-63be9ebb07c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:47 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-3621f72a-52ab-484f-a4df-59968b2f00b0 tempest-CinderUnicodeTest-71031161 None] Volume e342b088-dfc8-4964-a266-3fe171068147: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e342b088-dfc8-4964-a266-3fe171068147', 'volume_size': 1}
Nov 05 19:19:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3621f72a-52ab-484f-a4df-59968b2f00b0 tempest-CinderUnicodeTest-71031161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:19:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c.eacc00e6-849f-452e-a88a-12d88e8a44ca" returned: 0 in 0.388s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:47 devstack sudo[100124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c.info
Nov 05 19:19:47 devstack sudo[100124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:48 devstack sudo[100124]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c.info" returned: 0 in 0.375s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:48 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c.info is being set with open permissions: ugo+rw
Nov 05 19:19:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:48 devstack sudo[100142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c.info
Nov 05 19:19:48 devstack sudo[100142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:48 devstack sudo[100142]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c.info" returned: 0 in 0.361s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Acquiring lock "cinder-quobyte-654c799f-c16a-4e4d-863a-aeb0d45c9aa2" by "_copy_volume_from_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:19:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Lock "cinder-quobyte-654c799f-c16a-4e4d-863a-aeb0d45c9aa2" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:19:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] snapshot: eacc00e6-849f-452e-a88a-12d88e8a44ca, volume: 654c799f-c16a-4e4d-863a-aeb0d45c9aa2,  {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 19:19:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:19:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:19:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:19:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:19:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:19:48 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16219c2-7bb2-4c69-b3d8-f53fea122aa8]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:19:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c.eacc00e6-849f-452e-a88a-12d88e8a44ca {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:48 devstack sudo[100180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c.eacc00e6-849f-452e-a88a-12d88e8a44ca
Nov 05 19:19:48 devstack sudo[100180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:49 devstack sudo[100180]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c.eacc00e6-849f-452e-a88a-12d88e8a44ca" returned: 0 in 0.442s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:19:49 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[977fc43c-2b12-4f94-8c57-95e47328ab86]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:19:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:49 devstack sudo[100187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c
Nov 05 19:19:49 devstack sudo[100187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:49 devstack sudo[100187]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c" returned: 0 in 0.382s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 19:19:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Creating direct copy from snapshot {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 19:19:49 devstack cinder-volume[87184]: DEBUG cinder.utils [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Path /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-654c799f-c16a-4e4d-863a-aeb0d45c9aa2 not found in is_blk_device check {{(pid=87184) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 19:19:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-654c799f-c16a-4e4d-863a-aeb0d45c9aa2 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:49 devstack sudo[100194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-654c799f-c16a-4e4d-863a-aeb0d45c9aa2
Nov 05 19:19:49 devstack sudo[100194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:57 devstack sudo[100194]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-654c799f-c16a-4e4d-863a-aeb0d45c9aa2" returned: 0 in 8.157s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:57 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Image conversion details: src /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c, size 1024.00 MB, duration 8.16 sec, destination /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-654c799f-c16a-4e4d-863a-aeb0d45c9aa2 {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 19:19:57 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Converted 1024.00 MB image at 125.52 MB/s
Nov 05 19:19:57 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-654c799f-c16a-4e4d-863a-aeb0d45c9aa2 is being set with open permissions: ugo+rw
Nov 05 19:19:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-654c799f-c16a-4e4d-863a-aeb0d45c9aa2 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:57 devstack sudo[100214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-654c799f-c16a-4e4d-863a-aeb0d45c9aa2
Nov 05 19:19:57 devstack sudo[100214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:57 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=104,cinder:UPDATE=123,cinder:DELETE=9,cinder:INSERT=28 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:19:57 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=91,cinder:UPDATE=129,cinder:INSERT=29,cinder:DELETE=13 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:19:57 devstack sudo[100214]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-654c799f-c16a-4e4d-863a-aeb0d45c9aa2" returned: 0 in 0.290s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:57 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Lock "cinder-quobyte-654c799f-c16a-4e4d-863a-aeb0d45c9aa2" released by "_copy_volume_from_snapshot" :: held 9.358s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:19:57 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Acquiring lock "cinder-quobyte-eacc00e6-849f-452e-a88a-12d88e8a44ca" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:19:57 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Lock "cinder-quobyte-eacc00e6-849f-452e-a88a-12d88e8a44ca" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:19:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Deleting offline snapshot eacc00e6-849f-452e-a88a-12d88e8a44ca of volume de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:19:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] snapshot_file for this snap is: volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c.eacc00e6-849f-452e-a88a-12d88e8a44ca {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:19:57 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af28e80-8c3c-4d17-8ad0-78ba418a07ce]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:19:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c.eacc00e6-849f-452e-a88a-12d88e8a44ca {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:58 devstack sudo[100217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c.eacc00e6-849f-452e-a88a-12d88e8a44ca
Nov 05 19:19:58 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:58 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c.eacc00e6-849f-452e-a88a-12d88e8a44ca" returned: 0 in 0.425s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:19:58 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0069c6-9f1a-4438-ac48-bfe7bb0b3a8b]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:19:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:58 devstack sudo[100222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c
Nov 05 19:19:58 devstack sudo[100222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:59 devstack sudo[100222]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c" returned: 0 in 0.589s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c.eacc00e6-849f-452e-a88a-12d88e8a44ca {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:59 devstack sudo[100227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c.eacc00e6-849f-452e-a88a-12d88e8a44ca
Nov 05 19:19:59 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:59 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c.eacc00e6-849f-452e-a88a-12d88e8a44ca" returned: 0 in 0.391s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c.eacc00e6-849f-452e-a88a-12d88e8a44ca {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:59 devstack sudo[100232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c.eacc00e6-849f-452e-a88a-12d88e8a44ca
Nov 05 19:19:59 devstack sudo[100232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:59 devstack sudo[100232]: pam_unix(sudo:session): session closed for user root
Nov 05 19:19:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c.eacc00e6-849f-452e-a88a-12d88e8a44ca" returned: 0 in 0.302s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:19:59 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Lock "cinder-quobyte-eacc00e6-849f-452e-a88a-12d88e8a44ca" released by "_delete_snapshot" :: held 1.839s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:19:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.639s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:19:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3621f72a-52ab-484f-a4df-59968b2f00b0 tempest-CinderUnicodeTest-71031161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.114s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:19:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3621f72a-52ab-484f-a4df-59968b2f00b0 tempest-CinderUnicodeTest-71031161 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:19:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1639060574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e342b088-dfc8-4964-a266-3fe171068147,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66cb280e23984f5e9824416f64b784df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:19:48Z,use_quota=True,user_id='471edfe1f62348518c80c7c5c32c5117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:19:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-3621f72a-52ab-484f-a4df-59968b2f00b0 tempest-CinderUnicodeTest-71031161 None] Creating volume e342b088-dfc8-4964-a266-3fe171068147 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:19:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3621f72a-52ab-484f-a4df-59968b2f00b0 tempest-CinderUnicodeTest-71031161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:19:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3621f72a-52ab-484f-a4df-59968b2f00b0 tempest-CinderUnicodeTest-71031161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:19:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3621f72a-52ab-484f-a4df-59968b2f00b0 tempest-CinderUnicodeTest-71031161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:19:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3621f72a-52ab-484f-a4df-59968b2f00b0 tempest-CinderUnicodeTest-71031161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:19:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3621f72a-52ab-484f-a4df-59968b2f00b0 tempest-CinderUnicodeTest-71031161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:19:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3621f72a-52ab-484f-a4df-59968b2f00b0 tempest-CinderUnicodeTest-71031161 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:19:59 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-3621f72a-52ab-484f-a4df-59968b2f00b0 tempest-CinderUnicodeTest-71031161 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:19:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3621f72a-52ab-484f-a4df-59968b2f00b0 tempest-CinderUnicodeTest-71031161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:19:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66421a23-5dfe-4387-b021-d0feee9ad097) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-654c799f-c16a-4e4d-863a-aeb0d45c9aa2', 'volume_size': 2, 'source_volid': 'de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c', 'source_volstatus': 'available'}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:59 devstack sudo[100235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147 1073741824
Nov 05 19:19:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14dd6b7b-c516-4f2a-84c8-79898f0e458c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:19:59 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:19:59 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Volume volume-654c799f-c16a-4e4d-863a-aeb0d45c9aa2 (654c799f-c16a-4e4d-863a-aeb0d45c9aa2): created successfully
Nov 05 19:19:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14dd6b7b-c516-4f2a-84c8-79898f0e458c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:19:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Flow 'volume_create_manager' (acc2f44a-c07b-43aa-992f-9e3528e3a6f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:19:59 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-04f3e874-e4d3-45d2-802e-60ac0424e404 tempest-VolumesCloneTest-792670162 None] Created volume successfully.
Nov 05 19:20:00 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3621f72a-52ab-484f-a4df-59968b2f00b0 tempest-CinderUnicodeTest-71031161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147 1073741824" returned: 0 in 0.641s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3621f72a-52ab-484f-a4df-59968b2f00b0 tempest-CinderUnicodeTest-71031161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:00 devstack sudo[100241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147
Nov 05 19:20:00 devstack sudo[100241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:00 devstack sudo[100241]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3621f72a-52ab-484f-a4df-59968b2f00b0 tempest-CinderUnicodeTest-71031161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147" returned: 0 in 0.408s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3621f72a-52ab-484f-a4df-59968b2f00b0 tempest-CinderUnicodeTest-71031161 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:20:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3621f72a-52ab-484f-a4df-59968b2f00b0 tempest-CinderUnicodeTest-71031161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:20:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3621f72a-52ab-484f-a4df-59968b2f00b0 tempest-CinderUnicodeTest-71031161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b702d64-d8aa-4364-a83f-63be9ebb07c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e342b088-dfc8-4964-a266-3fe171068147', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3621f72a-52ab-484f-a4df-59968b2f00b0 tempest-CinderUnicodeTest-71031161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1f4544f-9a55-4a84-81f1-e019900631fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:01 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-3621f72a-52ab-484f-a4df-59968b2f00b0 tempest-CinderUnicodeTest-71031161 None] Volume volume-e342b088-dfc8-4964-a266-3fe171068147 (e342b088-dfc8-4964-a266-3fe171068147): created successfully
Nov 05 19:20:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3621f72a-52ab-484f-a4df-59968b2f00b0 tempest-CinderUnicodeTest-71031161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1f4544f-9a55-4a84-81f1-e019900631fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3621f72a-52ab-484f-a4df-59968b2f00b0 tempest-CinderUnicodeTest-71031161 None] Flow 'volume_create_manager' (cfce3439-5b1c-417d-8dab-05095e2a641d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:20:01 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-3621f72a-52ab-484f-a4df-59968b2f00b0 tempest-CinderUnicodeTest-71031161 None] Created volume successfully.
Nov 05 19:20:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9a5476a3-9c3a-42e8-87ea-85f1f57c0980 tempest-VolumesCloneTest-792670162 None] Acquiring lock "cinder-654c799f-c16a-4e4d-863a-aeb0d45c9aa2-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:20:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9a5476a3-9c3a-42e8-87ea-85f1f57c0980 tempest-VolumesCloneTest-792670162 None] Lock "cinder-654c799f-c16a-4e4d-863a-aeb0d45c9aa2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:20:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9a5476a3-9c3a-42e8-87ea-85f1f57c0980 tempest-VolumesCloneTest-792670162 None] Acquiring lock "cinder-quobyte-654c799f-c16a-4e4d-863a-aeb0d45c9aa2" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:20:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9a5476a3-9c3a-42e8-87ea-85f1f57c0980 tempest-VolumesCloneTest-792670162 None] Lock "cinder-quobyte-654c799f-c16a-4e4d-863a-aeb0d45c9aa2" acquired by "delete_volume" :: waited 0.029s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:20:01 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9ee62c-e698-4272-8c18-3d365c70b313]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:20:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9a5476a3-9c3a-42e8-87ea-85f1f57c0980 tempest-VolumesCloneTest-792670162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-654c799f-c16a-4e4d-863a-aeb0d45c9aa2 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:01 devstack sudo[100244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-654c799f-c16a-4e4d-863a-aeb0d45c9aa2
Nov 05 19:20:01 devstack sudo[100244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:01 devstack sudo[100244]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9a5476a3-9c3a-42e8-87ea-85f1f57c0980 tempest-VolumesCloneTest-792670162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-654c799f-c16a-4e4d-863a-aeb0d45c9aa2" returned: 0 in 0.499s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9a5476a3-9c3a-42e8-87ea-85f1f57c0980 tempest-VolumesCloneTest-792670162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-654c799f-c16a-4e4d-863a-aeb0d45c9aa2 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ab60a5f2-a589-49b2-b762-75f5141da766 tempest-VolumesNegativeTest-309175902 None] Acquiring lock "cinder-cdc073a4-4757-4ca6-a570-0824a963f682-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:20:01 devstack sudo[100249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-654c799f-c16a-4e4d-863a-aeb0d45c9aa2
Nov 05 19:20:01 devstack sudo[100249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ab60a5f2-a589-49b2-b762-75f5141da766 tempest-VolumesNegativeTest-309175902 None] Lock "cinder-cdc073a4-4757-4ca6-a570-0824a963f682-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:20:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ab60a5f2-a589-49b2-b762-75f5141da766 tempest-VolumesNegativeTest-309175902 None] Acquiring lock "cinder-quobyte-cdc073a4-4757-4ca6-a570-0824a963f682" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:20:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ab60a5f2-a589-49b2-b762-75f5141da766 tempest-VolumesNegativeTest-309175902 None] Lock "cinder-quobyte-cdc073a4-4757-4ca6-a570-0824a963f682" acquired by "delete_volume" :: waited 0.032s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:20:01 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[360103bd-1f94-4f24-ad03-18622251e8e0]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:20:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ab60a5f2-a589-49b2-b762-75f5141da766 tempest-VolumesNegativeTest-309175902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cdc073a4-4757-4ca6-a570-0824a963f682 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:02 devstack sudo[100249]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9a5476a3-9c3a-42e8-87ea-85f1f57c0980 tempest-VolumesCloneTest-792670162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-654c799f-c16a-4e4d-863a-aeb0d45c9aa2" returned: 0 in 0.363s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:02 devstack sudo[100251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cdc073a4-4757-4ca6-a570-0824a963f682
Nov 05 19:20:02 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9a5476a3-9c3a-42e8-87ea-85f1f57c0980 tempest-VolumesCloneTest-792670162 None] Lock "cinder-quobyte-654c799f-c16a-4e4d-863a-aeb0d45c9aa2" released by "delete_volume" :: held 0.931s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:20:02 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-9a5476a3-9c3a-42e8-87ea-85f1f57c0980 tempest-VolumesCloneTest-792670162 None] Created reservations ['a8af8d50-0f1d-44aa-8a7c-323f868b4dd9', 'af357751-485d-42d9-9f97-107d0e6f98b3', 'e94ef728-25a9-465f-a0c2-8670873af971', 'e3ba7b20-48fe-4ca2-bff0-c8fcb7dc7885'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:20:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-20675b0d-fae3-442e-af52-a5094d382fb1 tempest-CinderUnicodeTest-71031161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:20:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-20675b0d-fae3-442e-af52-a5094d382fb1 tempest-CinderUnicodeTest-71031161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:20:02 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-20675b0d-fae3-442e-af52-a5094d382fb1 tempest-CinderUnicodeTest-71031161 None] Creating offline snapshot 3272dd14-19eb-4ed4-9ef5-321941c60023 of volume e342b088-dfc8-4964-a266-3fe171068147 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:20:02 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de897b1-23d0-4202-9549-78bf17f10cec]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:20:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-20675b0d-fae3-442e-af52-a5094d382fb1 tempest-CinderUnicodeTest-71031161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9a5476a3-9c3a-42e8-87ea-85f1f57c0980 tempest-VolumesCloneTest-792670162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:20:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9a5476a3-9c3a-42e8-87ea-85f1f57c0980 tempest-VolumesCloneTest-792670162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:20:02 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9a5476a3-9c3a-42e8-87ea-85f1f57c0980 tempest-VolumesCloneTest-792670162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:20:02 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9a5476a3-9c3a-42e8-87ea-85f1f57c0980 tempest-VolumesCloneTest-792670162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:20:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9a5476a3-9c3a-42e8-87ea-85f1f57c0980 tempest-VolumesCloneTest-792670162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:20:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9a5476a3-9c3a-42e8-87ea-85f1f57c0980 tempest-VolumesCloneTest-792670162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:02 devstack sudo[100257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:20:02 devstack sudo[100257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:02 devstack sudo[100254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147
Nov 05 19:20:02 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:02 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ab60a5f2-a589-49b2-b762-75f5141da766 tempest-VolumesNegativeTest-309175902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cdc073a4-4757-4ca6-a570-0824a963f682" returned: 0 in 0.558s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ab60a5f2-a589-49b2-b762-75f5141da766 tempest-VolumesNegativeTest-309175902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cdc073a4-4757-4ca6-a570-0824a963f682 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:02 devstack sudo[100262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cdc073a4-4757-4ca6-a570-0824a963f682
Nov 05 19:20:02 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:02 devstack sudo[100257]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9a5476a3-9c3a-42e8-87ea-85f1f57c0980 tempest-VolumesCloneTest-792670162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.313s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:02 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-9a5476a3-9c3a-42e8-87ea-85f1f57c0980 tempest-VolumesCloneTest-792670162 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:20:02 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-9a5476a3-9c3a-42e8-87ea-85f1f57c0980 tempest-VolumesCloneTest-792670162 None] Deleted volume successfully.
Nov 05 19:20:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9a5476a3-9c3a-42e8-87ea-85f1f57c0980 tempest-VolumesCloneTest-792670162 None] Lock "cinder-654c799f-c16a-4e4d-863a-aeb0d45c9aa2-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:20:02 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ab60a5f2-a589-49b2-b762-75f5141da766 tempest-VolumesNegativeTest-309175902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cdc073a4-4757-4ca6-a570-0824a963f682" returned: 0 in 0.287s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:02 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-20675b0d-fae3-442e-af52-a5094d382fb1 tempest-CinderUnicodeTest-71031161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147" returned: 0 in 0.456s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-20675b0d-fae3-442e-af52-a5094d382fb1 tempest-CinderUnicodeTest-71031161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147.3272dd14-19eb-4ed4-9ef5-321941c60023 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ab60a5f2-a589-49b2-b762-75f5141da766 tempest-VolumesNegativeTest-309175902 None] Lock "cinder-quobyte-cdc073a4-4757-4ca6-a570-0824a963f682" released by "delete_volume" :: held 0.934s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:20:02 devstack sudo[100269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147.3272dd14-19eb-4ed4-9ef5-321941c60023 1G
Nov 05 19:20:02 devstack sudo[100269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:02 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-ab60a5f2-a589-49b2-b762-75f5141da766 tempest-VolumesNegativeTest-309175902 None] Created reservations ['8f936b4e-dc02-46b8-81b9-b5b4934994bd', 'a7f44a93-9aa5-4d34-86fe-b3b62a755beb', '0cd2d0c8-791b-4ef2-90f8-4f311e9aa4bf', '5801e5c7-bd8d-4e52-a221-c816961f5e8d'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:20:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ab60a5f2-a589-49b2-b762-75f5141da766 tempest-VolumesNegativeTest-309175902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:20:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ab60a5f2-a589-49b2-b762-75f5141da766 tempest-VolumesNegativeTest-309175902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:20:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ab60a5f2-a589-49b2-b762-75f5141da766 tempest-VolumesNegativeTest-309175902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:20:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ab60a5f2-a589-49b2-b762-75f5141da766 tempest-VolumesNegativeTest-309175902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:20:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ab60a5f2-a589-49b2-b762-75f5141da766 tempest-VolumesNegativeTest-309175902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:20:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ab60a5f2-a589-49b2-b762-75f5141da766 tempest-VolumesNegativeTest-309175902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:03 devstack sudo[100273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:20:03 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:03 devstack sudo[100269]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-20675b0d-fae3-442e-af52-a5094d382fb1 tempest-CinderUnicodeTest-71031161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147.3272dd14-19eb-4ed4-9ef5-321941c60023 1G" returned: 0 in 0.504s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-20675b0d-fae3-442e-af52-a5094d382fb1 tempest-CinderUnicodeTest-71031161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e342b088-dfc8-4964-a266-3fe171068147 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147.3272dd14-19eb-4ed4-9ef5-321941c60023 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:03 devstack sudo[100278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e342b088-dfc8-4964-a266-3fe171068147 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147.3272dd14-19eb-4ed4-9ef5-321941c60023
Nov 05 19:20:03 devstack sudo[100278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:03 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ab60a5f2-a589-49b2-b762-75f5141da766 tempest-VolumesNegativeTest-309175902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.319s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:03 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-ab60a5f2-a589-49b2-b762-75f5141da766 tempest-VolumesNegativeTest-309175902 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:20:03 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-ab60a5f2-a589-49b2-b762-75f5141da766 tempest-VolumesNegativeTest-309175902 None] Deleted volume successfully.
Nov 05 19:20:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ab60a5f2-a589-49b2-b762-75f5141da766 tempest-VolumesNegativeTest-309175902 None] Lock "cinder-cdc073a4-4757-4ca6-a570-0824a963f682-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:20:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-03502734-839e-4f30-a212-7168c8d6eb88 tempest-VolumesCloneTest-792670162 None] Acquiring lock "cinder-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:20:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-03502734-839e-4f30-a212-7168c8d6eb88 tempest-VolumesCloneTest-792670162 None] Lock "cinder-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:20:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-03502734-839e-4f30-a212-7168c8d6eb88 tempest-VolumesCloneTest-792670162 None] Acquiring lock "cinder-quobyte-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:20:03 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-03502734-839e-4f30-a212-7168c8d6eb88 tempest-VolumesCloneTest-792670162 None] Lock "cinder-quobyte-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c" acquired by "delete_volume" :: waited 0.015s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:20:03 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3bb3ca-c0be-492f-ba13-fd273cdb99f7]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:20:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-03502734-839e-4f30-a212-7168c8d6eb88 tempest-VolumesCloneTest-792670162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:03 devstack sudo[100278]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-20675b0d-fae3-442e-af52-a5094d382fb1 tempest-CinderUnicodeTest-71031161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e342b088-dfc8-4964-a266-3fe171068147 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147.3272dd14-19eb-4ed4-9ef5-321941c60023" returned: 0 in 0.425s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:03 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-20675b0d-fae3-442e-af52-a5094d382fb1 tempest-CinderUnicodeTest-71031161 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147.3272dd14-19eb-4ed4-9ef5-321941c60023 is being set with open permissions: ugo+rw
Nov 05 19:20:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-20675b0d-fae3-442e-af52-a5094d382fb1 tempest-CinderUnicodeTest-71031161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147.3272dd14-19eb-4ed4-9ef5-321941c60023 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:03 devstack sudo[100284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147.3272dd14-19eb-4ed4-9ef5-321941c60023
Nov 05 19:20:03 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:03 devstack sudo[100283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c
Nov 05 19:20:03 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:04 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-20675b0d-fae3-442e-af52-a5094d382fb1 tempest-CinderUnicodeTest-71031161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147.3272dd14-19eb-4ed4-9ef5-321941c60023" returned: 0 in 0.281s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-20675b0d-fae3-442e-af52-a5094d382fb1 tempest-CinderUnicodeTest-71031161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:04 devstack sudo[100290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147.info
Nov 05 19:20:04 devstack sudo[100290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:04 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-03502734-839e-4f30-a212-7168c8d6eb88 tempest-VolumesCloneTest-792670162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c" returned: 0 in 0.474s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-03502734-839e-4f30-a212-7168c8d6eb88 tempest-VolumesCloneTest-792670162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:04 devstack sudo[100295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c
Nov 05 19:20:04 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:04 devstack sudo[100290]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-20675b0d-fae3-442e-af52-a5094d382fb1 tempest-CinderUnicodeTest-71031161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147.info" returned: 0 in 0.338s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:04 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-20675b0d-fae3-442e-af52-a5094d382fb1 tempest-CinderUnicodeTest-71031161 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147.info is being set with open permissions: ugo+rw
Nov 05 19:20:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-20675b0d-fae3-442e-af52-a5094d382fb1 tempest-CinderUnicodeTest-71031161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:04 devstack sudo[100298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147.info
Nov 05 19:20:04 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:04 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-03502734-839e-4f30-a212-7168c8d6eb88 tempest-VolumesCloneTest-792670162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c" returned: 0 in 0.315s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-03502734-839e-4f30-a212-7168c8d6eb88 tempest-VolumesCloneTest-792670162 None] Lock "cinder-quobyte-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c" released by "delete_volume" :: held 0.876s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:20:04 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-03502734-839e-4f30-a212-7168c8d6eb88 tempest-VolumesCloneTest-792670162 None] Created reservations ['b73f8d73-30ea-43a5-a55c-4511220cf7c6', '49e2d778-4164-4790-ba58-52268b42c936', 'b861e102-ed36-4a5f-9540-7a7977e8b42e', '065bc54a-ff2f-4bb2-a210-1989555874e9'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:20:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-03502734-839e-4f30-a212-7168c8d6eb88 tempest-VolumesCloneTest-792670162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:20:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-03502734-839e-4f30-a212-7168c8d6eb88 tempest-VolumesCloneTest-792670162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:20:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-03502734-839e-4f30-a212-7168c8d6eb88 tempest-VolumesCloneTest-792670162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:20:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-03502734-839e-4f30-a212-7168c8d6eb88 tempest-VolumesCloneTest-792670162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:20:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-03502734-839e-4f30-a212-7168c8d6eb88 tempest-VolumesCloneTest-792670162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:20:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-03502734-839e-4f30-a212-7168c8d6eb88 tempest-VolumesCloneTest-792670162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:04 devstack sudo[100302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:20:04 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:04 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-20675b0d-fae3-442e-af52-a5094d382fb1 tempest-CinderUnicodeTest-71031161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147.info" returned: 0 in 0.332s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-20675b0d-fae3-442e-af52-a5094d382fb1 tempest-CinderUnicodeTest-71031161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.465s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:20:04 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-20675b0d-fae3-442e-af52-a5094d382fb1 tempest-CinderUnicodeTest-71031161 None] Create snapshot completed successfully
Nov 05 19:20:05 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-03502734-839e-4f30-a212-7168c8d6eb88 tempest-VolumesCloneTest-792670162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.346s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:05 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-03502734-839e-4f30-a212-7168c8d6eb88 tempest-VolumesCloneTest-792670162 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:20:05 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-03502734-839e-4f30-a212-7168c8d6eb88 tempest-VolumesCloneTest-792670162 None] Deleted volume successfully.
Nov 05 19:20:05 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-03502734-839e-4f30-a212-7168c8d6eb88 tempest-VolumesCloneTest-792670162 None] Lock "cinder-de3c2cd3-ad6f-4daa-a4f8-aaa477613b0c-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:20:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:20:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:20:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:20:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:20:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:20:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:20:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:05 devstack sudo[100305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:20:05 devstack sudo[100305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:05 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-61bd58f4-05f9-405c-b618-bbfd79325718 tempest-CinderUnicodeTest-71031161 None] Acquiring lock "cinder-3272dd14-19eb-4ed4-9ef5-321941c60023-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:20:05 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-61bd58f4-05f9-405c-b618-bbfd79325718 tempest-CinderUnicodeTest-71031161 None] Lock "cinder-3272dd14-19eb-4ed4-9ef5-321941c60023-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:20:05 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-61bd58f4-05f9-405c-b618-bbfd79325718 tempest-CinderUnicodeTest-71031161 None] Acquiring lock "cinder-quobyte-e342b088-dfc8-4964-a266-3fe171068147" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:20:05 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-61bd58f4-05f9-405c-b618-bbfd79325718 tempest-CinderUnicodeTest-71031161 None] Lock "cinder-quobyte-e342b088-dfc8-4964-a266-3fe171068147" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:20:05 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-61bd58f4-05f9-405c-b618-bbfd79325718 tempest-CinderUnicodeTest-71031161 None] Acquiring lock "cinder-quobyte-3272dd14-19eb-4ed4-9ef5-321941c60023" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:20:05 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-61bd58f4-05f9-405c-b618-bbfd79325718 tempest-CinderUnicodeTest-71031161 None] Lock "cinder-quobyte-3272dd14-19eb-4ed4-9ef5-321941c60023" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:20:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-61bd58f4-05f9-405c-b618-bbfd79325718 tempest-CinderUnicodeTest-71031161 None] Deleting offline snapshot 3272dd14-19eb-4ed4-9ef5-321941c60023 of volume e342b088-dfc8-4964-a266-3fe171068147 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:20:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-61bd58f4-05f9-405c-b618-bbfd79325718 tempest-CinderUnicodeTest-71031161 None] snapshot_file for this snap is: volume-e342b088-dfc8-4964-a266-3fe171068147.3272dd14-19eb-4ed4-9ef5-321941c60023 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:20:05 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc88c71-ebff-402f-b76b-48f34a2ee4f9]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:20:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-61bd58f4-05f9-405c-b618-bbfd79325718 tempest-CinderUnicodeTest-71031161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147.3272dd14-19eb-4ed4-9ef5-321941c60023 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:05 devstack sudo[100305]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.468s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:05 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:20:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:20:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread count: 28 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 19:20:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread info: [<_MainThread(MainThread, started 126882883072128)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126882770872512)>, <Thread(Thread-3 (stat_writer), started daemon 126882769837376)>, <Thread(Rabbit-heartbeat, started daemon 126882768896256)>, <Thread(Thread-5 (_runner), started daemon 126882768980928)>, <Thread(Thread-7 (_runner), started daemon 126882767016448)>, <Thread(fd_logger, started daemon 126882764561216)>, <Thread(privsep_reader, started daemon 126882764568576)>, <Thread(tpool_thread_0, started daemon 126882759292608)>, <Thread(tpool_thread_1, started daemon 126882750899904)>, <Thread(tpool_thread_2, started daemon 126882742507200)>, <Thread(tpool_thread_3, started daemon 126882734114496)>, <Thread(tpool_thread_4, started daemon 126882725721792)>, <Thread(tpool_thread_5, started daemon 126882717329088)>, <Thread(tpool_thread_6, started daemon 126882708920000)>, <Thread(tpool_thread_7, started daemon 126882700510912)>, <Thread(tpool_thread_8, started daemon 126882692101824)>, <Thread(tpool_thread_9, started daemon 126882683692736)>, <Thread(tpool_thread_10, started daemon 126882675283648)>, <Thread(tpool_thread_11, started daemon 126882666874560)>, <Thread(tpool_thread_12, started daemon 126882658465472)>, <Thread(tpool_thread_13, started daemon 126882650056384)>, <Thread(tpool_thread_14, started daemon 126882641647296)>, <Thread(tpool_thread_15, started daemon 126882633238208)>, <Thread(tpool_thread_16, started daemon 126882624829120)>, <Thread(tpool_thread_17, started daemon 126882616420032)>, <Thread(tpool_thread_18, started daemon 126882608010944)>, <Thread(tpool_thread_19, started daemon 126882599601856)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 19:20:05 devstack sudo[100308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147.3272dd14-19eb-4ed4-9ef5-321941c60023
Nov 05 19:20:05 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:06 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-61bd58f4-05f9-405c-b618-bbfd79325718 tempest-CinderUnicodeTest-71031161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147.3272dd14-19eb-4ed4-9ef5-321941c60023" returned: 0 in 0.519s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-61bd58f4-05f9-405c-b618-bbfd79325718 tempest-CinderUnicodeTest-71031161 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e342b088-dfc8-4964-a266-3fe171068147(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:20:06 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e438d784-3c45-44e0-9ff0-b13c6de8cf81]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:20:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-61bd58f4-05f9-405c-b618-bbfd79325718 tempest-CinderUnicodeTest-71031161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:06 devstack sudo[100313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147
Nov 05 19:20:06 devstack sudo[100313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:06 devstack sudo[100313]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-61bd58f4-05f9-405c-b618-bbfd79325718 tempest-CinderUnicodeTest-71031161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147" returned: 0 in 0.529s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-61bd58f4-05f9-405c-b618-bbfd79325718 tempest-CinderUnicodeTest-71031161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147.3272dd14-19eb-4ed4-9ef5-321941c60023 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:06 devstack sudo[100319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147.3272dd14-19eb-4ed4-9ef5-321941c60023
Nov 05 19:20:06 devstack sudo[100319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:07 devstack sudo[100319]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-61bd58f4-05f9-405c-b618-bbfd79325718 tempest-CinderUnicodeTest-71031161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147.3272dd14-19eb-4ed4-9ef5-321941c60023" returned: 0 in 0.522s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-61bd58f4-05f9-405c-b618-bbfd79325718 tempest-CinderUnicodeTest-71031161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147.3272dd14-19eb-4ed4-9ef5-321941c60023 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:07 devstack sudo[100327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147.3272dd14-19eb-4ed4-9ef5-321941c60023
Nov 05 19:20:07 devstack sudo[100327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:07 devstack sudo[100327]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-61bd58f4-05f9-405c-b618-bbfd79325718 tempest-CinderUnicodeTest-71031161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147.3272dd14-19eb-4ed4-9ef5-321941c60023" returned: 0 in 0.367s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-61bd58f4-05f9-405c-b618-bbfd79325718 tempest-CinderUnicodeTest-71031161 None] Lock "cinder-quobyte-3272dd14-19eb-4ed4-9ef5-321941c60023" released by "_delete_snapshot" :: held 2.139s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:20:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-61bd58f4-05f9-405c-b618-bbfd79325718 tempest-CinderUnicodeTest-71031161 None] Lock "cinder-quobyte-e342b088-dfc8-4964-a266-3fe171068147" released by "delete_snapshot" :: held 2.175s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:20:07 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-61bd58f4-05f9-405c-b618-bbfd79325718 tempest-CinderUnicodeTest-71031161 None] Created reservations ['794d3835-9ec8-4854-930a-866b6d41c5e8', '4eaddf7f-43d6-4cb8-8ebd-56037ae13fd7', '7dbdedd0-52bd-4a63-a221-8b9d10c36721', '196f1dde-b721-4f0d-80ef-a3ca43a368fa'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:20:07 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-61bd58f4-05f9-405c-b618-bbfd79325718 tempest-CinderUnicodeTest-71031161 None] Delete snapshot completed successfully.
Nov 05 19:20:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-61bd58f4-05f9-405c-b618-bbfd79325718 tempest-CinderUnicodeTest-71031161 None] Lock "cinder-3272dd14-19eb-4ed4-9ef5-321941c60023-delete_snapshot" released by "delete_snapshot" :: held 2.379s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:20:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e4761448-9073-46c7-ab9d-45e8d4fcdad7 tempest-CinderUnicodeTest-71031161 None] Acquiring lock "cinder-e342b088-dfc8-4964-a266-3fe171068147-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:20:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e4761448-9073-46c7-ab9d-45e8d4fcdad7 tempest-CinderUnicodeTest-71031161 None] Lock "cinder-e342b088-dfc8-4964-a266-3fe171068147-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:20:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e4761448-9073-46c7-ab9d-45e8d4fcdad7 tempest-CinderUnicodeTest-71031161 None] Acquiring lock "cinder-quobyte-e342b088-dfc8-4964-a266-3fe171068147" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:20:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e4761448-9073-46c7-ab9d-45e8d4fcdad7 tempest-CinderUnicodeTest-71031161 None] Lock "cinder-quobyte-e342b088-dfc8-4964-a266-3fe171068147" acquired by "delete_volume" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:20:09 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0315178-2b30-4cc1-8751-786a1da6149f]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:20:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e4761448-9073-46c7-ab9d-45e8d4fcdad7 tempest-CinderUnicodeTest-71031161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:09 devstack sudo[100330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147
Nov 05 19:20:09 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:09 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e4761448-9073-46c7-ab9d-45e8d4fcdad7 tempest-CinderUnicodeTest-71031161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147" returned: 0 in 0.540s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e4761448-9073-46c7-ab9d-45e8d4fcdad7 tempest-CinderUnicodeTest-71031161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:09 devstack sudo[100335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147
Nov 05 19:20:09 devstack sudo[100335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:10 devstack sudo[100335]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e4761448-9073-46c7-ab9d-45e8d4fcdad7 tempest-CinderUnicodeTest-71031161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e342b088-dfc8-4964-a266-3fe171068147" returned: 0 in 0.387s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e4761448-9073-46c7-ab9d-45e8d4fcdad7 tempest-CinderUnicodeTest-71031161 None] Lock "cinder-quobyte-e342b088-dfc8-4964-a266-3fe171068147" released by "delete_volume" :: held 1.054s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:20:10 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-e4761448-9073-46c7-ab9d-45e8d4fcdad7 tempest-CinderUnicodeTest-71031161 None] Created reservations ['02c4eff7-b301-4e3f-ae9a-a9821fa2f943', 'c4059e53-c716-4422-8fa8-68728d20e697', 'b57249cc-b68b-4692-a07c-ce9467141a3b', 'cf49fd38-0bfb-4114-a54f-2c071144e9a2'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:20:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e4761448-9073-46c7-ab9d-45e8d4fcdad7 tempest-CinderUnicodeTest-71031161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:20:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e4761448-9073-46c7-ab9d-45e8d4fcdad7 tempest-CinderUnicodeTest-71031161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:20:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e4761448-9073-46c7-ab9d-45e8d4fcdad7 tempest-CinderUnicodeTest-71031161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:20:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e4761448-9073-46c7-ab9d-45e8d4fcdad7 tempest-CinderUnicodeTest-71031161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:20:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e4761448-9073-46c7-ab9d-45e8d4fcdad7 tempest-CinderUnicodeTest-71031161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:20:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e4761448-9073-46c7-ab9d-45e8d4fcdad7 tempest-CinderUnicodeTest-71031161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:10 devstack sudo[100338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:20:10 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:10 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e4761448-9073-46c7-ab9d-45e8d4fcdad7 tempest-CinderUnicodeTest-71031161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.331s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:10 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-e4761448-9073-46c7-ab9d-45e8d4fcdad7 tempest-CinderUnicodeTest-71031161 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:20:10 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-e4761448-9073-46c7-ab9d-45e8d4fcdad7 tempest-CinderUnicodeTest-71031161 None] Deleted volume successfully.
Nov 05 19:20:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e4761448-9073-46c7-ab9d-45e8d4fcdad7 tempest-CinderUnicodeTest-71031161 None] Lock "cinder-e342b088-dfc8-4964-a266-3fe171068147-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:20:10 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-045975fb-e901-49f1-9a27-ef057d8eda18 tempest-VolumesGetTest-2098101542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:20:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-045975fb-e901-49f1-9a27-ef057d8eda18 tempest-VolumesGetTest-2098101542 None] Flow 'volume_create_manager' (b17a4fb5-2057-46eb-b6e2-437ce7ef2843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:20:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-045975fb-e901-49f1-9a27-ef057d8eda18 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f02fa497-553b-482e-be6d-43a1783174fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-045975fb-e901-49f1-9a27-ef057d8eda18 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f02fa497-553b-482e-be6d-43a1783174fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-949580422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc4ee0fd-551b-43cc-a61d-40e1794b2a48,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='409f7e915edd48d6a6656bbe4ec42331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:20:11Z,use_quota=True,user_id='bacc0b743e174fb78263f33729f9f26d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-045975fb-e901-49f1-9a27-ef057d8eda18 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe789f60-019a-421d-a6b5-7141d15c61e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-045975fb-e901-49f1-9a27-ef057d8eda18 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe789f60-019a-421d-a6b5-7141d15c61e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-045975fb-e901-49f1-9a27-ef057d8eda18 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94badead-77e2-46e8-830b-16e402d93d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-045975fb-e901-49f1-9a27-ef057d8eda18 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94badead-77e2-46e8-830b-16e402d93d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc4ee0fd-551b-43cc-a61d-40e1794b2a48', 'volume_name': 'volume-fc4ee0fd-551b-43cc-a61d-40e1794b2a48', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-045975fb-e901-49f1-9a27-ef057d8eda18 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a619251-cb28-45e4-b889-a7c02ae17a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-045975fb-e901-49f1-9a27-ef057d8eda18 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a619251-cb28-45e4-b889-a7c02ae17a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-045975fb-e901-49f1-9a27-ef057d8eda18 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e760ba7-6dd9-46c3-9dbf-1e9b00a80afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:10 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-045975fb-e901-49f1-9a27-ef057d8eda18 tempest-VolumesGetTest-2098101542 None] Volume fc4ee0fd-551b-43cc-a61d-40e1794b2a48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc4ee0fd-551b-43cc-a61d-40e1794b2a48', 'volume_size': 1}
Nov 05 19:20:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-045975fb-e901-49f1-9a27-ef057d8eda18 tempest-VolumesGetTest-2098101542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:20:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-045975fb-e901-49f1-9a27-ef057d8eda18 tempest-VolumesGetTest-2098101542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:20:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-045975fb-e901-49f1-9a27-ef057d8eda18 tempest-VolumesGetTest-2098101542 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-949580422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc4ee0fd-551b-43cc-a61d-40e1794b2a48,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='409f7e915edd48d6a6656bbe4ec42331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:20:11Z,use_quota=True,user_id='bacc0b743e174fb78263f33729f9f26d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:20:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-045975fb-e901-49f1-9a27-ef057d8eda18 tempest-VolumesGetTest-2098101542 None] Creating volume fc4ee0fd-551b-43cc-a61d-40e1794b2a48 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:20:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-045975fb-e901-49f1-9a27-ef057d8eda18 tempest-VolumesGetTest-2098101542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:20:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-045975fb-e901-49f1-9a27-ef057d8eda18 tempest-VolumesGetTest-2098101542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:20:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-045975fb-e901-49f1-9a27-ef057d8eda18 tempest-VolumesGetTest-2098101542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:20:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-045975fb-e901-49f1-9a27-ef057d8eda18 tempest-VolumesGetTest-2098101542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:20:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-045975fb-e901-49f1-9a27-ef057d8eda18 tempest-VolumesGetTest-2098101542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:20:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-045975fb-e901-49f1-9a27-ef057d8eda18 tempest-VolumesGetTest-2098101542 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:20:10 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-045975fb-e901-49f1-9a27-ef057d8eda18 tempest-VolumesGetTest-2098101542 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:20:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-045975fb-e901-49f1-9a27-ef057d8eda18 tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fc4ee0fd-551b-43cc-a61d-40e1794b2a48 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:10 devstack sudo[100343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fc4ee0fd-551b-43cc-a61d-40e1794b2a48 1073741824
Nov 05 19:20:10 devstack sudo[100343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-312138b2-ad86-4ec2-98f7-380475917516 tempest-CinderUnicodeTest-71031161 None] Acquiring lock "cinder-0ab1244e-7484-4091-937c-53e68837e78c-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:20:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-312138b2-ad86-4ec2-98f7-380475917516 tempest-CinderUnicodeTest-71031161 None] Lock "cinder-0ab1244e-7484-4091-937c-53e68837e78c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:20:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-312138b2-ad86-4ec2-98f7-380475917516 tempest-CinderUnicodeTest-71031161 None] Acquiring lock "cinder-quobyte-0ab1244e-7484-4091-937c-53e68837e78c" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:20:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-312138b2-ad86-4ec2-98f7-380475917516 tempest-CinderUnicodeTest-71031161 None] Lock "cinder-quobyte-0ab1244e-7484-4091-937c-53e68837e78c" acquired by "delete_volume" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:20:11 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edaa8b9-0eb4-44ea-81db-b98b5d723159]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:20:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-312138b2-ad86-4ec2-98f7-380475917516 tempest-CinderUnicodeTest-71031161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ab1244e-7484-4091-937c-53e68837e78c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:11 devstack sudo[100343]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-045975fb-e901-49f1-9a27-ef057d8eda18 tempest-VolumesGetTest-2098101542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fc4ee0fd-551b-43cc-a61d-40e1794b2a48 1073741824" returned: 0 in 0.624s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-045975fb-e901-49f1-9a27-ef057d8eda18 tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fc4ee0fd-551b-43cc-a61d-40e1794b2a48 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:11 devstack sudo[100349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ab1244e-7484-4091-937c-53e68837e78c
Nov 05 19:20:11 devstack sudo[100349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:11 devstack sudo[100350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fc4ee0fd-551b-43cc-a61d-40e1794b2a48
Nov 05 19:20:11 devstack sudo[100350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:11 devstack sudo[100350]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-045975fb-e901-49f1-9a27-ef057d8eda18 tempest-VolumesGetTest-2098101542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fc4ee0fd-551b-43cc-a61d-40e1794b2a48" returned: 0 in 0.344s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-045975fb-e901-49f1-9a27-ef057d8eda18 tempest-VolumesGetTest-2098101542 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:20:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-045975fb-e901-49f1-9a27-ef057d8eda18 tempest-VolumesGetTest-2098101542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:20:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-045975fb-e901-49f1-9a27-ef057d8eda18 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e760ba7-6dd9-46c3-9dbf-1e9b00a80afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc4ee0fd-551b-43cc-a61d-40e1794b2a48', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:11 devstack sudo[100349]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-045975fb-e901-49f1-9a27-ef057d8eda18 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3f1403d-8bc0-4f25-8039-d22be04cec1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-312138b2-ad86-4ec2-98f7-380475917516 tempest-CinderUnicodeTest-71031161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ab1244e-7484-4091-937c-53e68837e78c" returned: 0 in 0.536s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-312138b2-ad86-4ec2-98f7-380475917516 tempest-CinderUnicodeTest-71031161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ab1244e-7484-4091-937c-53e68837e78c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:12 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-045975fb-e901-49f1-9a27-ef057d8eda18 tempest-VolumesGetTest-2098101542 None] Volume volume-fc4ee0fd-551b-43cc-a61d-40e1794b2a48 (fc4ee0fd-551b-43cc-a61d-40e1794b2a48): created successfully
Nov 05 19:20:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-045975fb-e901-49f1-9a27-ef057d8eda18 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3f1403d-8bc0-4f25-8039-d22be04cec1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-045975fb-e901-49f1-9a27-ef057d8eda18 tempest-VolumesGetTest-2098101542 None] Flow 'volume_create_manager' (b17a4fb5-2057-46eb-b6e2-437ce7ef2843) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:20:12 devstack sudo[100357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ab1244e-7484-4091-937c-53e68837e78c
Nov 05 19:20:12 devstack sudo[100357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:12 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-045975fb-e901-49f1-9a27-ef057d8eda18 tempest-VolumesGetTest-2098101542 None] Created volume successfully.
Nov 05 19:20:12 devstack sudo[100357]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-312138b2-ad86-4ec2-98f7-380475917516 tempest-CinderUnicodeTest-71031161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0ab1244e-7484-4091-937c-53e68837e78c" returned: 0 in 0.337s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-312138b2-ad86-4ec2-98f7-380475917516 tempest-CinderUnicodeTest-71031161 None] Lock "cinder-quobyte-0ab1244e-7484-4091-937c-53e68837e78c" released by "delete_volume" :: held 0.937s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:20:12 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-312138b2-ad86-4ec2-98f7-380475917516 tempest-CinderUnicodeTest-71031161 None] Created reservations ['cf9a215e-a514-44bb-a4c0-fc62dc5b88a4', '99830a83-9ae7-4796-a88b-6f810ae1e44f', '20cdf7b4-08ed-4122-a86c-b457762833f0', '2b5a6a66-a2c2-4694-971a-e90cdfae028d'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:20:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-312138b2-ad86-4ec2-98f7-380475917516 tempest-CinderUnicodeTest-71031161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:20:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-312138b2-ad86-4ec2-98f7-380475917516 tempest-CinderUnicodeTest-71031161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:20:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-312138b2-ad86-4ec2-98f7-380475917516 tempest-CinderUnicodeTest-71031161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:20:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-312138b2-ad86-4ec2-98f7-380475917516 tempest-CinderUnicodeTest-71031161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:20:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-312138b2-ad86-4ec2-98f7-380475917516 tempest-CinderUnicodeTest-71031161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:20:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-312138b2-ad86-4ec2-98f7-380475917516 tempest-CinderUnicodeTest-71031161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:12 devstack sudo[100360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:20:12 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:12 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-312138b2-ad86-4ec2-98f7-380475917516 tempest-CinderUnicodeTest-71031161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.334s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:12 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-312138b2-ad86-4ec2-98f7-380475917516 tempest-CinderUnicodeTest-71031161 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:20:12 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-312138b2-ad86-4ec2-98f7-380475917516 tempest-CinderUnicodeTest-71031161 None] Deleted volume successfully.
Nov 05 19:20:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-312138b2-ad86-4ec2-98f7-380475917516 tempest-CinderUnicodeTest-71031161 None] Lock "cinder-0ab1244e-7484-4091-937c-53e68837e78c-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:20:14 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-f36e568b-75c5-47b1-8fe5-ab0d48a67220 tempest-VolumesGetTest-2098101542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:20:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f36e568b-75c5-47b1-8fe5-ab0d48a67220 tempest-VolumesGetTest-2098101542 None] Flow 'volume_create_manager' (93d5e1dc-1b79-4cc7-a10d-0cb7517eaf04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:20:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f36e568b-75c5-47b1-8fe5-ab0d48a67220 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (814c32c9-5299-4133-b146-5539e888cd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f36e568b-75c5-47b1-8fe5-ab0d48a67220 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (814c32c9-5299-4133-b146-5539e888cd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:20:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1442996163',display_name='tempest-VolumesGetTest-Volume-342930516',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96fdf9d6-8a68-4d87-aee4-eb3cfea1caf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='409f7e915edd48d6a6656bbe4ec42331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:20:14Z,use_quota=True,user_id='bacc0b743e174fb78263f33729f9f26d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f36e568b-75c5-47b1-8fe5-ab0d48a67220 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1bd9f81-52fd-493e-bd40-564f4609b87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f36e568b-75c5-47b1-8fe5-ab0d48a67220 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1bd9f81-52fd-493e-bd40-564f4609b87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f36e568b-75c5-47b1-8fe5-ab0d48a67220 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9141af4-5aa6-45e7-bf59-682f96039aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f36e568b-75c5-47b1-8fe5-ab0d48a67220 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9141af4-5aa6-45e7-bf59-682f96039aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96fdf9d6-8a68-4d87-aee4-eb3cfea1caf8', 'volume_name': 'volume-96fdf9d6-8a68-4d87-aee4-eb3cfea1caf8', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f36e568b-75c5-47b1-8fe5-ab0d48a67220 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8796524-b8a0-4638-aebc-664c92c59a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f36e568b-75c5-47b1-8fe5-ab0d48a67220 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8796524-b8a0-4638-aebc-664c92c59a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f36e568b-75c5-47b1-8fe5-ab0d48a67220 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (156025f8-469b-41c9-96b7-4f6f78d76e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:14 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-f36e568b-75c5-47b1-8fe5-ab0d48a67220 tempest-VolumesGetTest-2098101542 None] Volume 96fdf9d6-8a68-4d87-aee4-eb3cfea1caf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96fdf9d6-8a68-4d87-aee4-eb3cfea1caf8', 'volume_size': 1}
Nov 05 19:20:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f36e568b-75c5-47b1-8fe5-ab0d48a67220 tempest-VolumesGetTest-2098101542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:20:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f36e568b-75c5-47b1-8fe5-ab0d48a67220 tempest-VolumesGetTest-2098101542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:20:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f36e568b-75c5-47b1-8fe5-ab0d48a67220 tempest-VolumesGetTest-2098101542 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:20:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1442996163',display_name='tempest-VolumesGetTest-Volume-342930516',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96fdf9d6-8a68-4d87-aee4-eb3cfea1caf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='409f7e915edd48d6a6656bbe4ec42331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:20:14Z,use_quota=True,user_id='bacc0b743e174fb78263f33729f9f26d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:20:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-f36e568b-75c5-47b1-8fe5-ab0d48a67220 tempest-VolumesGetTest-2098101542 None] Creating volume 96fdf9d6-8a68-4d87-aee4-eb3cfea1caf8 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:20:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f36e568b-75c5-47b1-8fe5-ab0d48a67220 tempest-VolumesGetTest-2098101542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:20:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f36e568b-75c5-47b1-8fe5-ab0d48a67220 tempest-VolumesGetTest-2098101542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:20:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f36e568b-75c5-47b1-8fe5-ab0d48a67220 tempest-VolumesGetTest-2098101542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:20:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f36e568b-75c5-47b1-8fe5-ab0d48a67220 tempest-VolumesGetTest-2098101542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:20:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f36e568b-75c5-47b1-8fe5-ab0d48a67220 tempest-VolumesGetTest-2098101542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:20:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f36e568b-75c5-47b1-8fe5-ab0d48a67220 tempest-VolumesGetTest-2098101542 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:20:14 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-f36e568b-75c5-47b1-8fe5-ab0d48a67220 tempest-VolumesGetTest-2098101542 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:20:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f36e568b-75c5-47b1-8fe5-ab0d48a67220 tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-96fdf9d6-8a68-4d87-aee4-eb3cfea1caf8 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:14 devstack sudo[100363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-96fdf9d6-8a68-4d87-aee4-eb3cfea1caf8 1073741824
Nov 05 19:20:14 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:14 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f36e568b-75c5-47b1-8fe5-ab0d48a67220 tempest-VolumesGetTest-2098101542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-96fdf9d6-8a68-4d87-aee4-eb3cfea1caf8 1073741824" returned: 0 in 0.685s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f36e568b-75c5-47b1-8fe5-ab0d48a67220 tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-96fdf9d6-8a68-4d87-aee4-eb3cfea1caf8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:15 devstack sudo[100369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-96fdf9d6-8a68-4d87-aee4-eb3cfea1caf8
Nov 05 19:20:15 devstack sudo[100369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:15 devstack sudo[100369]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f36e568b-75c5-47b1-8fe5-ab0d48a67220 tempest-VolumesGetTest-2098101542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-96fdf9d6-8a68-4d87-aee4-eb3cfea1caf8" returned: 0 in 0.300s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:15 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f36e568b-75c5-47b1-8fe5-ab0d48a67220 tempest-VolumesGetTest-2098101542 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:20:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f36e568b-75c5-47b1-8fe5-ab0d48a67220 tempest-VolumesGetTest-2098101542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:20:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f36e568b-75c5-47b1-8fe5-ab0d48a67220 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (156025f8-469b-41c9-96b7-4f6f78d76e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96fdf9d6-8a68-4d87-aee4-eb3cfea1caf8', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f36e568b-75c5-47b1-8fe5-ab0d48a67220 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (355ff2e0-4c17-40c1-9219-b92d86b7874b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:15 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-f36e568b-75c5-47b1-8fe5-ab0d48a67220 tempest-VolumesGetTest-2098101542 None] Volume volume-96fdf9d6-8a68-4d87-aee4-eb3cfea1caf8 (96fdf9d6-8a68-4d87-aee4-eb3cfea1caf8): created successfully
Nov 05 19:20:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f36e568b-75c5-47b1-8fe5-ab0d48a67220 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (355ff2e0-4c17-40c1-9219-b92d86b7874b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f36e568b-75c5-47b1-8fe5-ab0d48a67220 tempest-VolumesGetTest-2098101542 None] Flow 'volume_create_manager' (93d5e1dc-1b79-4cc7-a10d-0cb7517eaf04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:20:15 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f36e568b-75c5-47b1-8fe5-ab0d48a67220 tempest-VolumesGetTest-2098101542 None] Created volume successfully.
Nov 05 19:20:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-60855a41-edac-41f2-8f51-006a03a615c1 tempest-VolumesGetTest-2098101542 None] Acquiring lock "cinder-96fdf9d6-8a68-4d87-aee4-eb3cfea1caf8-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:20:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-60855a41-edac-41f2-8f51-006a03a615c1 tempest-VolumesGetTest-2098101542 None] Lock "cinder-96fdf9d6-8a68-4d87-aee4-eb3cfea1caf8-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:20:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-60855a41-edac-41f2-8f51-006a03a615c1 tempest-VolumesGetTest-2098101542 None] Acquiring lock "cinder-quobyte-96fdf9d6-8a68-4d87-aee4-eb3cfea1caf8" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:20:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-60855a41-edac-41f2-8f51-006a03a615c1 tempest-VolumesGetTest-2098101542 None] Lock "cinder-quobyte-96fdf9d6-8a68-4d87-aee4-eb3cfea1caf8" acquired by "delete_volume" :: waited 0.016s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:20:16 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[724a49bd-f86b-4127-876f-eb3cb0acc45b]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:20:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-60855a41-edac-41f2-8f51-006a03a615c1 tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-96fdf9d6-8a68-4d87-aee4-eb3cfea1caf8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:16 devstack sudo[100372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-96fdf9d6-8a68-4d87-aee4-eb3cfea1caf8
Nov 05 19:20:16 devstack sudo[100372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:16 devstack sudo[100372]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-60855a41-edac-41f2-8f51-006a03a615c1 tempest-VolumesGetTest-2098101542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-96fdf9d6-8a68-4d87-aee4-eb3cfea1caf8" returned: 0 in 0.422s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-60855a41-edac-41f2-8f51-006a03a615c1 tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-96fdf9d6-8a68-4d87-aee4-eb3cfea1caf8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:16 devstack sudo[100377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-96fdf9d6-8a68-4d87-aee4-eb3cfea1caf8
Nov 05 19:20:16 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:17 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-60855a41-edac-41f2-8f51-006a03a615c1 tempest-VolumesGetTest-2098101542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-96fdf9d6-8a68-4d87-aee4-eb3cfea1caf8" returned: 0 in 0.264s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-60855a41-edac-41f2-8f51-006a03a615c1 tempest-VolumesGetTest-2098101542 None] Lock "cinder-quobyte-96fdf9d6-8a68-4d87-aee4-eb3cfea1caf8" released by "delete_volume" :: held 0.743s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:20:17 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-60855a41-edac-41f2-8f51-006a03a615c1 tempest-VolumesGetTest-2098101542 None] Created reservations ['3c19f0f4-673c-4018-ba7c-b4a6a0b3c15c', '39087936-94a5-4e26-ad7f-e8e70fdcbb59', '499f1d80-e062-46e1-a000-33a519550b5f', '88e94543-2977-47ef-859b-4dbb69203eb1'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:20:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-60855a41-edac-41f2-8f51-006a03a615c1 tempest-VolumesGetTest-2098101542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:20:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-60855a41-edac-41f2-8f51-006a03a615c1 tempest-VolumesGetTest-2098101542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:20:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-60855a41-edac-41f2-8f51-006a03a615c1 tempest-VolumesGetTest-2098101542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:20:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-60855a41-edac-41f2-8f51-006a03a615c1 tempest-VolumesGetTest-2098101542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:20:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-60855a41-edac-41f2-8f51-006a03a615c1 tempest-VolumesGetTest-2098101542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:20:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-60855a41-edac-41f2-8f51-006a03a615c1 tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:17 devstack sudo[100381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:20:17 devstack sudo[100381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:17 devstack sudo[100381]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-60855a41-edac-41f2-8f51-006a03a615c1 tempest-VolumesGetTest-2098101542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.320s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:17 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-60855a41-edac-41f2-8f51-006a03a615c1 tempest-VolumesGetTest-2098101542 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:20:17 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-60855a41-edac-41f2-8f51-006a03a615c1 tempest-VolumesGetTest-2098101542 None] Deleted volume successfully.
Nov 05 19:20:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c202203e-3162-4ea3-bc75-a06c9c9654e7 tempest-VolumesGetTest-2098101542 None] Acquiring lock "cinder-fc4ee0fd-551b-43cc-a61d-40e1794b2a48-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:20:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-60855a41-edac-41f2-8f51-006a03a615c1 tempest-VolumesGetTest-2098101542 None] Lock "cinder-96fdf9d6-8a68-4d87-aee4-eb3cfea1caf8-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:20:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c202203e-3162-4ea3-bc75-a06c9c9654e7 tempest-VolumesGetTest-2098101542 None] Lock "cinder-fc4ee0fd-551b-43cc-a61d-40e1794b2a48-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:20:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c202203e-3162-4ea3-bc75-a06c9c9654e7 tempest-VolumesGetTest-2098101542 None] Acquiring lock "cinder-quobyte-fc4ee0fd-551b-43cc-a61d-40e1794b2a48" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:20:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c202203e-3162-4ea3-bc75-a06c9c9654e7 tempest-VolumesGetTest-2098101542 None] Lock "cinder-quobyte-fc4ee0fd-551b-43cc-a61d-40e1794b2a48" acquired by "delete_volume" :: waited 0.023s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:20:17 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8099ff5b-ca58-40da-902f-f91fd9765639]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:20:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c202203e-3162-4ea3-bc75-a06c9c9654e7 tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fc4ee0fd-551b-43cc-a61d-40e1794b2a48 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:18 devstack sudo[100384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fc4ee0fd-551b-43cc-a61d-40e1794b2a48
Nov 05 19:20:18 devstack sudo[100384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:18 devstack sudo[100384]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c202203e-3162-4ea3-bc75-a06c9c9654e7 tempest-VolumesGetTest-2098101542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fc4ee0fd-551b-43cc-a61d-40e1794b2a48" returned: 0 in 0.417s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c202203e-3162-4ea3-bc75-a06c9c9654e7 tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fc4ee0fd-551b-43cc-a61d-40e1794b2a48 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:18 devstack sudo[100390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fc4ee0fd-551b-43cc-a61d-40e1794b2a48
Nov 05 19:20:18 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:18 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c202203e-3162-4ea3-bc75-a06c9c9654e7 tempest-VolumesGetTest-2098101542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fc4ee0fd-551b-43cc-a61d-40e1794b2a48" returned: 0 in 0.285s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c202203e-3162-4ea3-bc75-a06c9c9654e7 tempest-VolumesGetTest-2098101542 None] Lock "cinder-quobyte-fc4ee0fd-551b-43cc-a61d-40e1794b2a48" released by "delete_volume" :: held 0.794s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:20:18 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-c202203e-3162-4ea3-bc75-a06c9c9654e7 tempest-VolumesGetTest-2098101542 None] Created reservations ['113c58ad-70bd-4e07-a08f-c25a0d1f4f23', '3c9a7ff6-d11f-43c7-8460-7d524056a480', 'fa328b9c-5fa4-4bf8-9eb2-c991137a721d', 'b2abdfa8-1606-4e11-8804-67f0356c1868'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:20:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c202203e-3162-4ea3-bc75-a06c9c9654e7 tempest-VolumesGetTest-2098101542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:20:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c202203e-3162-4ea3-bc75-a06c9c9654e7 tempest-VolumesGetTest-2098101542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:20:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c202203e-3162-4ea3-bc75-a06c9c9654e7 tempest-VolumesGetTest-2098101542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:20:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c202203e-3162-4ea3-bc75-a06c9c9654e7 tempest-VolumesGetTest-2098101542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:20:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c202203e-3162-4ea3-bc75-a06c9c9654e7 tempest-VolumesGetTest-2098101542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:20:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c202203e-3162-4ea3-bc75-a06c9c9654e7 tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:18 devstack sudo[100393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:20:18 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:19 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c202203e-3162-4ea3-bc75-a06c9c9654e7 tempest-VolumesGetTest-2098101542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.353s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:19 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-c202203e-3162-4ea3-bc75-a06c9c9654e7 tempest-VolumesGetTest-2098101542 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:20:19 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-c202203e-3162-4ea3-bc75-a06c9c9654e7 tempest-VolumesGetTest-2098101542 None] Deleted volume successfully.
Nov 05 19:20:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c202203e-3162-4ea3-bc75-a06c9c9654e7 tempest-VolumesGetTest-2098101542 None] Lock "cinder-fc4ee0fd-551b-43cc-a61d-40e1794b2a48-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:20:19 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cf91c3c-ec37-4259-b7fc-9b495e4e9294 tempest-VolumesGetTest-2098101542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:20:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2cf91c3c-ec37-4259-b7fc-9b495e4e9294 tempest-VolumesGetTest-2098101542 None] Flow 'volume_create_manager' (bc30eda0-bc83-48b5-95dd-04be83cee222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:20:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2cf91c3c-ec37-4259-b7fc-9b495e4e9294 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (880e2fea-34a4-47be-bbfb-cc8b8a26d220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2cf91c3c-ec37-4259-b7fc-9b495e4e9294 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (880e2fea-34a4-47be-bbfb-cc8b8a26d220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1444329938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6351b106-0e03-4bea-8666-0495806dc39b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='409f7e915edd48d6a6656bbe4ec42331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:20:20Z,use_quota=True,user_id='bacc0b743e174fb78263f33729f9f26d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2cf91c3c-ec37-4259-b7fc-9b495e4e9294 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d55a54b7-a20d-470e-bbe9-086d7a5a3290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2cf91c3c-ec37-4259-b7fc-9b495e4e9294 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d55a54b7-a20d-470e-bbe9-086d7a5a3290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2cf91c3c-ec37-4259-b7fc-9b495e4e9294 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11c784e6-4d68-4dbb-b592-0f3eb399aa43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2cf91c3c-ec37-4259-b7fc-9b495e4e9294 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11c784e6-4d68-4dbb-b592-0f3eb399aa43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6351b106-0e03-4bea-8666-0495806dc39b', 'volume_name': 'volume-6351b106-0e03-4bea-8666-0495806dc39b', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2cf91c3c-ec37-4259-b7fc-9b495e4e9294 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa2e169c-eecb-4d3d-9a87-0ace06af66fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2cf91c3c-ec37-4259-b7fc-9b495e4e9294 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa2e169c-eecb-4d3d-9a87-0ace06af66fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2cf91c3c-ec37-4259-b7fc-9b495e4e9294 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5228bdd0-7788-4e6d-8c41-3b5ad450b1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:19 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-2cf91c3c-ec37-4259-b7fc-9b495e4e9294 tempest-VolumesGetTest-2098101542 None] Volume 6351b106-0e03-4bea-8666-0495806dc39b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6351b106-0e03-4bea-8666-0495806dc39b', 'volume_size': 1}
Nov 05 19:20:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2cf91c3c-ec37-4259-b7fc-9b495e4e9294 tempest-VolumesGetTest-2098101542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:20:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2cf91c3c-ec37-4259-b7fc-9b495e4e9294 tempest-VolumesGetTest-2098101542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:20:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2cf91c3c-ec37-4259-b7fc-9b495e4e9294 tempest-VolumesGetTest-2098101542 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1444329938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6351b106-0e03-4bea-8666-0495806dc39b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='409f7e915edd48d6a6656bbe4ec42331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:20:20Z,use_quota=True,user_id='bacc0b743e174fb78263f33729f9f26d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:20:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-2cf91c3c-ec37-4259-b7fc-9b495e4e9294 tempest-VolumesGetTest-2098101542 None] Creating volume 6351b106-0e03-4bea-8666-0495806dc39b {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:20:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2cf91c3c-ec37-4259-b7fc-9b495e4e9294 tempest-VolumesGetTest-2098101542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:20:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2cf91c3c-ec37-4259-b7fc-9b495e4e9294 tempest-VolumesGetTest-2098101542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:20:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2cf91c3c-ec37-4259-b7fc-9b495e4e9294 tempest-VolumesGetTest-2098101542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:20:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2cf91c3c-ec37-4259-b7fc-9b495e4e9294 tempest-VolumesGetTest-2098101542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:20:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2cf91c3c-ec37-4259-b7fc-9b495e4e9294 tempest-VolumesGetTest-2098101542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:20:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2cf91c3c-ec37-4259-b7fc-9b495e4e9294 tempest-VolumesGetTest-2098101542 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:20:19 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-2cf91c3c-ec37-4259-b7fc-9b495e4e9294 tempest-VolumesGetTest-2098101542 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:20:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2cf91c3c-ec37-4259-b7fc-9b495e4e9294 tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:19 devstack sudo[100396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b 1073741824
Nov 05 19:20:19 devstack sudo[100396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:20 devstack sudo[100396]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2cf91c3c-ec37-4259-b7fc-9b495e4e9294 tempest-VolumesGetTest-2098101542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b 1073741824" returned: 0 in 0.648s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2cf91c3c-ec37-4259-b7fc-9b495e4e9294 tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:20 devstack sudo[100402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b
Nov 05 19:20:20 devstack sudo[100402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:20 devstack sudo[100402]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2cf91c3c-ec37-4259-b7fc-9b495e4e9294 tempest-VolumesGetTest-2098101542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b" returned: 0 in 0.328s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2cf91c3c-ec37-4259-b7fc-9b495e4e9294 tempest-VolumesGetTest-2098101542 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:20:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2cf91c3c-ec37-4259-b7fc-9b495e4e9294 tempest-VolumesGetTest-2098101542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:20:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2cf91c3c-ec37-4259-b7fc-9b495e4e9294 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5228bdd0-7788-4e6d-8c41-3b5ad450b1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6351b106-0e03-4bea-8666-0495806dc39b', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2cf91c3c-ec37-4259-b7fc-9b495e4e9294 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5408b642-a09d-4e7c-8608-0de87e712ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:20 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-2cf91c3c-ec37-4259-b7fc-9b495e4e9294 tempest-VolumesGetTest-2098101542 None] Volume volume-6351b106-0e03-4bea-8666-0495806dc39b (6351b106-0e03-4bea-8666-0495806dc39b): created successfully
Nov 05 19:20:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2cf91c3c-ec37-4259-b7fc-9b495e4e9294 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5408b642-a09d-4e7c-8608-0de87e712ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2cf91c3c-ec37-4259-b7fc-9b495e4e9294 tempest-VolumesGetTest-2098101542 None] Flow 'volume_create_manager' (bc30eda0-bc83-48b5-95dd-04be83cee222) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:20:20 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-2cf91c3c-ec37-4259-b7fc-9b495e4e9294 tempest-VolumesGetTest-2098101542 None] Created volume successfully.
Nov 05 19:20:22 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:20:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Flow 'volume_create_manager' (59822d1c-348d-44af-b254-677626f7e6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:20:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e7f2689-b8ec-46bf-b084-efbbd84abbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e7f2689-b8ec-46bf-b084-efbbd84abbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1498491565',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3b0f713-6638-4303-8367-eb2f8bdb0baa,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='409f7e915edd48d6a6656bbe4ec42331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=6351b106-0e03-4bea-8666-0495806dc39b,status='creating',terminated_at=None,updated_at=2026-11-05T18:20:22Z,use_quota=True,user_id='bacc0b743e174fb78263f33729f9f26d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92d3bffe-f25e-4e31-827c-bfe661a68b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92d3bffe-f25e-4e31-827c-bfe661a68b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ca23c7-2d6b-4099-8f7f-ed2bc8946305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ca23c7-2d6b-4099-8f7f-ed2bc8946305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b3b0f713-6638-4303-8367-eb2f8bdb0baa', 'volume_name': 'volume-b3b0f713-6638-4303-8367-eb2f8bdb0baa', 'volume_size': 1, 'source_volid': '6351b106-0e03-4bea-8666-0495806dc39b', 'source_volstatus': 'available'}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0a885b4-8272-4219-81ea-4df0d24d95b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0a885b4-8272-4219-81ea-4df0d24d95b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e79091fb-f0ce-477e-8e08-1a55d99b2c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:22 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Volume b3b0f713-6638-4303-8367-eb2f8bdb0baa: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b3b0f713-6638-4303-8367-eb2f8bdb0baa', 'volume_size': 1, 'source_volid': '6351b106-0e03-4bea-8666-0495806dc39b', 'source_volstatus': 'available'}
Nov 05 19:20:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:20:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:20:22 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Cloning volume 6351b106-0e03-4bea-8666-0495806dc39b to volume b3b0f713-6638-4303-8367-eb2f8bdb0baa
Nov 05 19:20:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Creating offline snapshot 567e7896-19e3-46e5-b9c5-bb15f6676738 of volume 6351b106-0e03-4bea-8666-0495806dc39b {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:20:22 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70ff216-47c3-4a1c-8dd2-3caaf772d232]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:20:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:22 devstack sudo[100405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b
Nov 05 19:20:22 devstack sudo[100405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:23 devstack sudo[100405]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b" returned: 0 in 0.442s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b.567e7896-19e3-46e5-b9c5-bb15f6676738 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:23 devstack sudo[100411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b.567e7896-19e3-46e5-b9c5-bb15f6676738 1G
Nov 05 19:20:23 devstack sudo[100411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:23 devstack sudo[100411]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b.567e7896-19e3-46e5-b9c5-bb15f6676738 1G" returned: 0 in 0.516s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6351b106-0e03-4bea-8666-0495806dc39b -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b.567e7896-19e3-46e5-b9c5-bb15f6676738 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:23 devstack sudo[100417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6351b106-0e03-4bea-8666-0495806dc39b -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b.567e7896-19e3-46e5-b9c5-bb15f6676738
Nov 05 19:20:23 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:23 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6351b106-0e03-4bea-8666-0495806dc39b -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b.567e7896-19e3-46e5-b9c5-bb15f6676738" returned: 0 in 0.337s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:23 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b.567e7896-19e3-46e5-b9c5-bb15f6676738 is being set with open permissions: ugo+rw
Nov 05 19:20:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b.567e7896-19e3-46e5-b9c5-bb15f6676738 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:23 devstack sudo[100423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b.567e7896-19e3-46e5-b9c5-bb15f6676738
Nov 05 19:20:23 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:24 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b.567e7896-19e3-46e5-b9c5-bb15f6676738" returned: 0 in 0.293s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:24 devstack sudo[100426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b.info
Nov 05 19:20:24 devstack sudo[100426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:24 devstack sudo[100426]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b.info" returned: 0 in 0.273s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:24 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b.info is being set with open permissions: ugo+rw
Nov 05 19:20:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:24 devstack sudo[100429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b.info
Nov 05 19:20:24 devstack sudo[100429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:24 devstack sudo[100429]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b.info" returned: 0 in 0.290s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Acquiring lock "cinder-quobyte-b3b0f713-6638-4303-8367-eb2f8bdb0baa" by "_copy_volume_from_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:20:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Lock "cinder-quobyte-b3b0f713-6638-4303-8367-eb2f8bdb0baa" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:20:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] snapshot: 567e7896-19e3-46e5-b9c5-bb15f6676738, volume: b3b0f713-6638-4303-8367-eb2f8bdb0baa,  {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 19:20:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:20:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:20:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:20:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:20:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:20:24 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba63fb5c-55a2-4a26-ae97-8f68840058c8]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:20:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b.567e7896-19e3-46e5-b9c5-bb15f6676738 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:25 devstack sudo[100432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b.567e7896-19e3-46e5-b9c5-bb15f6676738
Nov 05 19:20:25 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:25 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b.567e7896-19e3-46e5-b9c5-bb15f6676738" returned: 0 in 0.524s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6351b106-0e03-4bea-8666-0495806dc39b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:20:25 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c821025-2156-4455-b537-413cd125675f]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:20:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:25 devstack sudo[100437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b
Nov 05 19:20:25 devstack sudo[100437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:25 devstack sudo[100437]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b" returned: 0 in 0.398s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 19:20:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Creating direct copy from snapshot {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 19:20:25 devstack cinder-volume[87184]: DEBUG cinder.utils [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Path /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b3b0f713-6638-4303-8367-eb2f8bdb0baa not found in is_blk_device check {{(pid=87184) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 19:20:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b3b0f713-6638-4303-8367-eb2f8bdb0baa {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:25 devstack sudo[100443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b3b0f713-6638-4303-8367-eb2f8bdb0baa
Nov 05 19:20:25 devstack sudo[100443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:34 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:UPDATE=79,cinder:SELECT=49,cinder:INSERT=16,cinder:DELETE=7 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:20:34 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:UPDATE=79,cinder:SELECT=63,cinder:DELETE=6,cinder:INSERT=24 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:20:34 devstack sudo[100443]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b3b0f713-6638-4303-8367-eb2f8bdb0baa" returned: 0 in 8.509s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:34 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Image conversion details: src /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b, size 1024.00 MB, duration 8.51 sec, destination /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b3b0f713-6638-4303-8367-eb2f8bdb0baa {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 19:20:34 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Converted 1024.00 MB image at 120.32 MB/s
Nov 05 19:20:34 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b3b0f713-6638-4303-8367-eb2f8bdb0baa is being set with open permissions: ugo+rw
Nov 05 19:20:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b3b0f713-6638-4303-8367-eb2f8bdb0baa {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:34 devstack sudo[100459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b3b0f713-6638-4303-8367-eb2f8bdb0baa
Nov 05 19:20:34 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:34 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b3b0f713-6638-4303-8367-eb2f8bdb0baa" returned: 0 in 0.289s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Lock "cinder-quobyte-b3b0f713-6638-4303-8367-eb2f8bdb0baa" released by "_copy_volume_from_snapshot" :: held 9.866s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:20:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Acquiring lock "cinder-quobyte-567e7896-19e3-46e5-b9c5-bb15f6676738" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:20:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Lock "cinder-quobyte-567e7896-19e3-46e5-b9c5-bb15f6676738" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:20:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Deleting offline snapshot 567e7896-19e3-46e5-b9c5-bb15f6676738 of volume 6351b106-0e03-4bea-8666-0495806dc39b {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:20:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] snapshot_file for this snap is: volume-6351b106-0e03-4bea-8666-0495806dc39b.567e7896-19e3-46e5-b9c5-bb15f6676738 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:20:34 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4860b7eb-0873-489d-93cd-4c0a70071993]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:20:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b.567e7896-19e3-46e5-b9c5-bb15f6676738 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:34 devstack sudo[100462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b.567e7896-19e3-46e5-b9c5-bb15f6676738
Nov 05 19:20:34 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:35 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b.567e7896-19e3-46e5-b9c5-bb15f6676738" returned: 0 in 0.519s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6351b106-0e03-4bea-8666-0495806dc39b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:20:35 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f27dcb1-0250-40f3-8cc3-ec256f8068b7]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:20:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:35 devstack sudo[100467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b
Nov 05 19:20:35 devstack sudo[100467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:36 devstack sudo[100467]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b" returned: 0 in 0.657s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b.567e7896-19e3-46e5-b9c5-bb15f6676738 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:36 devstack sudo[100474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b.567e7896-19e3-46e5-b9c5-bb15f6676738
Nov 05 19:20:36 devstack sudo[100474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:36 devstack sudo[100474]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b.567e7896-19e3-46e5-b9c5-bb15f6676738" returned: 0 in 0.420s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b.567e7896-19e3-46e5-b9c5-bb15f6676738 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:36 devstack sudo[100480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b.567e7896-19e3-46e5-b9c5-bb15f6676738
Nov 05 19:20:36 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:36 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b6468d9-3b56-4740-811a-f8809063bb1b tempest-TestInstancesWithCinderVolumes-180007272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:20:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1b6468d9-3b56-4740-811a-f8809063bb1b tempest-TestInstancesWithCinderVolumes-180007272 None] Flow 'volume_create_manager' (f952f66a-bc06-467b-9235-ce8b312c1b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:20:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1b6468d9-3b56-4740-811a-f8809063bb1b tempest-TestInstancesWithCinderVolumes-180007272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e5f8ea1-58dc-4b30-b07f-a7ddd4219714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1b6468d9-3b56-4740-811a-f8809063bb1b tempest-TestInstancesWithCinderVolumes-180007272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e5f8ea1-58dc-4b30-b07f-a7ddd4219714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-45013853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45317731-362b-4362-8feb-37e3ea1ca53c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb2b0ab56d614d918117b3851c0b1063',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:20:37Z,use_quota=True,user_id='83998c0907184619941c4c30b8f8cb90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f225398-a0b1-45bd-a7f7-6e0759a0616f),volume_type_id=5f225398-a0b1-45bd-a7f7-6e0759a0616f)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1b6468d9-3b56-4740-811a-f8809063bb1b tempest-TestInstancesWithCinderVolumes-180007272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87578fc6-a75e-47c7-aa7e-08cfe3a0f0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1b6468d9-3b56-4740-811a-f8809063bb1b tempest-TestInstancesWithCinderVolumes-180007272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87578fc6-a75e-47c7-aa7e-08cfe3a0f0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1b6468d9-3b56-4740-811a-f8809063bb1b tempest-TestInstancesWithCinderVolumes-180007272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (662e5460-c9fa-45aa-9964-a386cdd54107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1b6468d9-3b56-4740-811a-f8809063bb1b tempest-TestInstancesWithCinderVolumes-180007272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (662e5460-c9fa-45aa-9964-a386cdd54107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45317731-362b-4362-8feb-37e3ea1ca53c', 'volume_name': 'volume-45317731-362b-4362-8feb-37e3ea1ca53c', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1b6468d9-3b56-4740-811a-f8809063bb1b tempest-TestInstancesWithCinderVolumes-180007272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d671f892-5a74-4e17-954f-c9c4ad0b8553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1b6468d9-3b56-4740-811a-f8809063bb1b tempest-TestInstancesWithCinderVolumes-180007272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d671f892-5a74-4e17-954f-c9c4ad0b8553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:36 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1b6468d9-3b56-4740-811a-f8809063bb1b tempest-TestInstancesWithCinderVolumes-180007272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9915e7c0-affa-42e4-8ded-fc6b9819f1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:36 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-1b6468d9-3b56-4740-811a-f8809063bb1b tempest-TestInstancesWithCinderVolumes-180007272 None] Volume 45317731-362b-4362-8feb-37e3ea1ca53c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45317731-362b-4362-8feb-37e3ea1ca53c', 'volume_size': 1}
Nov 05 19:20:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1b6468d9-3b56-4740-811a-f8809063bb1b tempest-TestInstancesWithCinderVolumes-180007272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:20:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b.567e7896-19e3-46e5-b9c5-bb15f6676738" returned: 0 in 0.367s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Lock "cinder-quobyte-567e7896-19e3-46e5-b9c5-bb15f6676738" released by "_delete_snapshot" :: held 2.104s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:20:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.356s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:20:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1b6468d9-3b56-4740-811a-f8809063bb1b tempest-TestInstancesWithCinderVolumes-180007272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.111s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:20:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1b6468d9-3b56-4740-811a-f8809063bb1b tempest-TestInstancesWithCinderVolumes-180007272 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-45013853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45317731-362b-4362-8feb-37e3ea1ca53c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb2b0ab56d614d918117b3851c0b1063',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:20:37Z,use_quota=True,user_id='83998c0907184619941c4c30b8f8cb90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f225398-a0b1-45bd-a7f7-6e0759a0616f),volume_type_id=5f225398-a0b1-45bd-a7f7-6e0759a0616f)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:20:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-1b6468d9-3b56-4740-811a-f8809063bb1b tempest-TestInstancesWithCinderVolumes-180007272 None] Creating volume 45317731-362b-4362-8feb-37e3ea1ca53c {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:20:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1b6468d9-3b56-4740-811a-f8809063bb1b tempest-TestInstancesWithCinderVolumes-180007272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:20:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1b6468d9-3b56-4740-811a-f8809063bb1b tempest-TestInstancesWithCinderVolumes-180007272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:20:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1b6468d9-3b56-4740-811a-f8809063bb1b tempest-TestInstancesWithCinderVolumes-180007272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:20:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1b6468d9-3b56-4740-811a-f8809063bb1b tempest-TestInstancesWithCinderVolumes-180007272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:20:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1b6468d9-3b56-4740-811a-f8809063bb1b tempest-TestInstancesWithCinderVolumes-180007272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:20:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1b6468d9-3b56-4740-811a-f8809063bb1b tempest-TestInstancesWithCinderVolumes-180007272 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:20:36 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-1b6468d9-3b56-4740-811a-f8809063bb1b tempest-TestInstancesWithCinderVolumes-180007272 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:20:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1b6468d9-3b56-4740-811a-f8809063bb1b tempest-TestInstancesWithCinderVolumes-180007272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-45317731-362b-4362-8feb-37e3ea1ca53c 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e79091fb-f0ce-477e-8e08-1a55d99b2c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3b0f713-6638-4303-8367-eb2f8bdb0baa', 'volume_size': 1, 'source_volid': '6351b106-0e03-4bea-8666-0495806dc39b', 'source_volstatus': 'available'}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:36 devstack sudo[100483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-45317731-362b-4362-8feb-37e3ea1ca53c 1073741824
Nov 05 19:20:36 devstack sudo[100483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27df36a4-dac7-4af1-8ee2-c3f3f6f787ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:36 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Volume volume-b3b0f713-6638-4303-8367-eb2f8bdb0baa (b3b0f713-6638-4303-8367-eb2f8bdb0baa): created successfully
Nov 05 19:20:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27df36a4-dac7-4af1-8ee2-c3f3f6f787ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Flow 'volume_create_manager' (59822d1c-348d-44af-b254-677626f7e6cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:20:37 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-6c654cd8-6129-40bd-a314-b919958e30ad tempest-VolumesGetTest-2098101542 None] Created volume successfully.
Nov 05 19:20:37 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc5fc87d-9cdb-48a5-8a3c-7d8996090008 tempest-TestInstancesWithCinderVolumes-180007272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:20:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bc5fc87d-9cdb-48a5-8a3c-7d8996090008 tempest-TestInstancesWithCinderVolumes-180007272 None] Flow 'volume_create_manager' (727032a0-1fde-4670-aeb0-7f32c3b93e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:20:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bc5fc87d-9cdb-48a5-8a3c-7d8996090008 tempest-TestInstancesWithCinderVolumes-180007272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3531e523-3f2c-44a2-b52c-a9cc03933634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bc5fc87d-9cdb-48a5-8a3c-7d8996090008 tempest-TestInstancesWithCinderVolumes-180007272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3531e523-3f2c-44a2-b52c-a9cc03933634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1814370727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0a21a9a-2804-4b20-98a1-fe03c6d22a98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb2b0ab56d614d918117b3851c0b1063',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:20:37Z,use_quota=True,user_id='83998c0907184619941c4c30b8f8cb90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73abfd71-746f-4c41-94f3-317b06385f70),volume_type_id=73abfd71-746f-4c41-94f3-317b06385f70)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bc5fc87d-9cdb-48a5-8a3c-7d8996090008 tempest-TestInstancesWithCinderVolumes-180007272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ab16646-e9f6-4c95-8019-3c2f87daf967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bc5fc87d-9cdb-48a5-8a3c-7d8996090008 tempest-TestInstancesWithCinderVolumes-180007272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ab16646-e9f6-4c95-8019-3c2f87daf967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bc5fc87d-9cdb-48a5-8a3c-7d8996090008 tempest-TestInstancesWithCinderVolumes-180007272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e1f20c6-57e4-4f29-b8b0-4ebff71abf06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bc5fc87d-9cdb-48a5-8a3c-7d8996090008 tempest-TestInstancesWithCinderVolumes-180007272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e1f20c6-57e4-4f29-b8b0-4ebff71abf06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0a21a9a-2804-4b20-98a1-fe03c6d22a98', 'volume_name': 'volume-b0a21a9a-2804-4b20-98a1-fe03c6d22a98', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bc5fc87d-9cdb-48a5-8a3c-7d8996090008 tempest-TestInstancesWithCinderVolumes-180007272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa7491f3-47c9-4343-9fd5-b6433f290a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bc5fc87d-9cdb-48a5-8a3c-7d8996090008 tempest-TestInstancesWithCinderVolumes-180007272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa7491f3-47c9-4343-9fd5-b6433f290a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bc5fc87d-9cdb-48a5-8a3c-7d8996090008 tempest-TestInstancesWithCinderVolumes-180007272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0c16eb9-95e5-4293-b1d2-dea4f5ae06b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:37 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-bc5fc87d-9cdb-48a5-8a3c-7d8996090008 tempest-TestInstancesWithCinderVolumes-180007272 None] Volume b0a21a9a-2804-4b20-98a1-fe03c6d22a98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0a21a9a-2804-4b20-98a1-fe03c6d22a98', 'volume_size': 1}
Nov 05 19:20:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bc5fc87d-9cdb-48a5-8a3c-7d8996090008 tempest-TestInstancesWithCinderVolumes-180007272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:20:37 devstack sudo[100483]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1b6468d9-3b56-4740-811a-f8809063bb1b tempest-TestInstancesWithCinderVolumes-180007272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-45317731-362b-4362-8feb-37e3ea1ca53c 1073741824" returned: 0 in 0.686s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1b6468d9-3b56-4740-811a-f8809063bb1b tempest-TestInstancesWithCinderVolumes-180007272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-45317731-362b-4362-8feb-37e3ea1ca53c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:37 devstack sudo[100490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-45317731-362b-4362-8feb-37e3ea1ca53c
Nov 05 19:20:37 devstack sudo[100490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:37 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:20:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Flow 'volume_create_manager' (1bca2f01-7f8b-4810-bdcf-7ab430d3dc1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:20:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46464ff4-b2be-4cc2-95e4-b59e68244e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46464ff4-b2be-4cc2-95e4-b59e68244e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2098761544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7eaa07e-8892-494e-aa1c-9abc8bd39dee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb2b0ab56d614d918117b3851c0b1063',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:20:38Z,use_quota=True,user_id='83998c0907184619941c4c30b8f8cb90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f77dec79-d42e-40db-a2ef-db0a759e1361),volume_type_id=f77dec79-d42e-40db-a2ef-db0a759e1361)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb7b7079-fe66-4e5d-82f7-d17a32c1a94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb7b7079-fe66-4e5d-82f7-d17a32c1a94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e6969d1-8214-4be2-b0e4-af4962b3ca53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:37 devstack cinder-volume[87184]: DEBUG cinder.image.glance [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Creating Keystone auth plugin from conf {{(pid=87184) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 19:20:38 devstack sudo[100490]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1b6468d9-3b56-4740-811a-f8809063bb1b tempest-TestInstancesWithCinderVolumes-180007272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-45317731-362b-4362-8feb-37e3ea1ca53c" returned: 0 in 0.443s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1b6468d9-3b56-4740-811a-f8809063bb1b tempest-TestInstancesWithCinderVolumes-180007272 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:20:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1b6468d9-3b56-4740-811a-f8809063bb1b tempest-TestInstancesWithCinderVolumes-180007272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:20:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bc5fc87d-9cdb-48a5-8a3c-7d8996090008 tempest-TestInstancesWithCinderVolumes-180007272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.926s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:20:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bc5fc87d-9cdb-48a5-8a3c-7d8996090008 tempest-TestInstancesWithCinderVolumes-180007272 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1814370727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0a21a9a-2804-4b20-98a1-fe03c6d22a98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb2b0ab56d614d918117b3851c0b1063',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:20:37Z,use_quota=True,user_id='83998c0907184619941c4c30b8f8cb90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73abfd71-746f-4c41-94f3-317b06385f70),volume_type_id=73abfd71-746f-4c41-94f3-317b06385f70)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:20:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-bc5fc87d-9cdb-48a5-8a3c-7d8996090008 tempest-TestInstancesWithCinderVolumes-180007272 None] Creating volume b0a21a9a-2804-4b20-98a1-fe03c6d22a98 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:20:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bc5fc87d-9cdb-48a5-8a3c-7d8996090008 tempest-TestInstancesWithCinderVolumes-180007272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:20:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bc5fc87d-9cdb-48a5-8a3c-7d8996090008 tempest-TestInstancesWithCinderVolumes-180007272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:20:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bc5fc87d-9cdb-48a5-8a3c-7d8996090008 tempest-TestInstancesWithCinderVolumes-180007272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:20:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bc5fc87d-9cdb-48a5-8a3c-7d8996090008 tempest-TestInstancesWithCinderVolumes-180007272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:20:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bc5fc87d-9cdb-48a5-8a3c-7d8996090008 tempest-TestInstancesWithCinderVolumes-180007272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:20:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bc5fc87d-9cdb-48a5-8a3c-7d8996090008 tempest-TestInstancesWithCinderVolumes-180007272 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:20:38 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-bc5fc87d-9cdb-48a5-8a3c-7d8996090008 tempest-TestInstancesWithCinderVolumes-180007272 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:20:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bc5fc87d-9cdb-48a5-8a3c-7d8996090008 tempest-TestInstancesWithCinderVolumes-180007272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b0a21a9a-2804-4b20-98a1-fe03c6d22a98 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1b6468d9-3b56-4740-811a-f8809063bb1b tempest-TestInstancesWithCinderVolumes-180007272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9915e7c0-affa-42e4-8ded-fc6b9819f1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45317731-362b-4362-8feb-37e3ea1ca53c', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:38 devstack sudo[100493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b0a21a9a-2804-4b20-98a1-fe03c6d22a98 1073741824
Nov 05 19:20:38 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1b6468d9-3b56-4740-811a-f8809063bb1b tempest-TestInstancesWithCinderVolumes-180007272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0798e408-ba3c-48a5-a46f-1f914e5d7bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:38 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-1b6468d9-3b56-4740-811a-f8809063bb1b tempest-TestInstancesWithCinderVolumes-180007272 None] Volume volume-45317731-362b-4362-8feb-37e3ea1ca53c (45317731-362b-4362-8feb-37e3ea1ca53c): created successfully
Nov 05 19:20:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1b6468d9-3b56-4740-811a-f8809063bb1b tempest-TestInstancesWithCinderVolumes-180007272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0798e408-ba3c-48a5-a46f-1f914e5d7bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1b6468d9-3b56-4740-811a-f8809063bb1b tempest-TestInstancesWithCinderVolumes-180007272 None] Flow 'volume_create_manager' (f952f66a-bc06-467b-9235-ce8b312c1b93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:20:38 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-1b6468d9-3b56-4740-811a-f8809063bb1b tempest-TestInstancesWithCinderVolumes-180007272 None] Created volume successfully.
Nov 05 19:20:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e6969d1-8214-4be2-b0e4-af4962b3ca53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a7eaa07e-8892-494e-aa1c-9abc8bd39dee', 'volume_name': 'volume-a7eaa07e-8892-494e-aa1c-9abc8bd39dee', 'volume_size': 1, 'image_id': '0b2cbd62-311b-4fd8-aa06-186937391b0e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0b2cbd62-311b-4fd8-aa06-186937391b0e', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1905603935', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb2b0ab56d614d918117b3851c0b1063', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0b2cbd62-311b-4fd8-aa06-186937391b0e', 'created_at': datetime.datetime(2026, 11, 5, 18, 20, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 18, 20, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0b2cbd62-311b-4fd8-aa06-186937391b0e/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x736627a0a030>}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4437befc-88bc-4e80-a1ce-195531e5c7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4437befc-88bc-4e80-a1ce-195531e5c7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62bfd25e-5472-4d07-a52c-0860ae3e1b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:38 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Volume a7eaa07e-8892-494e-aa1c-9abc8bd39dee: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a7eaa07e-8892-494e-aa1c-9abc8bd39dee', 'volume_size': 1, 'image_id': '0b2cbd62-311b-4fd8-aa06-186937391b0e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0b2cbd62-311b-4fd8-aa06-186937391b0e', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1905603935', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb2b0ab56d614d918117b3851c0b1063', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0b2cbd62-311b-4fd8-aa06-186937391b0e', 'created_at': datetime.datetime(2026, 11, 5, 18, 20, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 18, 20, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0b2cbd62-311b-4fd8-aa06-186937391b0e/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x736627a0a030>}
Nov 05 19:20:38 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Trying to clone a7eaa07e-8892-494e-aa1c-9abc8bd39dee from image 0b2cbd62-311b-4fd8-aa06-186937391b0e at location (None, [{'url': 'file:///opt/stack/data/glance/images/0b2cbd62-311b-4fd8-aa06-186937391b0e', 'metadata': {}}]). {{(pid=87184) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 19:20:38 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bc5fc87d-9cdb-48a5-8a3c-7d8996090008 tempest-TestInstancesWithCinderVolumes-180007272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b0a21a9a-2804-4b20-98a1-fe03c6d22a98 1073741824" returned: 0 in 0.695s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bc5fc87d-9cdb-48a5-8a3c-7d8996090008 tempest-TestInstancesWithCinderVolumes-180007272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b0a21a9a-2804-4b20-98a1-fe03c6d22a98 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:38 devstack sudo[100505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b0a21a9a-2804-4b20-98a1-fe03c6d22a98
Nov 05 19:20:38 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:39 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-89a6a5aa-777a-4969-9c54-733a0936bd9c tempest-VolumesGetTest-2098101542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:20:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-89a6a5aa-777a-4969-9c54-733a0936bd9c tempest-VolumesGetTest-2098101542 None] Flow 'volume_create_manager' (cd43a011-42b9-4357-8a4f-609197ea30d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:20:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-89a6a5aa-777a-4969-9c54-733a0936bd9c tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ba03676-be37-433f-bc3d-abb08a1f118b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-89a6a5aa-777a-4969-9c54-733a0936bd9c tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ba03676-be37-433f-bc3d-abb08a1f118b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:20:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-691663196',display_name='tempest-VolumesGetTest-Volume-152738032',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=145d8069-de99-4bd3-a654-3556f7afd25d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='409f7e915edd48d6a6656bbe4ec42331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:20:39Z,use_quota=True,user_id='bacc0b743e174fb78263f33729f9f26d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-89a6a5aa-777a-4969-9c54-733a0936bd9c tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c53e0f93-aab3-4e71-9049-19c9185a738a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-89a6a5aa-777a-4969-9c54-733a0936bd9c tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c53e0f93-aab3-4e71-9049-19c9185a738a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-89a6a5aa-777a-4969-9c54-733a0936bd9c tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e18f14c-7aa1-4b64-ab2e-50f773bd6702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-89a6a5aa-777a-4969-9c54-733a0936bd9c tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e18f14c-7aa1-4b64-ab2e-50f773bd6702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '145d8069-de99-4bd3-a654-3556f7afd25d', 'volume_name': 'volume-145d8069-de99-4bd3-a654-3556f7afd25d', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:39 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-89a6a5aa-777a-4969-9c54-733a0936bd9c tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e3804f-1f60-4dd7-8b0f-ac346450ae58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-89a6a5aa-777a-4969-9c54-733a0936bd9c tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e3804f-1f60-4dd7-8b0f-ac346450ae58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-89a6a5aa-777a-4969-9c54-733a0936bd9c tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beef6a52-827a-4425-a4e0-5f1d3d693e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:39 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-89a6a5aa-777a-4969-9c54-733a0936bd9c tempest-VolumesGetTest-2098101542 None] Volume 145d8069-de99-4bd3-a654-3556f7afd25d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-145d8069-de99-4bd3-a654-3556f7afd25d', 'volume_size': 1}
Nov 05 19:20:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-89a6a5aa-777a-4969-9c54-733a0936bd9c tempest-VolumesGetTest-2098101542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:20:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bc5fc87d-9cdb-48a5-8a3c-7d8996090008 tempest-TestInstancesWithCinderVolumes-180007272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b0a21a9a-2804-4b20-98a1-fe03c6d22a98" returned: 0 in 0.426s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bc5fc87d-9cdb-48a5-8a3c-7d8996090008 tempest-TestInstancesWithCinderVolumes-180007272 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:20:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bc5fc87d-9cdb-48a5-8a3c-7d8996090008 tempest-TestInstancesWithCinderVolumes-180007272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:20:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-89a6a5aa-777a-4969-9c54-733a0936bd9c tempest-VolumesGetTest-2098101542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:20:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-89a6a5aa-777a-4969-9c54-733a0936bd9c tempest-VolumesGetTest-2098101542 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:20:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-691663196',display_name='tempest-VolumesGetTest-Volume-152738032',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=145d8069-de99-4bd3-a654-3556f7afd25d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='409f7e915edd48d6a6656bbe4ec42331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:20:39Z,use_quota=True,user_id='bacc0b743e174fb78263f33729f9f26d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:20:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-89a6a5aa-777a-4969-9c54-733a0936bd9c tempest-VolumesGetTest-2098101542 None] Creating volume 145d8069-de99-4bd3-a654-3556f7afd25d {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:20:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-89a6a5aa-777a-4969-9c54-733a0936bd9c tempest-VolumesGetTest-2098101542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:20:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-89a6a5aa-777a-4969-9c54-733a0936bd9c tempest-VolumesGetTest-2098101542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:20:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-89a6a5aa-777a-4969-9c54-733a0936bd9c tempest-VolumesGetTest-2098101542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:20:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-89a6a5aa-777a-4969-9c54-733a0936bd9c tempest-VolumesGetTest-2098101542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:20:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-89a6a5aa-777a-4969-9c54-733a0936bd9c tempest-VolumesGetTest-2098101542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:20:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-89a6a5aa-777a-4969-9c54-733a0936bd9c tempest-VolumesGetTest-2098101542 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:20:39 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-89a6a5aa-777a-4969-9c54-733a0936bd9c tempest-VolumesGetTest-2098101542 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:20:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-89a6a5aa-777a-4969-9c54-733a0936bd9c tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-145d8069-de99-4bd3-a654-3556f7afd25d 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bc5fc87d-9cdb-48a5-8a3c-7d8996090008 tempest-TestInstancesWithCinderVolumes-180007272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0c16eb9-95e5-4293-b1d2-dea4f5ae06b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0a21a9a-2804-4b20-98a1-fe03c6d22a98', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:39 devstack sudo[100508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-145d8069-de99-4bd3-a654-3556f7afd25d 1073741824
Nov 05 19:20:39 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bc5fc87d-9cdb-48a5-8a3c-7d8996090008 tempest-TestInstancesWithCinderVolumes-180007272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ca100f-6a24-47b5-9174-6516fdd92bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:39 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-bc5fc87d-9cdb-48a5-8a3c-7d8996090008 tempest-TestInstancesWithCinderVolumes-180007272 None] Volume volume-b0a21a9a-2804-4b20-98a1-fe03c6d22a98 (b0a21a9a-2804-4b20-98a1-fe03c6d22a98): created successfully
Nov 05 19:20:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bc5fc87d-9cdb-48a5-8a3c-7d8996090008 tempest-TestInstancesWithCinderVolumes-180007272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ca100f-6a24-47b5-9174-6516fdd92bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bc5fc87d-9cdb-48a5-8a3c-7d8996090008 tempest-TestInstancesWithCinderVolumes-180007272 None] Flow 'volume_create_manager' (727032a0-1fde-4670-aeb0-7f32c3b93e45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:20:39 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-bc5fc87d-9cdb-48a5-8a3c-7d8996090008 tempest-TestInstancesWithCinderVolumes-180007272 None] Created volume successfully.
Nov 05 19:20:39 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-89a6a5aa-777a-4969-9c54-733a0936bd9c tempest-VolumesGetTest-2098101542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-145d8069-de99-4bd3-a654-3556f7afd25d 1073741824" returned: 0 in 0.637s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-89a6a5aa-777a-4969-9c54-733a0936bd9c tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-145d8069-de99-4bd3-a654-3556f7afd25d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:40 devstack sudo[100514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-145d8069-de99-4bd3-a654-3556f7afd25d
Nov 05 19:20:40 devstack sudo[100514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:40 devstack sudo[100514]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-89a6a5aa-777a-4969-9c54-733a0936bd9c tempest-VolumesGetTest-2098101542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-145d8069-de99-4bd3-a654-3556f7afd25d" returned: 0 in 0.327s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-89a6a5aa-777a-4969-9c54-733a0936bd9c tempest-VolumesGetTest-2098101542 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:20:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-89a6a5aa-777a-4969-9c54-733a0936bd9c tempest-VolumesGetTest-2098101542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:20:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-89a6a5aa-777a-4969-9c54-733a0936bd9c tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beef6a52-827a-4425-a4e0-5f1d3d693e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-145d8069-de99-4bd3-a654-3556f7afd25d', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-89a6a5aa-777a-4969-9c54-733a0936bd9c tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c6b90a1-0682-4796-b7a2-0e5cf74a60d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:40 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-89a6a5aa-777a-4969-9c54-733a0936bd9c tempest-VolumesGetTest-2098101542 None] Volume volume-145d8069-de99-4bd3-a654-3556f7afd25d (145d8069-de99-4bd3-a654-3556f7afd25d): created successfully
Nov 05 19:20:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-89a6a5aa-777a-4969-9c54-733a0936bd9c tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c6b90a1-0682-4796-b7a2-0e5cf74a60d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-89a6a5aa-777a-4969-9c54-733a0936bd9c tempest-VolumesGetTest-2098101542 None] Flow 'volume_create_manager' (cd43a011-42b9-4357-8a4f-609197ea30d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:20:40 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-89a6a5aa-777a-4969-9c54-733a0936bd9c tempest-VolumesGetTest-2098101542 None] Created volume successfully.
Nov 05 19:20:41 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f816e091-857a-406f-b56d-5bbd32a743b4 tempest-VolumesGetTest-2098101542 None] Acquiring lock "cinder-145d8069-de99-4bd3-a654-3556f7afd25d-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:20:41 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f816e091-857a-406f-b56d-5bbd32a743b4 tempest-VolumesGetTest-2098101542 None] Lock "cinder-145d8069-de99-4bd3-a654-3556f7afd25d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:20:41 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f816e091-857a-406f-b56d-5bbd32a743b4 tempest-VolumesGetTest-2098101542 None] Acquiring lock "cinder-quobyte-145d8069-de99-4bd3-a654-3556f7afd25d" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:20:41 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f816e091-857a-406f-b56d-5bbd32a743b4 tempest-VolumesGetTest-2098101542 None] Lock "cinder-quobyte-145d8069-de99-4bd3-a654-3556f7afd25d" acquired by "delete_volume" :: waited 0.016s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:20:41 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abeb7ae-fc4c-4338-866e-f6e38513b8ff]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:20:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f816e091-857a-406f-b56d-5bbd32a743b4 tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-145d8069-de99-4bd3-a654-3556f7afd25d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:41 devstack sudo[100517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-145d8069-de99-4bd3-a654-3556f7afd25d
Nov 05 19:20:41 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:41 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f816e091-857a-406f-b56d-5bbd32a743b4 tempest-VolumesGetTest-2098101542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-145d8069-de99-4bd3-a654-3556f7afd25d" returned: 0 in 0.426s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f816e091-857a-406f-b56d-5bbd32a743b4 tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-145d8069-de99-4bd3-a654-3556f7afd25d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:42 devstack sudo[100522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-145d8069-de99-4bd3-a654-3556f7afd25d
Nov 05 19:20:42 devstack sudo[100522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:42 devstack sudo[100522]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f816e091-857a-406f-b56d-5bbd32a743b4 tempest-VolumesGetTest-2098101542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-145d8069-de99-4bd3-a654-3556f7afd25d" returned: 0 in 0.280s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:42 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f816e091-857a-406f-b56d-5bbd32a743b4 tempest-VolumesGetTest-2098101542 None] Lock "cinder-quobyte-145d8069-de99-4bd3-a654-3556f7afd25d" released by "delete_volume" :: held 0.761s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:20:42 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-f816e091-857a-406f-b56d-5bbd32a743b4 tempest-VolumesGetTest-2098101542 None] Created reservations ['ef92f80f-7d47-4634-9df6-fe4ee88da2f7', 'a94d9266-0cc1-4aca-8230-76ef30ff98d3', 'c54833ff-04d9-47d5-8a8e-520898e756c5', '7a9bd61f-f5f4-491e-8643-9cea88bd722e'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:20:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f816e091-857a-406f-b56d-5bbd32a743b4 tempest-VolumesGetTest-2098101542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:20:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f816e091-857a-406f-b56d-5bbd32a743b4 tempest-VolumesGetTest-2098101542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:20:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f816e091-857a-406f-b56d-5bbd32a743b4 tempest-VolumesGetTest-2098101542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:20:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f816e091-857a-406f-b56d-5bbd32a743b4 tempest-VolumesGetTest-2098101542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:20:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f816e091-857a-406f-b56d-5bbd32a743b4 tempest-VolumesGetTest-2098101542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:20:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f816e091-857a-406f-b56d-5bbd32a743b4 tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:42 devstack sudo[100525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:20:42 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:42 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5583a603-28e4-4b94-9097-b42c31e4050f tempest-VolumesGetTest-2098101542 None] Acquiring lock "cinder-b3b0f713-6638-4303-8367-eb2f8bdb0baa-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:20:42 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5583a603-28e4-4b94-9097-b42c31e4050f tempest-VolumesGetTest-2098101542 None] Lock "cinder-b3b0f713-6638-4303-8367-eb2f8bdb0baa-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:20:42 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f816e091-857a-406f-b56d-5bbd32a743b4 tempest-VolumesGetTest-2098101542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.344s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:42 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-f816e091-857a-406f-b56d-5bbd32a743b4 tempest-VolumesGetTest-2098101542 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:20:42 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f816e091-857a-406f-b56d-5bbd32a743b4 tempest-VolumesGetTest-2098101542 None] Deleted volume successfully.
Nov 05 19:20:42 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5583a603-28e4-4b94-9097-b42c31e4050f tempest-VolumesGetTest-2098101542 None] Acquiring lock "cinder-quobyte-b3b0f713-6638-4303-8367-eb2f8bdb0baa" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:20:42 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f816e091-857a-406f-b56d-5bbd32a743b4 tempest-VolumesGetTest-2098101542 None] Lock "cinder-145d8069-de99-4bd3-a654-3556f7afd25d-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:20:42 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5583a603-28e4-4b94-9097-b42c31e4050f tempest-VolumesGetTest-2098101542 None] Lock "cinder-quobyte-b3b0f713-6638-4303-8367-eb2f8bdb0baa" acquired by "delete_volume" :: waited 0.025s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:20:42 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03573e0-6cbb-4f7b-8209-a3dc5bb87716]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:20:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5583a603-28e4-4b94-9097-b42c31e4050f tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b3b0f713-6638-4303-8367-eb2f8bdb0baa {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:43 devstack sudo[100528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b3b0f713-6638-4303-8367-eb2f8bdb0baa
Nov 05 19:20:43 devstack sudo[100528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:43 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:20:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Flow 'volume_create_manager' (07f9becf-81e3-4c41-8ecc-dd103b5c895e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:20:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6306cea4-31c8-42a4-9985-2bdd029a1825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6306cea4-31c8-42a4-9985-2bdd029a1825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-848861896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f353428-8629-4c58-8d0a-58c0ea9574ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6e84b6e86f54da98a4c2531fb105c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:20:43Z,use_quota=True,user_id='38dc29a34f174cef9fc8c89fd83809b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b662a1-846d-4c9c-9460-3993d1e342a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b662a1-846d-4c9c-9460-3993d1e342a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26c86e51-5be3-4814-8a34-bf9fe750d814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:43 devstack cinder-volume[87184]: DEBUG cinder.image.glance [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Creating Keystone auth plugin from conf {{(pid=87184) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 19:20:43 devstack sudo[100528]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5583a603-28e4-4b94-9097-b42c31e4050f tempest-VolumesGetTest-2098101542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b3b0f713-6638-4303-8367-eb2f8bdb0baa" returned: 0 in 0.397s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5583a603-28e4-4b94-9097-b42c31e4050f tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b3b0f713-6638-4303-8367-eb2f8bdb0baa {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:43 devstack sudo[100533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b3b0f713-6638-4303-8367-eb2f8bdb0baa
Nov 05 19:20:43 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:43 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0b2cbd62-311b-4fd8-aa06-186937391b0e_j2nqoo2sdevstack@QuobyteHD, size 20.69 MB, duration 5.00 sec {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 19:20:43 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Image download 20.69 MB at 4.14 MB/s
Nov 05 19:20:43 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[014b9f09-b5c3-4186-8866-bd2fcb0731ff]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:20:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0b2cbd62-311b-4fd8-aa06-186937391b0e_j2nqoo2sdevstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:43 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5583a603-28e4-4b94-9097-b42c31e4050f tempest-VolumesGetTest-2098101542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b3b0f713-6638-4303-8367-eb2f8bdb0baa" returned: 0 in 0.301s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26c86e51-5be3-4814-8a34-bf9fe750d814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5f353428-8629-4c58-8d0a-58c0ea9574ef', 'volume_name': 'volume-5f353428-8629-4c58-8d0a-58c0ea9574ef', 'volume_size': 1, 'image_id': '300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3e813114ebb84b35a5c6eb1b802f157f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'created_at': datetime.datetime(2026, 11, 5, 18, 1, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 18, 1, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x736627af2990>}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ef88657-06e4-4a8d-8256-2fc995decf75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ef88657-06e4-4a8d-8256-2fc995decf75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e420dbd-90a0-436a-a680-e1318b4bd90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:43 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Volume 5f353428-8629-4c58-8d0a-58c0ea9574ef: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5f353428-8629-4c58-8d0a-58c0ea9574ef', 'volume_size': 1, 'image_id': '300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3e813114ebb84b35a5c6eb1b802f157f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'created_at': datetime.datetime(2026, 11, 5, 18, 1, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 18, 1, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x736627af2990>}
Nov 05 19:20:43 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Trying to clone 5f353428-8629-4c58-8d0a-58c0ea9574ef from image 300700a0-51ab-4ee2-8ef0-e0eeaa8aee29 at location (None, [{'url': 'file:///opt/stack/data/glance/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'metadata': {}}]). {{(pid=87184) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 19:20:43 devstack sudo[100535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0b2cbd62-311b-4fd8-aa06-186937391b0e_j2nqoo2sdevstack@QuobyteHD
Nov 05 19:20:43 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5583a603-28e4-4b94-9097-b42c31e4050f tempest-VolumesGetTest-2098101542 None] Lock "cinder-quobyte-b3b0f713-6638-4303-8367-eb2f8bdb0baa" released by "delete_volume" :: held 0.773s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:20:43 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-5583a603-28e4-4b94-9097-b42c31e4050f tempest-VolumesGetTest-2098101542 None] Created reservations ['6f887102-ca0d-410d-805e-a56786fe4589', 'efa911ad-25da-486d-86d5-614230b567e8', '5023b387-d0a6-45a6-a58d-754e5d3d97c3', '4181e9d1-827a-40d2-a4eb-3120806e41cf'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:20:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5583a603-28e4-4b94-9097-b42c31e4050f tempest-VolumesGetTest-2098101542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:20:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5583a603-28e4-4b94-9097-b42c31e4050f tempest-VolumesGetTest-2098101542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:20:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5583a603-28e4-4b94-9097-b42c31e4050f tempest-VolumesGetTest-2098101542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:20:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5583a603-28e4-4b94-9097-b42c31e4050f tempest-VolumesGetTest-2098101542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:20:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5583a603-28e4-4b94-9097-b42c31e4050f tempest-VolumesGetTest-2098101542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:20:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5583a603-28e4-4b94-9097-b42c31e4050f tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:43 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0b2cbd62-311b-4fd8-aa06-186937391b0e_j2nqoo2sdevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:43 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Temporary image 0b2cbd62-311b-4fd8-aa06-186937391b0e is fetched for user 83998c0907184619941c4c30b8f8cb90. {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 19:20:43 devstack sudo[100541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:20:43 devstack sudo[100541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:44 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_hl0rlnkpdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 19:20:44 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 19:20:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ac25c5b0-b40a-485b-b4f6-4fb43834f579 tempest-VolumesGetTest-2098101542 None] Acquiring lock "cinder-6351b106-0e03-4bea-8666-0495806dc39b-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:20:44 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c055a91-5eda-4d48-9f52-958957aa06f8]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:20:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0b2cbd62-311b-4fd8-aa06-186937391b0e_j2nqoo2sdevstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ac25c5b0-b40a-485b-b4f6-4fb43834f579 tempest-VolumesGetTest-2098101542 None] Lock "cinder-6351b106-0e03-4bea-8666-0495806dc39b-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:20:44 devstack sudo[100541]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:44 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a07b12-28d7-497d-80c2-1e74f3af1cca]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:20:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_hl0rlnkpdevstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5583a603-28e4-4b94-9097-b42c31e4050f tempest-VolumesGetTest-2098101542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.321s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:44 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-5583a603-28e4-4b94-9097-b42c31e4050f tempest-VolumesGetTest-2098101542 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:20:44 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-5583a603-28e4-4b94-9097-b42c31e4050f tempest-VolumesGetTest-2098101542 None] Deleted volume successfully.
Nov 05 19:20:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ac25c5b0-b40a-485b-b4f6-4fb43834f579 tempest-VolumesGetTest-2098101542 None] Acquiring lock "cinder-quobyte-6351b106-0e03-4bea-8666-0495806dc39b" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:20:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ac25c5b0-b40a-485b-b4f6-4fb43834f579 tempest-VolumesGetTest-2098101542 None] Lock "cinder-quobyte-6351b106-0e03-4bea-8666-0495806dc39b" acquired by "delete_volume" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:20:44 devstack sudo[100545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0b2cbd62-311b-4fd8-aa06-186937391b0e_j2nqoo2sdevstack@QuobyteHD
Nov 05 19:20:44 devstack sudo[100545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5583a603-28e4-4b94-9097-b42c31e4050f tempest-VolumesGetTest-2098101542 None] Lock "cinder-b3b0f713-6638-4303-8367-eb2f8bdb0baa-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:20:44 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46950fd-aeef-42db-b0b3-44096faf3bf3]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:20:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ac25c5b0-b40a-485b-b4f6-4fb43834f579 tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:44 devstack sudo[100546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_hl0rlnkpdevstack@QuobyteHD
Nov 05 19:20:44 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:44 devstack sudo[100548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b
Nov 05 19:20:44 devstack sudo[100548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:44 devstack sudo[100545]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0b2cbd62-311b-4fd8-aa06-186937391b0e_j2nqoo2sdevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:20:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:20:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2098761544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7eaa07e-8892-494e-aa1c-9abc8bd39dee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb2b0ab56d614d918117b3851c0b1063',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:20:38Z,use_quota=True,user_id='83998c0907184619941c4c30b8f8cb90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f77dec79-d42e-40db-a2ef-db0a759e1361),volume_type_id=f77dec79-d42e-40db-a2ef-db0a759e1361)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:20:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Creating volume a7eaa07e-8892-494e-aa1c-9abc8bd39dee {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:20:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:20:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:20:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:20:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:20:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:20:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:20:44 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:20:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a7eaa07e-8892-494e-aa1c-9abc8bd39dee 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:44 devstack sudo[100557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a7eaa07e-8892-494e-aa1c-9abc8bd39dee 1073741824
Nov 05 19:20:44 devstack sudo[100557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:44 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_hl0rlnkpdevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:44 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Temporary image 300700a0-51ab-4ee2-8ef0-e0eeaa8aee29 is fetched for user 38dc29a34f174cef9fc8c89fd83809b3. {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 19:20:44 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[70697dfc-2ed4-457d-8d53-86736f1751c5]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:20:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_hl0rlnkpdevstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:44 devstack sudo[100548]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ac25c5b0-b40a-485b-b4f6-4fb43834f579 tempest-VolumesGetTest-2098101542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b" returned: 0 in 0.408s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ac25c5b0-b40a-485b-b4f6-4fb43834f579 tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:44 devstack sudo[100563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b
Nov 05 19:20:44 devstack sudo[100563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:44 devstack sudo[100561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_hl0rlnkpdevstack@QuobyteHD
Nov 05 19:20:44 devstack sudo[100561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:44 devstack sudo[100563]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ac25c5b0-b40a-485b-b4f6-4fb43834f579 tempest-VolumesGetTest-2098101542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6351b106-0e03-4bea-8666-0495806dc39b" returned: 0 in 0.283s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:44 devstack sudo[100561]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_hl0rlnkpdevstack@QuobyteHD" returned: 0 in 0.388s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:20:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ac25c5b0-b40a-485b-b4f6-4fb43834f579 tempest-VolumesGetTest-2098101542 None] Lock "cinder-quobyte-6351b106-0e03-4bea-8666-0495806dc39b" released by "delete_volume" :: held 0.780s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:20:44 devstack sudo[100557]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a7eaa07e-8892-494e-aa1c-9abc8bd39dee 1073741824" returned: 0 in 0.537s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a7eaa07e-8892-494e-aa1c-9abc8bd39dee {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:45 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-ac25c5b0-b40a-485b-b4f6-4fb43834f579 tempest-VolumesGetTest-2098101542 None] Created reservations ['c12dea16-020f-41b4-9eec-e74edf41e51a', 'df66cf67-05f1-4945-a0b3-b99ff64f8864', 'be05bdb6-0afe-4607-963b-af648580f2ec', 'bfa12ee2-d986-4511-a094-98517038dddf'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:20:45 devstack sudo[100578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a7eaa07e-8892-494e-aa1c-9abc8bd39dee
Nov 05 19:20:45 devstack sudo[100578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ac25c5b0-b40a-485b-b4f6-4fb43834f579 tempest-VolumesGetTest-2098101542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:20:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ac25c5b0-b40a-485b-b4f6-4fb43834f579 tempest-VolumesGetTest-2098101542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:20:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ac25c5b0-b40a-485b-b4f6-4fb43834f579 tempest-VolumesGetTest-2098101542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:20:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ac25c5b0-b40a-485b-b4f6-4fb43834f579 tempest-VolumesGetTest-2098101542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:20:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ac25c5b0-b40a-485b-b4f6-4fb43834f579 tempest-VolumesGetTest-2098101542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:20:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ac25c5b0-b40a-485b-b4f6-4fb43834f579 tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:45 devstack sudo[100580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:20:45 devstack sudo[100580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:45 devstack sudo[100578]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a7eaa07e-8892-494e-aa1c-9abc8bd39dee" returned: 0 in 0.328s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:20:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:20:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.385s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:20:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-848861896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f353428-8629-4c58-8d0a-58c0ea9574ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6e84b6e86f54da98a4c2531fb105c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:20:43Z,use_quota=True,user_id='38dc29a34f174cef9fc8c89fd83809b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:20:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Creating volume 5f353428-8629-4c58-8d0a-58c0ea9574ef {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:20:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:20:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:20:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:20:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:20:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:20:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:20:45 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:20:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5f353428-8629-4c58-8d0a-58c0ea9574ef 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:45 devstack sudo[100583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5f353428-8629-4c58-8d0a-58c0ea9574ef 1073741824
Nov 05 19:20:45 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:45 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Attempting download of 0b2cbd62-311b-4fd8-aa06-186937391b0e ((None, [{'url': 'file:///opt/stack/data/glance/images/0b2cbd62-311b-4fd8-aa06-186937391b0e', 'metadata': {}}])) to volume a7eaa07e-8892-494e-aa1c-9abc8bd39dee. {{(pid=87184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 19:20:45 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc39c0b-0960-46a0-ba6f-e15ca88836eb]: (4, 'raw') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:20:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0b2cbd62-311b-4fd8-aa06-186937391b0e_68nsz04f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:45 devstack sudo[100580]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ac25c5b0-b40a-485b-b4f6-4fb43834f579 tempest-VolumesGetTest-2098101542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.304s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:45 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-ac25c5b0-b40a-485b-b4f6-4fb43834f579 tempest-VolumesGetTest-2098101542 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:20:45 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-ac25c5b0-b40a-485b-b4f6-4fb43834f579 tempest-VolumesGetTest-2098101542 None] Deleted volume successfully.
Nov 05 19:20:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ac25c5b0-b40a-485b-b4f6-4fb43834f579 tempest-VolumesGetTest-2098101542 None] Lock "cinder-6351b106-0e03-4bea-8666-0495806dc39b-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:20:45 devstack sudo[100586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0b2cbd62-311b-4fd8-aa06-186937391b0e_68nsz04f
Nov 05 19:20:45 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:45 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0b2cbd62-311b-4fd8-aa06-186937391b0e_68nsz04f" returned: 0 in 0.387s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0b2cbd62-311b-4fd8-aa06-186937391b0e_68nsz04f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:45 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5f353428-8629-4c58-8d0a-58c0ea9574ef 1073741824" returned: 0 in 0.580s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5f353428-8629-4c58-8d0a-58c0ea9574ef {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:46 devstack sudo[100594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0b2cbd62-311b-4fd8-aa06-186937391b0e_68nsz04f
Nov 05 19:20:46 devstack sudo[100594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:46 devstack sudo[100595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5f353428-8629-4c58-8d0a-58c0ea9574ef
Nov 05 19:20:46 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:46 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:20:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Flow 'volume_create_manager' (03dc3016-4292-4164-82ba-8285aaf3951c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:20:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0551c3c4-41f7-4235-8ffb-ee908c72b803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0551c3c4-41f7-4235-8ffb-ee908c72b803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1411036339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cad2e0d-4df2-4603-b7b9-39a1a6ceabdd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='409f7e915edd48d6a6656bbe4ec42331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:20:46Z,use_quota=True,user_id='bacc0b743e174fb78263f33729f9f26d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3d14d12-25ad-4e63-aa5d-12ecc7727560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3d14d12-25ad-4e63-aa5d-12ecc7727560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e31d12a6-0eff-4d6e-9805-6e9a00a5452c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:46 devstack cinder-volume[87184]: DEBUG cinder.image.glance [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Creating Keystone auth plugin from conf {{(pid=87184) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 19:20:46 devstack sudo[100594]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0b2cbd62-311b-4fd8-aa06-186937391b0e_68nsz04f" returned: 1 in 0.381s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0b2cbd62-311b-4fd8-aa06-186937391b0e_68nsz04f' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 19:20:46 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ced72b0-530b-41ff-a7da-94c549946690]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:20:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0b2cbd62-311b-4fd8-aa06-186937391b0e_j2nqoo2sdevstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:46 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5f353428-8629-4c58-8d0a-58c0ea9574ef" returned: 0 in 0.288s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:46 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:20:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:20:46 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Attempting download of 300700a0-51ab-4ee2-8ef0-e0eeaa8aee29 ((None, [{'url': 'file:///opt/stack/data/glance/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'metadata': {}}])) to volume 5f353428-8629-4c58-8d0a-58c0ea9574ef. {{(pid=87184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 19:20:46 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f02ac7e-3df6-410a-9584-e911f339a490]: (4, 'raw') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:20:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_8o830ajn {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:46 devstack sudo[100601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0b2cbd62-311b-4fd8-aa06-186937391b0e_j2nqoo2sdevstack@QuobyteHD
Nov 05 19:20:46 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e31d12a6-0eff-4d6e-9805-6e9a00a5452c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0cad2e0d-4df2-4603-b7b9-39a1a6ceabdd', 'volume_name': 'volume-0cad2e0d-4df2-4603-b7b9-39a1a6ceabdd', 'volume_size': 1, 'image_id': '300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3e813114ebb84b35a5c6eb1b802f157f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'created_at': datetime.datetime(2026, 11, 5, 18, 1, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 18, 1, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7366278cdd60>}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be54d970-90f7-4eb8-84a8-b3720691fc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be54d970-90f7-4eb8-84a8-b3720691fc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c18d2449-e083-4a8b-bdbe-c84a54c24f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:46 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Volume 0cad2e0d-4df2-4603-b7b9-39a1a6ceabdd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0cad2e0d-4df2-4603-b7b9-39a1a6ceabdd', 'volume_size': 1, 'image_id': '300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3e813114ebb84b35a5c6eb1b802f157f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'created_at': datetime.datetime(2026, 11, 5, 18, 1, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 18, 1, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7366278cdd60>}
Nov 05 19:20:46 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Trying to clone 0cad2e0d-4df2-4603-b7b9-39a1a6ceabdd from image 300700a0-51ab-4ee2-8ef0-e0eeaa8aee29 at location (None, [{'url': 'file:///opt/stack/data/glance/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'metadata': {}}]). {{(pid=87184) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 19:20:46 devstack sudo[100602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_8o830ajn
Nov 05 19:20:46 devstack sudo[100602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:46 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0b2cbd62-311b-4fd8-aa06-186937391b0e_j2nqoo2sdevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:46 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] 0b2cbd62-311b-4fd8-aa06-186937391b0e was qcow2, converting to qcow2 {{(pid=87184) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 19:20:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0b2cbd62-311b-4fd8-aa06-186937391b0e_j2nqoo2sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a7eaa07e-8892-494e-aa1c-9abc8bd39dee {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:46 devstack sudo[100609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0b2cbd62-311b-4fd8-aa06-186937391b0e_j2nqoo2sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a7eaa07e-8892-494e-aa1c-9abc8bd39dee
Nov 05 19:20:46 devstack sudo[100609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:46 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_z0id_t5odevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 19:20:46 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 19:20:46 devstack sudo[100602]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_8o830ajn" returned: 0 in 0.435s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_8o830ajn {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:46 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[411d773f-30d7-4db0-bac4-adfec0901885]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:20:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_z0id_t5odevstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:46 devstack sudo[100614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_8o830ajn
Nov 05 19:20:46 devstack sudo[100614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:46 devstack sudo[100615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_z0id_t5odevstack@QuobyteHD
Nov 05 19:20:46 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:47 devstack sudo[100614]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_8o830ajn" returned: 1 in 0.372s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_8o830ajn' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 19:20:47 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c84d133-fa8a-4e33-b46d-42637cc93695]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:20:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_hl0rlnkpdevstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:47 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_z0id_t5odevstack@QuobyteHD" returned: 0 in 0.396s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:47 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Temporary image 300700a0-51ab-4ee2-8ef0-e0eeaa8aee29 is fetched for user bacc0b743e174fb78263f33729f9f26d. {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 19:20:47 devstack sudo[100626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_hl0rlnkpdevstack@QuobyteHD
Nov 05 19:20:47 devstack sudo[100626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:47 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35db1bc-dcb3-43e0-9b1b-b27b8bf4bebb]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:20:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_z0id_t5odevstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:47 devstack sudo[100631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_z0id_t5odevstack@QuobyteHD
Nov 05 19:20:47 devstack sudo[100631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:47 devstack sudo[100626]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_hl0rlnkpdevstack@QuobyteHD" returned: 0 in 0.350s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:47 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] 300700a0-51ab-4ee2-8ef0-e0eeaa8aee29 was qcow2, converting to qcow2 {{(pid=87184) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 19:20:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_hl0rlnkpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5f353428-8629-4c58-8d0a-58c0ea9574ef {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:47 devstack sudo[100636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_hl0rlnkpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5f353428-8629-4c58-8d0a-58c0ea9574ef
Nov 05 19:20:47 devstack sudo[100636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:47 devstack sudo[100631]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_z0id_t5odevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:20:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:20:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1411036339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cad2e0d-4df2-4603-b7b9-39a1a6ceabdd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='409f7e915edd48d6a6656bbe4ec42331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:20:46Z,use_quota=True,user_id='bacc0b743e174fb78263f33729f9f26d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:20:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Creating volume 0cad2e0d-4df2-4603-b7b9-39a1a6ceabdd {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:20:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:20:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:20:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:20:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:20:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:20:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:20:47 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:20:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0cad2e0d-4df2-4603-b7b9-39a1a6ceabdd 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:47 devstack sudo[100641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0cad2e0d-4df2-4603-b7b9-39a1a6ceabdd 1073741824
Nov 05 19:20:47 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:48 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0cad2e0d-4df2-4603-b7b9-39a1a6ceabdd 1073741824" returned: 0 in 0.556s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0cad2e0d-4df2-4603-b7b9-39a1a6ceabdd {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:48 devstack sudo[100653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0cad2e0d-4df2-4603-b7b9-39a1a6ceabdd
Nov 05 19:20:48 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:48 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0cad2e0d-4df2-4603-b7b9-39a1a6ceabdd" returned: 0 in 0.305s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:20:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:20:48 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Attempting download of 300700a0-51ab-4ee2-8ef0-e0eeaa8aee29 ((None, [{'url': 'file:///opt/stack/data/glance/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'metadata': {}}])) to volume 0cad2e0d-4df2-4603-b7b9-39a1a6ceabdd. {{(pid=87184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 19:20:48 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d25b17f-3986-48c0-bffc-abe596d9d436]: (4, 'raw') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:20:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_pez5jej7 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:48 devstack sudo[100609]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0b2cbd62-311b-4fd8-aa06-186937391b0e_j2nqoo2sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a7eaa07e-8892-494e-aa1c-9abc8bd39dee" returned: 0 in 2.225s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:48 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0b2cbd62-311b-4fd8-aa06-186937391b0e_j2nqoo2sdevstack@QuobyteHD, size 112.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a7eaa07e-8892-494e-aa1c-9abc8bd39dee {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 19:20:48 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Converted 112.00 MB image at 50.30 MB/s
Nov 05 19:20:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a7eaa07e-8892-494e-aa1c-9abc8bd39dee 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:48 devstack sudo[100656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_pez5jej7
Nov 05 19:20:48 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:48 devstack sudo[100657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a7eaa07e-8892-494e-aa1c-9abc8bd39dee 1G
Nov 05 19:20:48 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:49 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_pez5jej7" returned: 0 in 0.440s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_pez5jej7 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:49 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a7eaa07e-8892-494e-aa1c-9abc8bd39dee 1G" returned: 0 in 0.424s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:49 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Downloaded image 0b2cbd62-311b-4fd8-aa06-186937391b0e ((None, [{'url': 'file:///opt/stack/data/glance/images/0b2cbd62-311b-4fd8-aa06-186937391b0e', 'metadata': {}}])) to volume a7eaa07e-8892-494e-aa1c-9abc8bd39dee successfully. {{(pid=87184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 19:20:49 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Temporary image 0b2cbd62-311b-4fd8-aa06-186937391b0e for user 83998c0907184619941c4c30b8f8cb90 is deleted. {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 19:20:49 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Marking volume a7eaa07e-8892-494e-aa1c-9abc8bd39dee as bootable. {{(pid=87184) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 19:20:49 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Copying metadata from image 0b2cbd62-311b-4fd8-aa06-186937391b0e to a7eaa07e-8892-494e-aa1c-9abc8bd39dee. {{(pid=87184) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 19:20:49 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Creating volume glance metadata for volume a7eaa07e-8892-494e-aa1c-9abc8bd39dee backed by image 0b2cbd62-311b-4fd8-aa06-186937391b0e with: {'image_id': '0b2cbd62-311b-4fd8-aa06-186937391b0e', 'image_name': 'tempest-scenario-img--1905603935', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87184) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 19:20:49 devstack sudo[100699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_pez5jej7
Nov 05 19:20:49 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62bfd25e-5472-4d07-a52c-0860ae3e1b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7eaa07e-8892-494e-aa1c-9abc8bd39dee', 'volume_size': 1, 'image_id': '0b2cbd62-311b-4fd8-aa06-186937391b0e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0b2cbd62-311b-4fd8-aa06-186937391b0e', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1905603935', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb2b0ab56d614d918117b3851c0b1063', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0b2cbd62-311b-4fd8-aa06-186937391b0e', 'created_at': datetime.datetime(2026, 11, 5, 18, 20, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 18, 20, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0b2cbd62-311b-4fd8-aa06-186937391b0e/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x736627a0a030>}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29e0eb0e-ecc6-46f9-99a2-860e24c75d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:49 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Volume volume-a7eaa07e-8892-494e-aa1c-9abc8bd39dee (a7eaa07e-8892-494e-aa1c-9abc8bd39dee): created successfully
Nov 05 19:20:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29e0eb0e-ecc6-46f9-99a2-860e24c75d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Flow 'volume_create_manager' (1bca2f01-7f8b-4810-bdcf-7ab430d3dc1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:20:49 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-8c699a41-cead-498b-9cc2-759026b4f1da tempest-TestInstancesWithCinderVolumes-180007272 None] Created volume successfully.
Nov 05 19:20:49 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_pez5jej7" returned: 1 in 0.480s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_pez5jej7' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 19:20:49 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aba6636-5507-45c7-8a43-3748e5892d27]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:20:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_z0id_t5odevstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:49 devstack sudo[100706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_z0id_t5odevstack@QuobyteHD
Nov 05 19:20:49 devstack sudo[100706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:49 devstack sudo[100636]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_hl0rlnkpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5f353428-8629-4c58-8d0a-58c0ea9574ef" returned: 0 in 2.272s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:49 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_hl0rlnkpdevstack@QuobyteHD, size 112.00 MB, duration 2.27 sec, destination /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5f353428-8629-4c58-8d0a-58c0ea9574ef {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 19:20:49 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Converted 112.00 MB image at 49.28 MB/s
Nov 05 19:20:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5f353428-8629-4c58-8d0a-58c0ea9574ef 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:49 devstack sudo[100708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5f353428-8629-4c58-8d0a-58c0ea9574ef 1G
Nov 05 19:20:49 devstack sudo[100708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:50 devstack sudo[100706]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_z0id_t5odevstack@QuobyteHD" returned: 0 in 0.358s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:50 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] 300700a0-51ab-4ee2-8ef0-e0eeaa8aee29 was qcow2, converting to qcow2 {{(pid=87184) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 19:20:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_z0id_t5odevstack@QuobyteHD /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0cad2e0d-4df2-4603-b7b9-39a1a6ceabdd {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:50 devstack sudo[100715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_z0id_t5odevstack@QuobyteHD /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0cad2e0d-4df2-4603-b7b9-39a1a6ceabdd
Nov 05 19:20:50 devstack sudo[100715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:50 devstack sudo[100708]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5f353428-8629-4c58-8d0a-58c0ea9574ef 1G" returned: 0 in 0.337s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:50 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Downloaded image 300700a0-51ab-4ee2-8ef0-e0eeaa8aee29 ((None, [{'url': 'file:///opt/stack/data/glance/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'metadata': {}}])) to volume 5f353428-8629-4c58-8d0a-58c0ea9574ef successfully. {{(pid=87184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 19:20:50 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Temporary image 300700a0-51ab-4ee2-8ef0-e0eeaa8aee29 for user 38dc29a34f174cef9fc8c89fd83809b3 is deleted. {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 19:20:50 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Marking volume 5f353428-8629-4c58-8d0a-58c0ea9574ef as bootable. {{(pid=87184) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 19:20:50 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Copying metadata from image 300700a0-51ab-4ee2-8ef0-e0eeaa8aee29 to 5f353428-8629-4c58-8d0a-58c0ea9574ef. {{(pid=87184) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 19:20:50 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Creating volume glance metadata for volume 5f353428-8629-4c58-8d0a-58c0ea9574ef backed by image 300700a0-51ab-4ee2-8ef0-e0eeaa8aee29 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87184) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 19:20:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e420dbd-90a0-436a-a680-e1318b4bd90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f353428-8629-4c58-8d0a-58c0ea9574ef', 'volume_size': 1, 'image_id': '300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3e813114ebb84b35a5c6eb1b802f157f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'created_at': datetime.datetime(2026, 11, 5, 18, 1, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 18, 1, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x736627af2990>}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efda54c4-d667-42b6-9948-9c46ed913ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:50 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Volume volume-5f353428-8629-4c58-8d0a-58c0ea9574ef (5f353428-8629-4c58-8d0a-58c0ea9574ef): created successfully
Nov 05 19:20:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efda54c4-d667-42b6-9948-9c46ed913ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Flow 'volume_create_manager' (07f9becf-81e3-4c41-8ecc-dd103b5c895e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:20:50 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-14da8c94-872f-4049-9621-40180380a9c8 tempest-TestShelveInstance-431802604 None] Created volume successfully.
Nov 05 19:20:52 devstack sudo[100715]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_z0id_t5odevstack@QuobyteHD /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0cad2e0d-4df2-4603-b7b9-39a1a6ceabdd" returned: 0 in 2.325s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:52 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_300700a0-51ab-4ee2-8ef0-e0eeaa8aee29_z0id_t5odevstack@QuobyteHD, size 112.00 MB, duration 2.33 sec, destination /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0cad2e0d-4df2-4603-b7b9-39a1a6ceabdd {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 19:20:52 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Converted 112.00 MB image at 48.16 MB/s
Nov 05 19:20:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0cad2e0d-4df2-4603-b7b9-39a1a6ceabdd 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:52 devstack sudo[100734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0cad2e0d-4df2-4603-b7b9-39a1a6ceabdd 1G
Nov 05 19:20:52 devstack sudo[100734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:52 devstack sudo[100734]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0cad2e0d-4df2-4603-b7b9-39a1a6ceabdd 1G" returned: 0 in 0.458s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:52 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Downloaded image 300700a0-51ab-4ee2-8ef0-e0eeaa8aee29 ((None, [{'url': 'file:///opt/stack/data/glance/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'metadata': {}}])) to volume 0cad2e0d-4df2-4603-b7b9-39a1a6ceabdd successfully. {{(pid=87184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 19:20:52 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Temporary image 300700a0-51ab-4ee2-8ef0-e0eeaa8aee29 for user bacc0b743e174fb78263f33729f9f26d is deleted. {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 19:20:52 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Marking volume 0cad2e0d-4df2-4603-b7b9-39a1a6ceabdd as bootable. {{(pid=87184) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 19:20:52 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Copying metadata from image 300700a0-51ab-4ee2-8ef0-e0eeaa8aee29 to 0cad2e0d-4df2-4603-b7b9-39a1a6ceabdd. {{(pid=87184) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 19:20:52 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Creating volume glance metadata for volume 0cad2e0d-4df2-4603-b7b9-39a1a6ceabdd backed by image 300700a0-51ab-4ee2-8ef0-e0eeaa8aee29 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87184) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 19:20:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c18d2449-e083-4a8b-bdbe-c84a54c24f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cad2e0d-4df2-4603-b7b9-39a1a6ceabdd', 'volume_size': 1, 'image_id': '300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3e813114ebb84b35a5c6eb1b802f157f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '300700a0-51ab-4ee2-8ef0-e0eeaa8aee29', 'created_at': datetime.datetime(2026, 11, 5, 18, 1, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 18, 1, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/300700a0-51ab-4ee2-8ef0-e0eeaa8aee29/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7366278cdd60>}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84f3d3f6-8b4b-4cf7-bb8b-e1ef6f4b91c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:53 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Volume volume-0cad2e0d-4df2-4603-b7b9-39a1a6ceabdd (0cad2e0d-4df2-4603-b7b9-39a1a6ceabdd): created successfully
Nov 05 19:20:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84f3d3f6-8b4b-4cf7-bb8b-e1ef6f4b91c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Flow 'volume_create_manager' (03dc3016-4292-4164-82ba-8285aaf3951c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:20:53 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-46ca8127-20cb-448f-bbf9-c6cca949100f tempest-VolumesGetTest-2098101542 None] Created volume successfully.
Nov 05 19:20:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-1cfdd4fe-7eb1-432f-a285-ec742363c8fc req-8fad178b-9646-4214-83f8-45b64c54337a tempest-TestInstancesWithCinderVolumes-180007272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:20:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-1cfdd4fe-7eb1-432f-a285-ec742363c8fc req-8fad178b-9646-4214-83f8-45b64c54337a tempest-TestInstancesWithCinderVolumes-180007272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:20:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-1cfdd4fe-7eb1-432f-a285-ec742363c8fc req-8fad178b-9646-4214-83f8-45b64c54337a tempest-TestInstancesWithCinderVolumes-180007272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.085s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:20:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-1cfdd4fe-7eb1-432f-a285-ec742363c8fc req-8fad178b-9646-4214-83f8-45b64c54337a tempest-TestInstancesWithCinderVolumes-180007272 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec', 'name': 'volume-a7eaa07e-8892-494e-aa1c-9abc8bd39dee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7a650b57-b348-403a-a623-ca267ddec6c3', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 19:20:53 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-1cfdd4fe-7eb1-432f-a285-ec742363c8fc req-8fad178b-9646-4214-83f8-45b64c54337a tempest-TestInstancesWithCinderVolumes-180007272 None] attachment_update completed successfully.
Nov 05 19:20:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-c59d78b7-6306-4562-aa1a-10448982caf0 req-f56e328b-572e-4b64-aacb-be2b82abfe26 tempest-TestShelveInstance-431802604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:20:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-c59d78b7-6306-4562-aa1a-10448982caf0 req-f56e328b-572e-4b64-aacb-be2b82abfe26 tempest-TestShelveInstance-431802604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:20:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-c59d78b7-6306-4562-aa1a-10448982caf0 req-f56e328b-572e-4b64-aacb-be2b82abfe26 tempest-TestShelveInstance-431802604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:20:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-c59d78b7-6306-4562-aa1a-10448982caf0 req-f56e328b-572e-4b64-aacb-be2b82abfe26 tempest-TestShelveInstance-431802604 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec', 'name': 'volume-5f353428-8629-4c58-8d0a-58c0ea9574ef', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '27042de1-13dd-40db-955a-53f384520630', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 19:20:54 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-c59d78b7-6306-4562-aa1a-10448982caf0 req-f56e328b-572e-4b64-aacb-be2b82abfe26 tempest-TestShelveInstance-431802604 None] attachment_update completed successfully.
Nov 05 19:20:54 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-6034177e-bbd0-4ca8-90c5-8a159c907bc7 tempest-VolumesGetTest-2098101542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:20:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6034177e-bbd0-4ca8-90c5-8a159c907bc7 tempest-VolumesGetTest-2098101542 None] Flow 'volume_create_manager' (86fb8c70-0e4f-4cae-b20e-af72f03afb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:20:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6034177e-bbd0-4ca8-90c5-8a159c907bc7 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf4c17ab-3ac2-441f-a424-27e3bcf66d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6034177e-bbd0-4ca8-90c5-8a159c907bc7 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf4c17ab-3ac2-441f-a424-27e3bcf66d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:20:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1581883219',display_name='tempest-VolumesGetTest-Volume-308047814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de90b494-07c2-419c-9773-b9fc96767960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='409f7e915edd48d6a6656bbe4ec42331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:20:55Z,use_quota=True,user_id='bacc0b743e174fb78263f33729f9f26d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6034177e-bbd0-4ca8-90c5-8a159c907bc7 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9ac0c19-e0f3-4236-a129-68768a27e384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6034177e-bbd0-4ca8-90c5-8a159c907bc7 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9ac0c19-e0f3-4236-a129-68768a27e384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6034177e-bbd0-4ca8-90c5-8a159c907bc7 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e00573-7a40-41ca-ad7e-1250144caec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6034177e-bbd0-4ca8-90c5-8a159c907bc7 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e00573-7a40-41ca-ad7e-1250144caec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de90b494-07c2-419c-9773-b9fc96767960', 'volume_name': 'volume-de90b494-07c2-419c-9773-b9fc96767960', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6034177e-bbd0-4ca8-90c5-8a159c907bc7 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4898082-0b8d-4558-ac28-ffac58a484d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6034177e-bbd0-4ca8-90c5-8a159c907bc7 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4898082-0b8d-4558-ac28-ffac58a484d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6034177e-bbd0-4ca8-90c5-8a159c907bc7 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b81abc4-2bd0-48fc-a4eb-27814b920b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:54 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-6034177e-bbd0-4ca8-90c5-8a159c907bc7 tempest-VolumesGetTest-2098101542 None] Volume de90b494-07c2-419c-9773-b9fc96767960: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de90b494-07c2-419c-9773-b9fc96767960', 'volume_size': 1}
Nov 05 19:20:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6034177e-bbd0-4ca8-90c5-8a159c907bc7 tempest-VolumesGetTest-2098101542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:20:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6034177e-bbd0-4ca8-90c5-8a159c907bc7 tempest-VolumesGetTest-2098101542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:20:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6034177e-bbd0-4ca8-90c5-8a159c907bc7 tempest-VolumesGetTest-2098101542 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:20:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1581883219',display_name='tempest-VolumesGetTest-Volume-308047814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de90b494-07c2-419c-9773-b9fc96767960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='409f7e915edd48d6a6656bbe4ec42331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:20:55Z,use_quota=True,user_id='bacc0b743e174fb78263f33729f9f26d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:20:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-6034177e-bbd0-4ca8-90c5-8a159c907bc7 tempest-VolumesGetTest-2098101542 None] Creating volume de90b494-07c2-419c-9773-b9fc96767960 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:20:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6034177e-bbd0-4ca8-90c5-8a159c907bc7 tempest-VolumesGetTest-2098101542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:20:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6034177e-bbd0-4ca8-90c5-8a159c907bc7 tempest-VolumesGetTest-2098101542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:20:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6034177e-bbd0-4ca8-90c5-8a159c907bc7 tempest-VolumesGetTest-2098101542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:20:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6034177e-bbd0-4ca8-90c5-8a159c907bc7 tempest-VolumesGetTest-2098101542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:20:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6034177e-bbd0-4ca8-90c5-8a159c907bc7 tempest-VolumesGetTest-2098101542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:20:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6034177e-bbd0-4ca8-90c5-8a159c907bc7 tempest-VolumesGetTest-2098101542 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:20:54 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-6034177e-bbd0-4ca8-90c5-8a159c907bc7 tempest-VolumesGetTest-2098101542 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:20:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6034177e-bbd0-4ca8-90c5-8a159c907bc7 tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de90b494-07c2-419c-9773-b9fc96767960 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:54 devstack sudo[100756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de90b494-07c2-419c-9773-b9fc96767960 1073741824
Nov 05 19:20:54 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:55 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6034177e-bbd0-4ca8-90c5-8a159c907bc7 tempest-VolumesGetTest-2098101542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de90b494-07c2-419c-9773-b9fc96767960 1073741824" returned: 0 in 0.528s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6034177e-bbd0-4ca8-90c5-8a159c907bc7 tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de90b494-07c2-419c-9773-b9fc96767960 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:55 devstack sudo[100763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de90b494-07c2-419c-9773-b9fc96767960
Nov 05 19:20:55 devstack sudo[100763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:55 devstack sudo[100763]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6034177e-bbd0-4ca8-90c5-8a159c907bc7 tempest-VolumesGetTest-2098101542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de90b494-07c2-419c-9773-b9fc96767960" returned: 0 in 0.295s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:55 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6034177e-bbd0-4ca8-90c5-8a159c907bc7 tempest-VolumesGetTest-2098101542 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:20:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6034177e-bbd0-4ca8-90c5-8a159c907bc7 tempest-VolumesGetTest-2098101542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:20:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6034177e-bbd0-4ca8-90c5-8a159c907bc7 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b81abc4-2bd0-48fc-a4eb-27814b920b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de90b494-07c2-419c-9773-b9fc96767960', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6034177e-bbd0-4ca8-90c5-8a159c907bc7 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2ff4c3e-cddc-409b-904d-6fa5bdb324a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:20:55 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-6034177e-bbd0-4ca8-90c5-8a159c907bc7 tempest-VolumesGetTest-2098101542 None] Volume volume-de90b494-07c2-419c-9773-b9fc96767960 (de90b494-07c2-419c-9773-b9fc96767960): created successfully
Nov 05 19:20:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6034177e-bbd0-4ca8-90c5-8a159c907bc7 tempest-VolumesGetTest-2098101542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2ff4c3e-cddc-409b-904d-6fa5bdb324a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:20:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6034177e-bbd0-4ca8-90c5-8a159c907bc7 tempest-VolumesGetTest-2098101542 None] Flow 'volume_create_manager' (86fb8c70-0e4f-4cae-b20e-af72f03afb2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:20:55 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-6034177e-bbd0-4ca8-90c5-8a159c907bc7 tempest-VolumesGetTest-2098101542 None] Created volume successfully.
Nov 05 19:20:57 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-53c20f4b-0146-41bd-9fe1-1402f9375658 tempest-VolumesGetTest-2098101542 None] Acquiring lock "cinder-de90b494-07c2-419c-9773-b9fc96767960-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:20:57 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-53c20f4b-0146-41bd-9fe1-1402f9375658 tempest-VolumesGetTest-2098101542 None] Lock "cinder-de90b494-07c2-419c-9773-b9fc96767960-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:20:57 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-53c20f4b-0146-41bd-9fe1-1402f9375658 tempest-VolumesGetTest-2098101542 None] Acquiring lock "cinder-quobyte-de90b494-07c2-419c-9773-b9fc96767960" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:20:57 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-53c20f4b-0146-41bd-9fe1-1402f9375658 tempest-VolumesGetTest-2098101542 None] Lock "cinder-quobyte-de90b494-07c2-419c-9773-b9fc96767960" acquired by "delete_volume" :: waited 0.026s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:20:57 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e8e973-f571-4e28-add5-897bb10bd8fa]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:20:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-53c20f4b-0146-41bd-9fe1-1402f9375658 tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de90b494-07c2-419c-9773-b9fc96767960 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:57 devstack sudo[101243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de90b494-07c2-419c-9773-b9fc96767960
Nov 05 19:20:57 devstack sudo[101243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:58 devstack sudo[101243]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-53c20f4b-0146-41bd-9fe1-1402f9375658 tempest-VolumesGetTest-2098101542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de90b494-07c2-419c-9773-b9fc96767960" returned: 0 in 0.842s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-53c20f4b-0146-41bd-9fe1-1402f9375658 tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de90b494-07c2-419c-9773-b9fc96767960 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:58 devstack sudo[101274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de90b494-07c2-419c-9773-b9fc96767960
Nov 05 19:20:58 devstack sudo[101274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:58 devstack sudo[101274]: pam_unix(sudo:session): session closed for user root
Nov 05 19:20:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-53c20f4b-0146-41bd-9fe1-1402f9375658 tempest-VolumesGetTest-2098101542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-de90b494-07c2-419c-9773-b9fc96767960" returned: 0 in 0.696s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:20:59 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-53c20f4b-0146-41bd-9fe1-1402f9375658 tempest-VolumesGetTest-2098101542 None] Lock "cinder-quobyte-de90b494-07c2-419c-9773-b9fc96767960" released by "delete_volume" :: held 1.663s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:20:59 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-53c20f4b-0146-41bd-9fe1-1402f9375658 tempest-VolumesGetTest-2098101542 None] Created reservations ['8937892f-0672-4c25-ab19-a058a6495ad4', '4ef8f574-2b79-4a3a-b8ae-e4f1b575ed0e', 'da8980ba-6bd2-4921-867f-a9289967462a', '9399a970-15fa-48ee-a3c7-c4932174d416'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:20:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-53c20f4b-0146-41bd-9fe1-1402f9375658 tempest-VolumesGetTest-2098101542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:20:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-53c20f4b-0146-41bd-9fe1-1402f9375658 tempest-VolumesGetTest-2098101542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:20:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-53c20f4b-0146-41bd-9fe1-1402f9375658 tempest-VolumesGetTest-2098101542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:20:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-53c20f4b-0146-41bd-9fe1-1402f9375658 tempest-VolumesGetTest-2098101542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:20:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-53c20f4b-0146-41bd-9fe1-1402f9375658 tempest-VolumesGetTest-2098101542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:20:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-53c20f4b-0146-41bd-9fe1-1402f9375658 tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:20:59 devstack sudo[101313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:20:59 devstack sudo[101313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:20:59 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ddb07259-b44d-49a2-956c-8a664024e977 tempest-VolumesGetTest-2098101542 None] Acquiring lock "cinder-0cad2e0d-4df2-4603-b7b9-39a1a6ceabdd-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:20:59 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ddb07259-b44d-49a2-956c-8a664024e977 tempest-VolumesGetTest-2098101542 None] Lock "cinder-0cad2e0d-4df2-4603-b7b9-39a1a6ceabdd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:21:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ddb07259-b44d-49a2-956c-8a664024e977 tempest-VolumesGetTest-2098101542 None] Acquiring lock "cinder-quobyte-0cad2e0d-4df2-4603-b7b9-39a1a6ceabdd" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:21:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ddb07259-b44d-49a2-956c-8a664024e977 tempest-VolumesGetTest-2098101542 None] Lock "cinder-quobyte-0cad2e0d-4df2-4603-b7b9-39a1a6ceabdd" acquired by "delete_volume" :: waited 0.042s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:21:00 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[362a8d3d-5aaf-4983-98c4-684b87978ba9]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:21:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ddb07259-b44d-49a2-956c-8a664024e977 tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0cad2e0d-4df2-4603-b7b9-39a1a6ceabdd {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:00 devstack sudo[101313]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-53c20f4b-0146-41bd-9fe1-1402f9375658 tempest-VolumesGetTest-2098101542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.800s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:00 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-53c20f4b-0146-41bd-9fe1-1402f9375658 tempest-VolumesGetTest-2098101542 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:21:00 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-53c20f4b-0146-41bd-9fe1-1402f9375658 tempest-VolumesGetTest-2098101542 None] Deleted volume successfully.
Nov 05 19:21:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-53c20f4b-0146-41bd-9fe1-1402f9375658 tempest-VolumesGetTest-2098101542 None] Lock "cinder-de90b494-07c2-419c-9773-b9fc96767960-delete_volume" released by "delete_volume" :: held 3.026s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:21:00 devstack sudo[101318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0cad2e0d-4df2-4603-b7b9-39a1a6ceabdd
Nov 05 19:21:00 devstack sudo[101318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:01 devstack sudo[101318]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ddb07259-b44d-49a2-956c-8a664024e977 tempest-VolumesGetTest-2098101542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0cad2e0d-4df2-4603-b7b9-39a1a6ceabdd" returned: 0 in 0.893s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ddb07259-b44d-49a2-956c-8a664024e977 tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0cad2e0d-4df2-4603-b7b9-39a1a6ceabdd {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:01 devstack sudo[101327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0cad2e0d-4df2-4603-b7b9-39a1a6ceabdd
Nov 05 19:21:01 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:01 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ddb07259-b44d-49a2-956c-8a664024e977 tempest-VolumesGetTest-2098101542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0cad2e0d-4df2-4603-b7b9-39a1a6ceabdd" returned: 0 in 0.582s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ddb07259-b44d-49a2-956c-8a664024e977 tempest-VolumesGetTest-2098101542 None] Lock "cinder-quobyte-0cad2e0d-4df2-4603-b7b9-39a1a6ceabdd" released by "delete_volume" :: held 1.584s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:21:01 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-ddb07259-b44d-49a2-956c-8a664024e977 tempest-VolumesGetTest-2098101542 None] Created reservations ['c58433de-b429-4975-982f-ffb2a2c2d9c6', '2cb02297-1488-4903-a4de-0b9a06ca2282', 'a6205ab2-4932-4209-b47b-96e53ea07b91', '6fc55b03-d640-4e6f-85c8-0e2000ae017e'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:21:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ddb07259-b44d-49a2-956c-8a664024e977 tempest-VolumesGetTest-2098101542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:21:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ddb07259-b44d-49a2-956c-8a664024e977 tempest-VolumesGetTest-2098101542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:21:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ddb07259-b44d-49a2-956c-8a664024e977 tempest-VolumesGetTest-2098101542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:21:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ddb07259-b44d-49a2-956c-8a664024e977 tempest-VolumesGetTest-2098101542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:21:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ddb07259-b44d-49a2-956c-8a664024e977 tempest-VolumesGetTest-2098101542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:21:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ddb07259-b44d-49a2-956c-8a664024e977 tempest-VolumesGetTest-2098101542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:02 devstack sudo[101330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:21:02 devstack sudo[101330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:02 devstack sudo[101330]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ddb07259-b44d-49a2-956c-8a664024e977 tempest-VolumesGetTest-2098101542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.868s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:02 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-ddb07259-b44d-49a2-956c-8a664024e977 tempest-VolumesGetTest-2098101542 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:21:02 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-ddb07259-b44d-49a2-956c-8a664024e977 tempest-VolumesGetTest-2098101542 None] Deleted volume successfully.
Nov 05 19:21:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ddb07259-b44d-49a2-956c-8a664024e977 tempest-VolumesGetTest-2098101542 None] Lock "cinder-0cad2e0d-4df2-4603-b7b9-39a1a6ceabdd-delete_volume" released by "delete_volume" :: held 3.105s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:21:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:21:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:21:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:21:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:21:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:21:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:21:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:05 devstack sudo[101335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:21:05 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:05 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.500s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:05 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:21:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:21:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread count: 28 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 19:21:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread info: [<_MainThread(MainThread, started 126882883072128)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126882770872512)>, <Thread(Thread-3 (stat_writer), started daemon 126882769837376)>, <Thread(Rabbit-heartbeat, started daemon 126882768896256)>, <Thread(Thread-5 (_runner), started daemon 126882768980928)>, <Thread(Thread-7 (_runner), started daemon 126882767016448)>, <Thread(fd_logger, started daemon 126882764561216)>, <Thread(privsep_reader, started daemon 126882764568576)>, <Thread(tpool_thread_0, started daemon 126882759292608)>, <Thread(tpool_thread_1, started daemon 126882750899904)>, <Thread(tpool_thread_2, started daemon 126882742507200)>, <Thread(tpool_thread_3, started daemon 126882734114496)>, <Thread(tpool_thread_4, started daemon 126882725721792)>, <Thread(tpool_thread_5, started daemon 126882717329088)>, <Thread(tpool_thread_6, started daemon 126882708920000)>, <Thread(tpool_thread_7, started daemon 126882700510912)>, <Thread(tpool_thread_8, started daemon 126882692101824)>, <Thread(tpool_thread_9, started daemon 126882683692736)>, <Thread(tpool_thread_10, started daemon 126882675283648)>, <Thread(tpool_thread_11, started daemon 126882666874560)>, <Thread(tpool_thread_12, started daemon 126882658465472)>, <Thread(tpool_thread_13, started daemon 126882650056384)>, <Thread(tpool_thread_14, started daemon 126882641647296)>, <Thread(tpool_thread_15, started daemon 126882633238208)>, <Thread(tpool_thread_16, started daemon 126882624829120)>, <Thread(tpool_thread_17, started daemon 126882616420032)>, <Thread(tpool_thread_18, started daemon 126882608010944)>, <Thread(tpool_thread_19, started daemon 126882599601856)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 19:21:11 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=68,cinder:UPDATE=69,cinder:INSERT=31,cinder:DELETE=8 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:21:12 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:UPDATE=75,cinder:INSERT=32,cinder:DELETE=5,cinder:SELECT=79 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:21:15 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-f02d6b94-36e6-4539-af40-b7b967e3bd82 tempest-VolumesListTestJSON-614398041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:21:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f02d6b94-36e6-4539-af40-b7b967e3bd82 tempest-VolumesListTestJSON-614398041 None] Flow 'volume_create_manager' (0fcd6b9e-2a08-4bdb-ae9d-031c2315a945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:21:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f02d6b94-36e6-4539-af40-b7b967e3bd82 tempest-VolumesListTestJSON-614398041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (304bb3c4-8a0a-418c-b755-da5a07005405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:21:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f02d6b94-36e6-4539-af40-b7b967e3bd82 tempest-VolumesListTestJSON-614398041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (304bb3c4-8a0a-418c-b755-da5a07005405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2074346750',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=456fd304-d600-4e45-a020-f48435da1386,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1c645fde5f8249f9bd0833f765f08700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:21:16Z,use_quota=True,user_id='863b5ea9c66040118b192d111c6d8e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:21:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f02d6b94-36e6-4539-af40-b7b967e3bd82 tempest-VolumesListTestJSON-614398041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b5d784b-c563-41d8-9d81-f98b96a3113b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:21:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f02d6b94-36e6-4539-af40-b7b967e3bd82 tempest-VolumesListTestJSON-614398041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b5d784b-c563-41d8-9d81-f98b96a3113b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:21:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f02d6b94-36e6-4539-af40-b7b967e3bd82 tempest-VolumesListTestJSON-614398041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1c0859a-9131-4cc4-b30f-d017b53d1619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:21:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f02d6b94-36e6-4539-af40-b7b967e3bd82 tempest-VolumesListTestJSON-614398041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1c0859a-9131-4cc4-b30f-d017b53d1619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '456fd304-d600-4e45-a020-f48435da1386', 'volume_name': 'volume-456fd304-d600-4e45-a020-f48435da1386', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:21:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f02d6b94-36e6-4539-af40-b7b967e3bd82 tempest-VolumesListTestJSON-614398041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6519eea-a127-47b9-9d07-5fcb3a5e8c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:21:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f02d6b94-36e6-4539-af40-b7b967e3bd82 tempest-VolumesListTestJSON-614398041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6519eea-a127-47b9-9d07-5fcb3a5e8c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:21:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f02d6b94-36e6-4539-af40-b7b967e3bd82 tempest-VolumesListTestJSON-614398041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66893f08-71cd-4595-bc9d-c7539488bafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:21:16 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-f02d6b94-36e6-4539-af40-b7b967e3bd82 tempest-VolumesListTestJSON-614398041 None] Volume 456fd304-d600-4e45-a020-f48435da1386: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-456fd304-d600-4e45-a020-f48435da1386', 'volume_size': 1}
Nov 05 19:21:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f02d6b94-36e6-4539-af40-b7b967e3bd82 tempest-VolumesListTestJSON-614398041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:21:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f02d6b94-36e6-4539-af40-b7b967e3bd82 tempest-VolumesListTestJSON-614398041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:21:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f02d6b94-36e6-4539-af40-b7b967e3bd82 tempest-VolumesListTestJSON-614398041 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2074346750',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=456fd304-d600-4e45-a020-f48435da1386,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1c645fde5f8249f9bd0833f765f08700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:21:16Z,use_quota=True,user_id='863b5ea9c66040118b192d111c6d8e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:21:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-f02d6b94-36e6-4539-af40-b7b967e3bd82 tempest-VolumesListTestJSON-614398041 None] Creating volume 456fd304-d600-4e45-a020-f48435da1386 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:21:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f02d6b94-36e6-4539-af40-b7b967e3bd82 tempest-VolumesListTestJSON-614398041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:21:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f02d6b94-36e6-4539-af40-b7b967e3bd82 tempest-VolumesListTestJSON-614398041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:21:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f02d6b94-36e6-4539-af40-b7b967e3bd82 tempest-VolumesListTestJSON-614398041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:21:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f02d6b94-36e6-4539-af40-b7b967e3bd82 tempest-VolumesListTestJSON-614398041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:21:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f02d6b94-36e6-4539-af40-b7b967e3bd82 tempest-VolumesListTestJSON-614398041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:21:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f02d6b94-36e6-4539-af40-b7b967e3bd82 tempest-VolumesListTestJSON-614398041 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:21:16 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-f02d6b94-36e6-4539-af40-b7b967e3bd82 tempest-VolumesListTestJSON-614398041 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:21:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f02d6b94-36e6-4539-af40-b7b967e3bd82 tempest-VolumesListTestJSON-614398041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-456fd304-d600-4e45-a020-f48435da1386 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:16 devstack sudo[101343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-456fd304-d600-4e45-a020-f48435da1386 1073741824
Nov 05 19:21:16 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:16 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f02d6b94-36e6-4539-af40-b7b967e3bd82 tempest-VolumesListTestJSON-614398041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-456fd304-d600-4e45-a020-f48435da1386 1073741824" returned: 0 in 0.462s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f02d6b94-36e6-4539-af40-b7b967e3bd82 tempest-VolumesListTestJSON-614398041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-456fd304-d600-4e45-a020-f48435da1386 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:16 devstack sudo[101372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-456fd304-d600-4e45-a020-f48435da1386
Nov 05 19:21:16 devstack sudo[101372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:16 devstack sudo[101372]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f02d6b94-36e6-4539-af40-b7b967e3bd82 tempest-VolumesListTestJSON-614398041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-456fd304-d600-4e45-a020-f48435da1386" returned: 0 in 0.268s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f02d6b94-36e6-4539-af40-b7b967e3bd82 tempest-VolumesListTestJSON-614398041 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:21:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f02d6b94-36e6-4539-af40-b7b967e3bd82 tempest-VolumesListTestJSON-614398041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:21:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f02d6b94-36e6-4539-af40-b7b967e3bd82 tempest-VolumesListTestJSON-614398041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66893f08-71cd-4595-bc9d-c7539488bafa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-456fd304-d600-4e45-a020-f48435da1386', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:21:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f02d6b94-36e6-4539-af40-b7b967e3bd82 tempest-VolumesListTestJSON-614398041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0c5e65e-e82b-4403-b926-21e00abe1779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:21:16 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-f02d6b94-36e6-4539-af40-b7b967e3bd82 tempest-VolumesListTestJSON-614398041 None] Volume volume-456fd304-d600-4e45-a020-f48435da1386 (456fd304-d600-4e45-a020-f48435da1386): created successfully
Nov 05 19:21:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f02d6b94-36e6-4539-af40-b7b967e3bd82 tempest-VolumesListTestJSON-614398041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0c5e65e-e82b-4403-b926-21e00abe1779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:21:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f02d6b94-36e6-4539-af40-b7b967e3bd82 tempest-VolumesListTestJSON-614398041 None] Flow 'volume_create_manager' (0fcd6b9e-2a08-4bdb-ae9d-031c2315a945) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:21:16 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f02d6b94-36e6-4539-af40-b7b967e3bd82 tempest-VolumesListTestJSON-614398041 None] Created volume successfully.
Nov 05 19:21:18 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-92f5d4dc-7a47-426b-aced-1dfa1b86f872 tempest-VolumesListTestJSON-614398041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:21:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-92f5d4dc-7a47-426b-aced-1dfa1b86f872 tempest-VolumesListTestJSON-614398041 None] Flow 'volume_create_manager' (3cbbedac-365a-480c-ab73-219b13f7cfea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:21:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-92f5d4dc-7a47-426b-aced-1dfa1b86f872 tempest-VolumesListTestJSON-614398041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f407667a-4670-4bc7-a400-92203e5138e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:21:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-92f5d4dc-7a47-426b-aced-1dfa1b86f872 tempest-VolumesListTestJSON-614398041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f407667a-4670-4bc7-a400-92203e5138e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1145279457',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3155779-2f14-4774-96de-e976986b80fa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1c645fde5f8249f9bd0833f765f08700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:21:19Z,use_quota=True,user_id='863b5ea9c66040118b192d111c6d8e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:21:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-92f5d4dc-7a47-426b-aced-1dfa1b86f872 tempest-VolumesListTestJSON-614398041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (478565e0-48b1-43f5-84e7-534cfa962663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:21:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-92f5d4dc-7a47-426b-aced-1dfa1b86f872 tempest-VolumesListTestJSON-614398041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (478565e0-48b1-43f5-84e7-534cfa962663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:21:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-92f5d4dc-7a47-426b-aced-1dfa1b86f872 tempest-VolumesListTestJSON-614398041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56214599-64e2-4ea0-b767-af07177b4c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:21:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-92f5d4dc-7a47-426b-aced-1dfa1b86f872 tempest-VolumesListTestJSON-614398041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56214599-64e2-4ea0-b767-af07177b4c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3155779-2f14-4774-96de-e976986b80fa', 'volume_name': 'volume-b3155779-2f14-4774-96de-e976986b80fa', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:21:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-92f5d4dc-7a47-426b-aced-1dfa1b86f872 tempest-VolumesListTestJSON-614398041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27222032-273b-47a4-9b4c-8c193edf0492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:21:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-92f5d4dc-7a47-426b-aced-1dfa1b86f872 tempest-VolumesListTestJSON-614398041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27222032-273b-47a4-9b4c-8c193edf0492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:21:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-92f5d4dc-7a47-426b-aced-1dfa1b86f872 tempest-VolumesListTestJSON-614398041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2530f972-9ff6-4d72-a13a-a847698ecdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:21:18 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-92f5d4dc-7a47-426b-aced-1dfa1b86f872 tempest-VolumesListTestJSON-614398041 None] Volume b3155779-2f14-4774-96de-e976986b80fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3155779-2f14-4774-96de-e976986b80fa', 'volume_size': 1}
Nov 05 19:21:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-92f5d4dc-7a47-426b-aced-1dfa1b86f872 tempest-VolumesListTestJSON-614398041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:21:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-92f5d4dc-7a47-426b-aced-1dfa1b86f872 tempest-VolumesListTestJSON-614398041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:21:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-92f5d4dc-7a47-426b-aced-1dfa1b86f872 tempest-VolumesListTestJSON-614398041 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1145279457',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3155779-2f14-4774-96de-e976986b80fa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1c645fde5f8249f9bd0833f765f08700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:21:19Z,use_quota=True,user_id='863b5ea9c66040118b192d111c6d8e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:21:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-92f5d4dc-7a47-426b-aced-1dfa1b86f872 tempest-VolumesListTestJSON-614398041 None] Creating volume b3155779-2f14-4774-96de-e976986b80fa {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:21:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-92f5d4dc-7a47-426b-aced-1dfa1b86f872 tempest-VolumesListTestJSON-614398041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:21:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-92f5d4dc-7a47-426b-aced-1dfa1b86f872 tempest-VolumesListTestJSON-614398041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:21:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-92f5d4dc-7a47-426b-aced-1dfa1b86f872 tempest-VolumesListTestJSON-614398041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:21:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-92f5d4dc-7a47-426b-aced-1dfa1b86f872 tempest-VolumesListTestJSON-614398041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:21:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-92f5d4dc-7a47-426b-aced-1dfa1b86f872 tempest-VolumesListTestJSON-614398041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:21:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-92f5d4dc-7a47-426b-aced-1dfa1b86f872 tempest-VolumesListTestJSON-614398041 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:21:18 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-92f5d4dc-7a47-426b-aced-1dfa1b86f872 tempest-VolumesListTestJSON-614398041 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:21:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-92f5d4dc-7a47-426b-aced-1dfa1b86f872 tempest-VolumesListTestJSON-614398041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b3155779-2f14-4774-96de-e976986b80fa 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:18 devstack sudo[101381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b3155779-2f14-4774-96de-e976986b80fa 1073741824
Nov 05 19:21:18 devstack sudo[101381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:19 devstack sudo[101381]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-92f5d4dc-7a47-426b-aced-1dfa1b86f872 tempest-VolumesListTestJSON-614398041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b3155779-2f14-4774-96de-e976986b80fa 1073741824" returned: 0 in 0.556s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-92f5d4dc-7a47-426b-aced-1dfa1b86f872 tempest-VolumesListTestJSON-614398041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b3155779-2f14-4774-96de-e976986b80fa {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:19 devstack sudo[101398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b3155779-2f14-4774-96de-e976986b80fa
Nov 05 19:21:19 devstack sudo[101398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:19 devstack sudo[101398]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-92f5d4dc-7a47-426b-aced-1dfa1b86f872 tempest-VolumesListTestJSON-614398041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b3155779-2f14-4774-96de-e976986b80fa" returned: 0 in 0.293s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-92f5d4dc-7a47-426b-aced-1dfa1b86f872 tempest-VolumesListTestJSON-614398041 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:21:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-92f5d4dc-7a47-426b-aced-1dfa1b86f872 tempest-VolumesListTestJSON-614398041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:21:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-92f5d4dc-7a47-426b-aced-1dfa1b86f872 tempest-VolumesListTestJSON-614398041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2530f972-9ff6-4d72-a13a-a847698ecdab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3155779-2f14-4774-96de-e976986b80fa', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:21:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-92f5d4dc-7a47-426b-aced-1dfa1b86f872 tempest-VolumesListTestJSON-614398041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ca3581d-82d8-49d6-9e75-172db2e53b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:21:19 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-92f5d4dc-7a47-426b-aced-1dfa1b86f872 tempest-VolumesListTestJSON-614398041 None] Volume volume-b3155779-2f14-4774-96de-e976986b80fa (b3155779-2f14-4774-96de-e976986b80fa): created successfully
Nov 05 19:21:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-92f5d4dc-7a47-426b-aced-1dfa1b86f872 tempest-VolumesListTestJSON-614398041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ca3581d-82d8-49d6-9e75-172db2e53b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:21:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-92f5d4dc-7a47-426b-aced-1dfa1b86f872 tempest-VolumesListTestJSON-614398041 None] Flow 'volume_create_manager' (3cbbedac-365a-480c-ab73-219b13f7cfea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:21:19 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-92f5d4dc-7a47-426b-aced-1dfa1b86f872 tempest-VolumesListTestJSON-614398041 None] Created volume successfully.
Nov 05 19:21:21 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-e15c5436-0ed0-454a-bcdb-48d77b63948a tempest-VolumesListTestJSON-614398041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:21:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e15c5436-0ed0-454a-bcdb-48d77b63948a tempest-VolumesListTestJSON-614398041 None] Flow 'volume_create_manager' (b5ca5577-a433-4371-99c3-34ba94972449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:21:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e15c5436-0ed0-454a-bcdb-48d77b63948a tempest-VolumesListTestJSON-614398041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (967298ca-fade-421e-9974-1f22157e3fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:21:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e15c5436-0ed0-454a-bcdb-48d77b63948a tempest-VolumesListTestJSON-614398041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (967298ca-fade-421e-9974-1f22157e3fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-388013184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f08e589-72d3-45f5-b84e-7f310c14c06c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1c645fde5f8249f9bd0833f765f08700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:21:21Z,use_quota=True,user_id='863b5ea9c66040118b192d111c6d8e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:21:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e15c5436-0ed0-454a-bcdb-48d77b63948a tempest-VolumesListTestJSON-614398041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cba1ad9a-af6c-41d8-8ec6-736cd67fa9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:21:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e15c5436-0ed0-454a-bcdb-48d77b63948a tempest-VolumesListTestJSON-614398041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cba1ad9a-af6c-41d8-8ec6-736cd67fa9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:21:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e15c5436-0ed0-454a-bcdb-48d77b63948a tempest-VolumesListTestJSON-614398041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05e7727b-ec0e-4446-a05a-0719ffd53f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:21:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e15c5436-0ed0-454a-bcdb-48d77b63948a tempest-VolumesListTestJSON-614398041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05e7727b-ec0e-4446-a05a-0719ffd53f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f08e589-72d3-45f5-b84e-7f310c14c06c', 'volume_name': 'volume-0f08e589-72d3-45f5-b84e-7f310c14c06c', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:21:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e15c5436-0ed0-454a-bcdb-48d77b63948a tempest-VolumesListTestJSON-614398041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4994fbf9-320c-435d-9b15-c7db3f8fae6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:21:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e15c5436-0ed0-454a-bcdb-48d77b63948a tempest-VolumesListTestJSON-614398041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4994fbf9-320c-435d-9b15-c7db3f8fae6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:21:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e15c5436-0ed0-454a-bcdb-48d77b63948a tempest-VolumesListTestJSON-614398041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63774703-6297-48ef-8ec1-7c0eab886cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:21:21 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-e15c5436-0ed0-454a-bcdb-48d77b63948a tempest-VolumesListTestJSON-614398041 None] Volume 0f08e589-72d3-45f5-b84e-7f310c14c06c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f08e589-72d3-45f5-b84e-7f310c14c06c', 'volume_size': 1}
Nov 05 19:21:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e15c5436-0ed0-454a-bcdb-48d77b63948a tempest-VolumesListTestJSON-614398041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:21:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e15c5436-0ed0-454a-bcdb-48d77b63948a tempest-VolumesListTestJSON-614398041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:21:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e15c5436-0ed0-454a-bcdb-48d77b63948a tempest-VolumesListTestJSON-614398041 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-388013184',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f08e589-72d3-45f5-b84e-7f310c14c06c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1c645fde5f8249f9bd0833f765f08700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:21:21Z,use_quota=True,user_id='863b5ea9c66040118b192d111c6d8e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:21:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-e15c5436-0ed0-454a-bcdb-48d77b63948a tempest-VolumesListTestJSON-614398041 None] Creating volume 0f08e589-72d3-45f5-b84e-7f310c14c06c {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:21:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e15c5436-0ed0-454a-bcdb-48d77b63948a tempest-VolumesListTestJSON-614398041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:21:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e15c5436-0ed0-454a-bcdb-48d77b63948a tempest-VolumesListTestJSON-614398041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:21:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e15c5436-0ed0-454a-bcdb-48d77b63948a tempest-VolumesListTestJSON-614398041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:21:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e15c5436-0ed0-454a-bcdb-48d77b63948a tempest-VolumesListTestJSON-614398041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:21:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e15c5436-0ed0-454a-bcdb-48d77b63948a tempest-VolumesListTestJSON-614398041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:21:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e15c5436-0ed0-454a-bcdb-48d77b63948a tempest-VolumesListTestJSON-614398041 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:21:21 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-e15c5436-0ed0-454a-bcdb-48d77b63948a tempest-VolumesListTestJSON-614398041 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:21:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e15c5436-0ed0-454a-bcdb-48d77b63948a tempest-VolumesListTestJSON-614398041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0f08e589-72d3-45f5-b84e-7f310c14c06c 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:21 devstack sudo[101401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0f08e589-72d3-45f5-b84e-7f310c14c06c 1073741824
Nov 05 19:21:21 devstack sudo[101401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:21 devstack sudo[101401]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e15c5436-0ed0-454a-bcdb-48d77b63948a tempest-VolumesListTestJSON-614398041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0f08e589-72d3-45f5-b84e-7f310c14c06c 1073741824" returned: 0 in 0.402s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e15c5436-0ed0-454a-bcdb-48d77b63948a tempest-VolumesListTestJSON-614398041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0f08e589-72d3-45f5-b84e-7f310c14c06c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:21 devstack sudo[101407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0f08e589-72d3-45f5-b84e-7f310c14c06c
Nov 05 19:21:21 devstack sudo[101407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:22 devstack sudo[101407]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e15c5436-0ed0-454a-bcdb-48d77b63948a tempest-VolumesListTestJSON-614398041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0f08e589-72d3-45f5-b84e-7f310c14c06c" returned: 0 in 0.241s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e15c5436-0ed0-454a-bcdb-48d77b63948a tempest-VolumesListTestJSON-614398041 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:21:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e15c5436-0ed0-454a-bcdb-48d77b63948a tempest-VolumesListTestJSON-614398041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:21:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e15c5436-0ed0-454a-bcdb-48d77b63948a tempest-VolumesListTestJSON-614398041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63774703-6297-48ef-8ec1-7c0eab886cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f08e589-72d3-45f5-b84e-7f310c14c06c', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:21:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e15c5436-0ed0-454a-bcdb-48d77b63948a tempest-VolumesListTestJSON-614398041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (413ea759-616e-458d-be38-c9b8e9528892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:21:22 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-e15c5436-0ed0-454a-bcdb-48d77b63948a tempest-VolumesListTestJSON-614398041 None] Volume volume-0f08e589-72d3-45f5-b84e-7f310c14c06c (0f08e589-72d3-45f5-b84e-7f310c14c06c): created successfully
Nov 05 19:21:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e15c5436-0ed0-454a-bcdb-48d77b63948a tempest-VolumesListTestJSON-614398041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (413ea759-616e-458d-be38-c9b8e9528892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:21:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e15c5436-0ed0-454a-bcdb-48d77b63948a tempest-VolumesListTestJSON-614398041 None] Flow 'volume_create_manager' (b5ca5577-a433-4371-99c3-34ba94972449) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:21:22 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-e15c5436-0ed0-454a-bcdb-48d77b63948a tempest-VolumesListTestJSON-614398041 None] Created volume successfully.
Nov 05 19:21:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9e8813ca-30e9-4a97-9b27-36e1e65022b5 tempest-VolumesListTestJSON-614398041 None] Acquiring lock "cinder-0f08e589-72d3-45f5-b84e-7f310c14c06c-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:21:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9e8813ca-30e9-4a97-9b27-36e1e65022b5 tempest-VolumesListTestJSON-614398041 None] Lock "cinder-0f08e589-72d3-45f5-b84e-7f310c14c06c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:21:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9e8813ca-30e9-4a97-9b27-36e1e65022b5 tempest-VolumesListTestJSON-614398041 None] Acquiring lock "cinder-quobyte-0f08e589-72d3-45f5-b84e-7f310c14c06c" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:21:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9e8813ca-30e9-4a97-9b27-36e1e65022b5 tempest-VolumesListTestJSON-614398041 None] Lock "cinder-quobyte-0f08e589-72d3-45f5-b84e-7f310c14c06c" acquired by "delete_volume" :: waited 0.016s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:21:24 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff566639-9a47-48cb-879e-31304f2ffc09]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:21:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9e8813ca-30e9-4a97-9b27-36e1e65022b5 tempest-VolumesListTestJSON-614398041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0f08e589-72d3-45f5-b84e-7f310c14c06c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:24 devstack sudo[101410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0f08e589-72d3-45f5-b84e-7f310c14c06c
Nov 05 19:21:24 devstack sudo[101410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:24 devstack sudo[101410]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9e8813ca-30e9-4a97-9b27-36e1e65022b5 tempest-VolumesListTestJSON-614398041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0f08e589-72d3-45f5-b84e-7f310c14c06c" returned: 0 in 0.363s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9e8813ca-30e9-4a97-9b27-36e1e65022b5 tempest-VolumesListTestJSON-614398041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0f08e589-72d3-45f5-b84e-7f310c14c06c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:24 devstack sudo[101415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0f08e589-72d3-45f5-b84e-7f310c14c06c
Nov 05 19:21:24 devstack sudo[101415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:24 devstack sudo[101415]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9e8813ca-30e9-4a97-9b27-36e1e65022b5 tempest-VolumesListTestJSON-614398041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0f08e589-72d3-45f5-b84e-7f310c14c06c" returned: 0 in 0.240s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9e8813ca-30e9-4a97-9b27-36e1e65022b5 tempest-VolumesListTestJSON-614398041 None] Lock "cinder-quobyte-0f08e589-72d3-45f5-b84e-7f310c14c06c" released by "delete_volume" :: held 0.645s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:21:24 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-9e8813ca-30e9-4a97-9b27-36e1e65022b5 tempest-VolumesListTestJSON-614398041 None] Created reservations ['3ca94e27-cfc1-4a4f-9c9c-08176cded36b', 'cde39eda-448e-4efd-8d24-6b7cfcf4e4ab', '0400801a-3bed-402e-95b9-8262d4343a9a', '767d9667-e142-4f73-86bc-49739ccdc5d3'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:21:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9e8813ca-30e9-4a97-9b27-36e1e65022b5 tempest-VolumesListTestJSON-614398041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:21:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9e8813ca-30e9-4a97-9b27-36e1e65022b5 tempest-VolumesListTestJSON-614398041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:21:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9e8813ca-30e9-4a97-9b27-36e1e65022b5 tempest-VolumesListTestJSON-614398041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:21:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9e8813ca-30e9-4a97-9b27-36e1e65022b5 tempest-VolumesListTestJSON-614398041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:21:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9e8813ca-30e9-4a97-9b27-36e1e65022b5 tempest-VolumesListTestJSON-614398041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:21:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9e8813ca-30e9-4a97-9b27-36e1e65022b5 tempest-VolumesListTestJSON-614398041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:25 devstack sudo[101418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:21:25 devstack sudo[101418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:25 devstack sudo[101418]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9e8813ca-30e9-4a97-9b27-36e1e65022b5 tempest-VolumesListTestJSON-614398041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.251s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:25 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-9e8813ca-30e9-4a97-9b27-36e1e65022b5 tempest-VolumesListTestJSON-614398041 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:21:25 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-9e8813ca-30e9-4a97-9b27-36e1e65022b5 tempest-VolumesListTestJSON-614398041 None] Deleted volume successfully.
Nov 05 19:21:25 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9e8813ca-30e9-4a97-9b27-36e1e65022b5 tempest-VolumesListTestJSON-614398041 None] Lock "cinder-0f08e589-72d3-45f5-b84e-7f310c14c06c-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:21:25 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d5357928-6dc1-4398-a2c2-c96b3f162958 tempest-VolumesListTestJSON-614398041 None] Acquiring lock "cinder-b3155779-2f14-4774-96de-e976986b80fa-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:21:25 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d5357928-6dc1-4398-a2c2-c96b3f162958 tempest-VolumesListTestJSON-614398041 None] Lock "cinder-b3155779-2f14-4774-96de-e976986b80fa-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:21:25 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d5357928-6dc1-4398-a2c2-c96b3f162958 tempest-VolumesListTestJSON-614398041 None] Acquiring lock "cinder-quobyte-b3155779-2f14-4774-96de-e976986b80fa" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:21:25 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d5357928-6dc1-4398-a2c2-c96b3f162958 tempest-VolumesListTestJSON-614398041 None] Lock "cinder-quobyte-b3155779-2f14-4774-96de-e976986b80fa" acquired by "delete_volume" :: waited 0.015s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:21:25 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b38d2aa-659e-481c-9847-8ee3ede76f49]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:21:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d5357928-6dc1-4398-a2c2-c96b3f162958 tempest-VolumesListTestJSON-614398041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b3155779-2f14-4774-96de-e976986b80fa {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:25 devstack sudo[101421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b3155779-2f14-4774-96de-e976986b80fa
Nov 05 19:21:25 devstack sudo[101421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:25 devstack sudo[101421]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d5357928-6dc1-4398-a2c2-c96b3f162958 tempest-VolumesListTestJSON-614398041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b3155779-2f14-4774-96de-e976986b80fa" returned: 0 in 0.386s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d5357928-6dc1-4398-a2c2-c96b3f162958 tempest-VolumesListTestJSON-614398041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b3155779-2f14-4774-96de-e976986b80fa {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:25 devstack sudo[101426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b3155779-2f14-4774-96de-e976986b80fa
Nov 05 19:21:25 devstack sudo[101426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:26 devstack sudo[101426]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d5357928-6dc1-4398-a2c2-c96b3f162958 tempest-VolumesListTestJSON-614398041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b3155779-2f14-4774-96de-e976986b80fa" returned: 0 in 0.263s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d5357928-6dc1-4398-a2c2-c96b3f162958 tempest-VolumesListTestJSON-614398041 None] Lock "cinder-quobyte-b3155779-2f14-4774-96de-e976986b80fa" released by "delete_volume" :: held 0.692s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:21:26 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-d5357928-6dc1-4398-a2c2-c96b3f162958 tempest-VolumesListTestJSON-614398041 None] Created reservations ['88ac0726-8574-48de-9f0a-49fef2a8ec84', '9a57aa48-26f2-46c9-8e14-b3242686de86', '2590ab3c-f8e6-421c-bdb3-8b4c214361cc', '4669d9f3-f48d-4c71-897a-0dc32a10fd9e'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:21:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d5357928-6dc1-4398-a2c2-c96b3f162958 tempest-VolumesListTestJSON-614398041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:21:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d5357928-6dc1-4398-a2c2-c96b3f162958 tempest-VolumesListTestJSON-614398041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:21:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d5357928-6dc1-4398-a2c2-c96b3f162958 tempest-VolumesListTestJSON-614398041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:21:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d5357928-6dc1-4398-a2c2-c96b3f162958 tempest-VolumesListTestJSON-614398041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:21:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d5357928-6dc1-4398-a2c2-c96b3f162958 tempest-VolumesListTestJSON-614398041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:21:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d5357928-6dc1-4398-a2c2-c96b3f162958 tempest-VolumesListTestJSON-614398041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:26 devstack sudo[101429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:21:26 devstack sudo[101429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:26 devstack sudo[101429]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d5357928-6dc1-4398-a2c2-c96b3f162958 tempest-VolumesListTestJSON-614398041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.268s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:26 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-d5357928-6dc1-4398-a2c2-c96b3f162958 tempest-VolumesListTestJSON-614398041 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:21:26 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-d5357928-6dc1-4398-a2c2-c96b3f162958 tempest-VolumesListTestJSON-614398041 None] Deleted volume successfully.
Nov 05 19:21:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d5357928-6dc1-4398-a2c2-c96b3f162958 tempest-VolumesListTestJSON-614398041 None] Lock "cinder-b3155779-2f14-4774-96de-e976986b80fa-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:21:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8c5d6320-64b0-4867-ac84-dba42766c284 tempest-VolumesListTestJSON-614398041 None] Acquiring lock "cinder-456fd304-d600-4e45-a020-f48435da1386-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:21:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8c5d6320-64b0-4867-ac84-dba42766c284 tempest-VolumesListTestJSON-614398041 None] Lock "cinder-456fd304-d600-4e45-a020-f48435da1386-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:21:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8c5d6320-64b0-4867-ac84-dba42766c284 tempest-VolumesListTestJSON-614398041 None] Acquiring lock "cinder-quobyte-456fd304-d600-4e45-a020-f48435da1386" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:21:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8c5d6320-64b0-4867-ac84-dba42766c284 tempest-VolumesListTestJSON-614398041 None] Lock "cinder-quobyte-456fd304-d600-4e45-a020-f48435da1386" acquired by "delete_volume" :: waited 0.017s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:21:26 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4beddeaa-7dce-4561-82fe-b2eea2dad6d5]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:21:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8c5d6320-64b0-4867-ac84-dba42766c284 tempest-VolumesListTestJSON-614398041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-456fd304-d600-4e45-a020-f48435da1386 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:26 devstack sudo[101432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-456fd304-d600-4e45-a020-f48435da1386
Nov 05 19:21:26 devstack sudo[101432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:27 devstack sudo[101432]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8c5d6320-64b0-4867-ac84-dba42766c284 tempest-VolumesListTestJSON-614398041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-456fd304-d600-4e45-a020-f48435da1386" returned: 0 in 0.364s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8c5d6320-64b0-4867-ac84-dba42766c284 tempest-VolumesListTestJSON-614398041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-456fd304-d600-4e45-a020-f48435da1386 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:27 devstack sudo[101438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-456fd304-d600-4e45-a020-f48435da1386
Nov 05 19:21:27 devstack sudo[101438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:27 devstack sudo[101438]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8c5d6320-64b0-4867-ac84-dba42766c284 tempest-VolumesListTestJSON-614398041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-456fd304-d600-4e45-a020-f48435da1386" returned: 0 in 0.272s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8c5d6320-64b0-4867-ac84-dba42766c284 tempest-VolumesListTestJSON-614398041 None] Lock "cinder-quobyte-456fd304-d600-4e45-a020-f48435da1386" released by "delete_volume" :: held 0.679s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:21:27 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-8c5d6320-64b0-4867-ac84-dba42766c284 tempest-VolumesListTestJSON-614398041 None] Created reservations ['2b5935de-8718-4cce-a92e-cd59629598cc', '08e464ec-c04a-42a6-8c2e-cc8467f5aa34', 'd4709424-9792-4a26-8a0b-3c640fad400b', '7202d964-969e-43d4-995c-fcc8be07bc15'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:21:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8c5d6320-64b0-4867-ac84-dba42766c284 tempest-VolumesListTestJSON-614398041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:21:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8c5d6320-64b0-4867-ac84-dba42766c284 tempest-VolumesListTestJSON-614398041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:21:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8c5d6320-64b0-4867-ac84-dba42766c284 tempest-VolumesListTestJSON-614398041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:21:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8c5d6320-64b0-4867-ac84-dba42766c284 tempest-VolumesListTestJSON-614398041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:21:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8c5d6320-64b0-4867-ac84-dba42766c284 tempest-VolumesListTestJSON-614398041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:21:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8c5d6320-64b0-4867-ac84-dba42766c284 tempest-VolumesListTestJSON-614398041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:27 devstack sudo[101442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:21:27 devstack sudo[101442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:27 devstack sudo[101442]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8c5d6320-64b0-4867-ac84-dba42766c284 tempest-VolumesListTestJSON-614398041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.261s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:27 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-8c5d6320-64b0-4867-ac84-dba42766c284 tempest-VolumesListTestJSON-614398041 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:21:27 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-8c5d6320-64b0-4867-ac84-dba42766c284 tempest-VolumesListTestJSON-614398041 None] Deleted volume successfully.
Nov 05 19:21:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8c5d6320-64b0-4867-ac84-dba42766c284 tempest-VolumesListTestJSON-614398041 None] Lock "cinder-456fd304-d600-4e45-a020-f48435da1386-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:21:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-a346e9f6-e646-41c8-9206-10ddf0016f35 req-615b07fd-c896-4367-aa0e-36ba26890037 tempest-TestInstancesWithCinderVolumes-180007272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:21:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-a346e9f6-e646-41c8-9206-10ddf0016f35 req-615b07fd-c896-4367-aa0e-36ba26890037 tempest-TestInstancesWithCinderVolumes-180007272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:21:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-a346e9f6-e646-41c8-9206-10ddf0016f35 req-615b07fd-c896-4367-aa0e-36ba26890037 tempest-TestInstancesWithCinderVolumes-180007272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:21:30 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-a346e9f6-e646-41c8-9206-10ddf0016f35 req-615b07fd-c896-4367-aa0e-36ba26890037 tempest-TestInstancesWithCinderVolumes-180007272 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec', 'name': 'volume-45317731-362b-4362-8feb-37e3ea1ca53c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '343bfb1c-974e-451b-a917-04c2921b8c3f', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 19:21:30 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-a346e9f6-e646-41c8-9206-10ddf0016f35 req-615b07fd-c896-4367-aa0e-36ba26890037 tempest-TestInstancesWithCinderVolumes-180007272 None] attachment_update completed successfully.
Nov 05 19:21:32 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b93168d-011f-4b47-9ed5-903acf371ccc tempest-VolumesSnapshotListTestJSON-319911770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:21:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4b93168d-011f-4b47-9ed5-903acf371ccc tempest-VolumesSnapshotListTestJSON-319911770 None] Flow 'volume_create_manager' (1b5a3ccc-a55d-4859-944e-a849537214bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:21:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4b93168d-011f-4b47-9ed5-903acf371ccc tempest-VolumesSnapshotListTestJSON-319911770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23303abc-7640-4aac-a3bb-6169333c3bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:21:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4b93168d-011f-4b47-9ed5-903acf371ccc tempest-VolumesSnapshotListTestJSON-319911770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23303abc-7640-4aac-a3bb-6169333c3bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-610722687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43337113-b9de-4335-b6d2-27dc92fdb6f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75a3af52fdb4506a3592f7f6d2ea48c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:21:33Z,use_quota=True,user_id='5029ee5902b34286897f6f3f06e37f77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:21:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4b93168d-011f-4b47-9ed5-903acf371ccc tempest-VolumesSnapshotListTestJSON-319911770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (befbc578-700d-4d06-be63-975c2ca5713d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:21:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4b93168d-011f-4b47-9ed5-903acf371ccc tempest-VolumesSnapshotListTestJSON-319911770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (befbc578-700d-4d06-be63-975c2ca5713d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:21:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4b93168d-011f-4b47-9ed5-903acf371ccc tempest-VolumesSnapshotListTestJSON-319911770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77967386-f812-48bd-b3c4-fdf86bdcf6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:21:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4b93168d-011f-4b47-9ed5-903acf371ccc tempest-VolumesSnapshotListTestJSON-319911770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77967386-f812-48bd-b3c4-fdf86bdcf6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43337113-b9de-4335-b6d2-27dc92fdb6f9', 'volume_name': 'volume-43337113-b9de-4335-b6d2-27dc92fdb6f9', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:21:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4b93168d-011f-4b47-9ed5-903acf371ccc tempest-VolumesSnapshotListTestJSON-319911770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (718cda1e-e92e-4003-acc0-75f2669d8191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:21:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4b93168d-011f-4b47-9ed5-903acf371ccc tempest-VolumesSnapshotListTestJSON-319911770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (718cda1e-e92e-4003-acc0-75f2669d8191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:21:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4b93168d-011f-4b47-9ed5-903acf371ccc tempest-VolumesSnapshotListTestJSON-319911770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e439372d-bcce-494a-ab7a-fe46f432bbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:21:32 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-4b93168d-011f-4b47-9ed5-903acf371ccc tempest-VolumesSnapshotListTestJSON-319911770 None] Volume 43337113-b9de-4335-b6d2-27dc92fdb6f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43337113-b9de-4335-b6d2-27dc92fdb6f9', 'volume_size': 1}
Nov 05 19:21:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4b93168d-011f-4b47-9ed5-903acf371ccc tempest-VolumesSnapshotListTestJSON-319911770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:21:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4b93168d-011f-4b47-9ed5-903acf371ccc tempest-VolumesSnapshotListTestJSON-319911770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:21:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4b93168d-011f-4b47-9ed5-903acf371ccc tempest-VolumesSnapshotListTestJSON-319911770 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-610722687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43337113-b9de-4335-b6d2-27dc92fdb6f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75a3af52fdb4506a3592f7f6d2ea48c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:21:33Z,use_quota=True,user_id='5029ee5902b34286897f6f3f06e37f77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:21:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-4b93168d-011f-4b47-9ed5-903acf371ccc tempest-VolumesSnapshotListTestJSON-319911770 None] Creating volume 43337113-b9de-4335-b6d2-27dc92fdb6f9 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:21:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4b93168d-011f-4b47-9ed5-903acf371ccc tempest-VolumesSnapshotListTestJSON-319911770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:21:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4b93168d-011f-4b47-9ed5-903acf371ccc tempest-VolumesSnapshotListTestJSON-319911770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:21:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4b93168d-011f-4b47-9ed5-903acf371ccc tempest-VolumesSnapshotListTestJSON-319911770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:21:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4b93168d-011f-4b47-9ed5-903acf371ccc tempest-VolumesSnapshotListTestJSON-319911770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:21:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4b93168d-011f-4b47-9ed5-903acf371ccc tempest-VolumesSnapshotListTestJSON-319911770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:21:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4b93168d-011f-4b47-9ed5-903acf371ccc tempest-VolumesSnapshotListTestJSON-319911770 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:21:32 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-4b93168d-011f-4b47-9ed5-903acf371ccc tempest-VolumesSnapshotListTestJSON-319911770 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:21:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4b93168d-011f-4b47-9ed5-903acf371ccc tempest-VolumesSnapshotListTestJSON-319911770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:32 devstack sudo[101503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9 1073741824
Nov 05 19:21:32 devstack sudo[101503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:33 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-6c3b01f3-7c53-48d2-9f04-f6e67f646ac6 req-d4cf638d-9f84-4512-b477-89f0bf5e32f8 tempest-TestShelveInstance-431802604 None] Terminate volume connection completed successfully.
Nov 05 19:21:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-6c3b01f3-7c53-48d2-9f04-f6e67f646ac6 req-d4cf638d-9f84-4512-b477-89f0bf5e32f8 tempest-TestShelveInstance-431802604 None] Deleting attachment 27042de1-13dd-40db-955a-53f384520630. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 19:21:33 devstack sudo[101503]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4b93168d-011f-4b47-9ed5-903acf371ccc tempest-VolumesSnapshotListTestJSON-319911770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9 1073741824" returned: 0 in 0.670s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4b93168d-011f-4b47-9ed5-903acf371ccc tempest-VolumesSnapshotListTestJSON-319911770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:33 devstack sudo[101522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9
Nov 05 19:21:33 devstack sudo[101522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-7168552e-68e2-40bb-b8fb-40bfd94a49f8 req-4fc809a3-5638-46e1-aea9-d238b42fb55d tempest-TestInstancesWithCinderVolumes-180007272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:21:33 devstack sudo[101522]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4b93168d-011f-4b47-9ed5-903acf371ccc tempest-VolumesSnapshotListTestJSON-319911770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9" returned: 0 in 0.262s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4b93168d-011f-4b47-9ed5-903acf371ccc tempest-VolumesSnapshotListTestJSON-319911770 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:21:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4b93168d-011f-4b47-9ed5-903acf371ccc tempest-VolumesSnapshotListTestJSON-319911770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:21:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-7168552e-68e2-40bb-b8fb-40bfd94a49f8 req-4fc809a3-5638-46e1-aea9-d238b42fb55d tempest-TestInstancesWithCinderVolumes-180007272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.215s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:21:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4b93168d-011f-4b47-9ed5-903acf371ccc tempest-VolumesSnapshotListTestJSON-319911770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e439372d-bcce-494a-ab7a-fe46f432bbe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43337113-b9de-4335-b6d2-27dc92fdb6f9', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:21:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4b93168d-011f-4b47-9ed5-903acf371ccc tempest-VolumesSnapshotListTestJSON-319911770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3de0cef2-7c98-47f0-8b79-0a0a4d8f6765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:21:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-7168552e-68e2-40bb-b8fb-40bfd94a49f8 req-4fc809a3-5638-46e1-aea9-d238b42fb55d tempest-TestInstancesWithCinderVolumes-180007272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:21:33 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-4b93168d-011f-4b47-9ed5-903acf371ccc tempest-VolumesSnapshotListTestJSON-319911770 None] Volume volume-43337113-b9de-4335-b6d2-27dc92fdb6f9 (43337113-b9de-4335-b6d2-27dc92fdb6f9): created successfully
Nov 05 19:21:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4b93168d-011f-4b47-9ed5-903acf371ccc tempest-VolumesSnapshotListTestJSON-319911770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3de0cef2-7c98-47f0-8b79-0a0a4d8f6765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:21:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4b93168d-011f-4b47-9ed5-903acf371ccc tempest-VolumesSnapshotListTestJSON-319911770 None] Flow 'volume_create_manager' (1b5a3ccc-a55d-4859-944e-a849537214bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:21:33 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-4b93168d-011f-4b47-9ed5-903acf371ccc tempest-VolumesSnapshotListTestJSON-319911770 None] Created volume successfully.
Nov 05 19:21:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-7168552e-68e2-40bb-b8fb-40bfd94a49f8 req-4fc809a3-5638-46e1-aea9-d238b42fb55d tempest-TestInstancesWithCinderVolumes-180007272 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec', 'name': 'volume-b0a21a9a-2804-4b20-98a1-fe03c6d22a98', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8c362c1a-e1eb-4ebe-a461-14411e03f686', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 19:21:33 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-7168552e-68e2-40bb-b8fb-40bfd94a49f8 req-4fc809a3-5638-46e1-aea9-d238b42fb55d tempest-TestInstancesWithCinderVolumes-180007272 None] attachment_update completed successfully.
Nov 05 19:21:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-aa55baea-e2f6-4f08-bae9-0710c607485c tempest-VolumesSnapshotListTestJSON-319911770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:21:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-aa55baea-e2f6-4f08-bae9-0710c607485c tempest-VolumesSnapshotListTestJSON-319911770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:21:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-aa55baea-e2f6-4f08-bae9-0710c607485c tempest-VolumesSnapshotListTestJSON-319911770 None] Creating offline snapshot b004748e-5a35-4ebc-aad0-7cb9ec9ee12a of volume 43337113-b9de-4335-b6d2-27dc92fdb6f9 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:21:35 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d73089a-1969-41e1-ac27-8896a4b8a652]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:21:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-aa55baea-e2f6-4f08-bae9-0710c607485c tempest-VolumesSnapshotListTestJSON-319911770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:35 devstack sudo[101528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9
Nov 05 19:21:35 devstack sudo[101528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:35 devstack sudo[101528]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-aa55baea-e2f6-4f08-bae9-0710c607485c tempest-VolumesSnapshotListTestJSON-319911770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9" returned: 0 in 0.403s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-aa55baea-e2f6-4f08-bae9-0710c607485c tempest-VolumesSnapshotListTestJSON-319911770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.b004748e-5a35-4ebc-aad0-7cb9ec9ee12a 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:35 devstack sudo[101535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.b004748e-5a35-4ebc-aad0-7cb9ec9ee12a 1G
Nov 05 19:21:35 devstack sudo[101535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:35 devstack sudo[101535]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-aa55baea-e2f6-4f08-bae9-0710c607485c tempest-VolumesSnapshotListTestJSON-319911770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.b004748e-5a35-4ebc-aad0-7cb9ec9ee12a 1G" returned: 0 in 0.493s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-aa55baea-e2f6-4f08-bae9-0710c607485c tempest-VolumesSnapshotListTestJSON-319911770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43337113-b9de-4335-b6d2-27dc92fdb6f9 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.b004748e-5a35-4ebc-aad0-7cb9ec9ee12a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:35 devstack sudo[101551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43337113-b9de-4335-b6d2-27dc92fdb6f9 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.b004748e-5a35-4ebc-aad0-7cb9ec9ee12a
Nov 05 19:21:35 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-e278906f-6d2b-4bbb-ad03-304749e7a3b0 req-4480dff6-7c13-4b85-ba72-617037662428 tempest-TestShelveInstance-431802604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:21:36 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-aa55baea-e2f6-4f08-bae9-0710c607485c tempest-VolumesSnapshotListTestJSON-319911770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43337113-b9de-4335-b6d2-27dc92fdb6f9 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.b004748e-5a35-4ebc-aad0-7cb9ec9ee12a" returned: 0 in 0.333s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:36 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-aa55baea-e2f6-4f08-bae9-0710c607485c tempest-VolumesSnapshotListTestJSON-319911770 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.b004748e-5a35-4ebc-aad0-7cb9ec9ee12a is being set with open permissions: ugo+rw
Nov 05 19:21:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-aa55baea-e2f6-4f08-bae9-0710c607485c tempest-VolumesSnapshotListTestJSON-319911770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.b004748e-5a35-4ebc-aad0-7cb9ec9ee12a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:36 devstack sudo[101564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.b004748e-5a35-4ebc-aad0-7cb9ec9ee12a
Nov 05 19:21:36 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:36 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-aa55baea-e2f6-4f08-bae9-0710c607485c tempest-VolumesSnapshotListTestJSON-319911770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.b004748e-5a35-4ebc-aad0-7cb9ec9ee12a" returned: 0 in 0.278s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-aa55baea-e2f6-4f08-bae9-0710c607485c tempest-VolumesSnapshotListTestJSON-319911770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:36 devstack sudo[101567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.info
Nov 05 19:21:36 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:36 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-aa55baea-e2f6-4f08-bae9-0710c607485c tempest-VolumesSnapshotListTestJSON-319911770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.info" returned: 0 in 0.253s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:36 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-aa55baea-e2f6-4f08-bae9-0710c607485c tempest-VolumesSnapshotListTestJSON-319911770 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.info is being set with open permissions: ugo+rw
Nov 05 19:21:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-aa55baea-e2f6-4f08-bae9-0710c607485c tempest-VolumesSnapshotListTestJSON-319911770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:36 devstack sudo[101570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.info
Nov 05 19:21:36 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:37 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-aa55baea-e2f6-4f08-bae9-0710c607485c tempest-VolumesSnapshotListTestJSON-319911770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.info" returned: 0 in 0.242s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-aa55baea-e2f6-4f08-bae9-0710c607485c tempest-VolumesSnapshotListTestJSON-319911770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.109s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:21:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-e278906f-6d2b-4bbb-ad03-304749e7a3b0 req-4480dff6-7c13-4b85-ba72-617037662428 tempest-TestShelveInstance-431802604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.877s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:21:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-e278906f-6d2b-4bbb-ad03-304749e7a3b0 req-4480dff6-7c13-4b85-ba72-617037662428 tempest-TestShelveInstance-431802604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:21:37 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-aa55baea-e2f6-4f08-bae9-0710c607485c tempest-VolumesSnapshotListTestJSON-319911770 None] Create snapshot completed successfully
Nov 05 19:21:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-e278906f-6d2b-4bbb-ad03-304749e7a3b0 req-4480dff6-7c13-4b85-ba72-617037662428 tempest-TestShelveInstance-431802604 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec', 'name': 'volume-5f353428-8629-4c58-8d0a-58c0ea9574ef', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9dcd736e-66b6-4afd-b817-f799aa37bc5f', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 19:21:37 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-e278906f-6d2b-4bbb-ad03-304749e7a3b0 req-4480dff6-7c13-4b85-ba72-617037662428 tempest-TestShelveInstance-431802604 None] attachment_update completed successfully.
Nov 05 19:21:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bbd3a2d0-41c1-4ac8-bc28-7aec2dd7b507 tempest-VolumesSnapshotListTestJSON-319911770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:21:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bbd3a2d0-41c1-4ac8-bc28-7aec2dd7b507 tempest-VolumesSnapshotListTestJSON-319911770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:21:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-bbd3a2d0-41c1-4ac8-bc28-7aec2dd7b507 tempest-VolumesSnapshotListTestJSON-319911770 None] Creating offline snapshot 4dc15711-86b3-441b-9746-6a391e08f1d7 of volume 43337113-b9de-4335-b6d2-27dc92fdb6f9 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:21:38 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a552ee3-0249-4acb-8b66-5e5e3e4f828a]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:21:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bbd3a2d0-41c1-4ac8-bc28-7aec2dd7b507 tempest-VolumesSnapshotListTestJSON-319911770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.b004748e-5a35-4ebc-aad0-7cb9ec9ee12a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:38 devstack sudo[101587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.b004748e-5a35-4ebc-aad0-7cb9ec9ee12a
Nov 05 19:21:38 devstack sudo[101587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:38 devstack sudo[101587]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bbd3a2d0-41c1-4ac8-bc28-7aec2dd7b507 tempest-VolumesSnapshotListTestJSON-319911770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.b004748e-5a35-4ebc-aad0-7cb9ec9ee12a" returned: 0 in 0.436s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-bbd3a2d0-41c1-4ac8-bc28-7aec2dd7b507 tempest-VolumesSnapshotListTestJSON-319911770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43337113-b9de-4335-b6d2-27dc92fdb6f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:21:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bbd3a2d0-41c1-4ac8-bc28-7aec2dd7b507 tempest-VolumesSnapshotListTestJSON-319911770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.b004748e-5a35-4ebc-aad0-7cb9ec9ee12a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.4dc15711-86b3-441b-9746-6a391e08f1d7 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:38 devstack sudo[101609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.b004748e-5a35-4ebc-aad0-7cb9ec9ee12a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.4dc15711-86b3-441b-9746-6a391e08f1d7 1G
Nov 05 19:21:38 devstack sudo[101609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:39 devstack sudo[101609]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bbd3a2d0-41c1-4ac8-bc28-7aec2dd7b507 tempest-VolumesSnapshotListTestJSON-319911770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.b004748e-5a35-4ebc-aad0-7cb9ec9ee12a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.4dc15711-86b3-441b-9746-6a391e08f1d7 1G" returned: 0 in 0.596s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bbd3a2d0-41c1-4ac8-bc28-7aec2dd7b507 tempest-VolumesSnapshotListTestJSON-319911770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.b004748e-5a35-4ebc-aad0-7cb9ec9ee12a -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.4dc15711-86b3-441b-9746-6a391e08f1d7 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:39 devstack sudo[101615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.b004748e-5a35-4ebc-aad0-7cb9ec9ee12a -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.4dc15711-86b3-441b-9746-6a391e08f1d7
Nov 05 19:21:39 devstack sudo[101615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:39 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-2b9d05f3-7cde-4814-b661-a496e6fa2230 req-cae7384b-143b-4e1a-81aa-ef75dfe496de tempest-TestInstancesWithCinderVolumes-180007272 None] Terminate volume connection completed successfully.
Nov 05 19:21:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-2b9d05f3-7cde-4814-b661-a496e6fa2230 req-cae7384b-143b-4e1a-81aa-ef75dfe496de tempest-TestInstancesWithCinderVolumes-180007272 None] Deleting attachment 343bfb1c-974e-451b-a917-04c2921b8c3f. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 19:21:39 devstack sudo[101615]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bbd3a2d0-41c1-4ac8-bc28-7aec2dd7b507 tempest-VolumesSnapshotListTestJSON-319911770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.b004748e-5a35-4ebc-aad0-7cb9ec9ee12a -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.4dc15711-86b3-441b-9746-6a391e08f1d7" returned: 0 in 0.481s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:39 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-bbd3a2d0-41c1-4ac8-bc28-7aec2dd7b507 tempest-VolumesSnapshotListTestJSON-319911770 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.4dc15711-86b3-441b-9746-6a391e08f1d7 is being set with open permissions: ugo+rw
Nov 05 19:21:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bbd3a2d0-41c1-4ac8-bc28-7aec2dd7b507 tempest-VolumesSnapshotListTestJSON-319911770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.4dc15711-86b3-441b-9746-6a391e08f1d7 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:40 devstack sudo[101634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.4dc15711-86b3-441b-9746-6a391e08f1d7
Nov 05 19:21:40 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:40 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bbd3a2d0-41c1-4ac8-bc28-7aec2dd7b507 tempest-VolumesSnapshotListTestJSON-319911770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.4dc15711-86b3-441b-9746-6a391e08f1d7" returned: 0 in 0.359s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bbd3a2d0-41c1-4ac8-bc28-7aec2dd7b507 tempest-VolumesSnapshotListTestJSON-319911770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.062s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:21:40 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-bbd3a2d0-41c1-4ac8-bc28-7aec2dd7b507 tempest-VolumesSnapshotListTestJSON-319911770 None] Create snapshot completed successfully
Nov 05 19:21:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9553c649-5e36-4b80-b246-6a406e9bd948 tempest-TestInstancesWithCinderVolumes-180007272 None] Acquiring lock "cinder-45317731-362b-4362-8feb-37e3ea1ca53c-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:21:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9553c649-5e36-4b80-b246-6a406e9bd948 tempest-TestInstancesWithCinderVolumes-180007272 None] Lock "cinder-45317731-362b-4362-8feb-37e3ea1ca53c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:21:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9553c649-5e36-4b80-b246-6a406e9bd948 tempest-TestInstancesWithCinderVolumes-180007272 None] Acquiring lock "cinder-quobyte-45317731-362b-4362-8feb-37e3ea1ca53c" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:21:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9553c649-5e36-4b80-b246-6a406e9bd948 tempest-TestInstancesWithCinderVolumes-180007272 None] Lock "cinder-quobyte-45317731-362b-4362-8feb-37e3ea1ca53c" acquired by "delete_volume" :: waited 0.026s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:21:40 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e2ec83-b4b6-47d9-81bd-21926d329d56]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:21:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9553c649-5e36-4b80-b246-6a406e9bd948 tempest-TestInstancesWithCinderVolumes-180007272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-45317731-362b-4362-8feb-37e3ea1ca53c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:41 devstack sudo[101689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-45317731-362b-4362-8feb-37e3ea1ca53c
Nov 05 19:21:41 devstack sudo[101689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:41 devstack sudo[101689]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9553c649-5e36-4b80-b246-6a406e9bd948 tempest-TestInstancesWithCinderVolumes-180007272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-45317731-362b-4362-8feb-37e3ea1ca53c" returned: 0 in 0.578s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9553c649-5e36-4b80-b246-6a406e9bd948 tempest-TestInstancesWithCinderVolumes-180007272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-45317731-362b-4362-8feb-37e3ea1ca53c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:41 devstack sudo[101700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-45317731-362b-4362-8feb-37e3ea1ca53c
Nov 05 19:21:41 devstack sudo[101700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:41 devstack sudo[101700]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9553c649-5e36-4b80-b246-6a406e9bd948 tempest-TestInstancesWithCinderVolumes-180007272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-45317731-362b-4362-8feb-37e3ea1ca53c" returned: 0 in 0.349s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:41 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9553c649-5e36-4b80-b246-6a406e9bd948 tempest-TestInstancesWithCinderVolumes-180007272 None] Lock "cinder-quobyte-45317731-362b-4362-8feb-37e3ea1ca53c" released by "delete_volume" :: held 1.066s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:21:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d8b61c47-f879-443e-8498-a34bd727dfe5 tempest-VolumesSnapshotListTestJSON-319911770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:21:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d8b61c47-f879-443e-8498-a34bd727dfe5 tempest-VolumesSnapshotListTestJSON-319911770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:21:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-d8b61c47-f879-443e-8498-a34bd727dfe5 tempest-VolumesSnapshotListTestJSON-319911770 None] Creating offline snapshot 3255a532-4e93-4b7e-8195-e4fc06d8346b of volume 43337113-b9de-4335-b6d2-27dc92fdb6f9 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:21:42 devstack cinder-volume[87184]: WARNING cinder.quota [None req-9553c649-5e36-4b80-b246-6a406e9bd948 tempest-TestInstancesWithCinderVolumes-180007272 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1997223793-1644130124 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1997223793-1644130124, it is now deprecated. Please use the default quota class for default quota.
Nov 05 19:21:42 devstack cinder-volume[87184]: WARNING cinder.quota [None req-9553c649-5e36-4b80-b246-6a406e9bd948 tempest-TestInstancesWithCinderVolumes-180007272 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1997223793-1644130124 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1997223793-1644130124, it is now deprecated. Please use the default quota class for default quota.
Nov 05 19:21:42 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3c42cc-4789-43ea-94c9-76b13481b967]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:21:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d8b61c47-f879-443e-8498-a34bd727dfe5 tempest-VolumesSnapshotListTestJSON-319911770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.4dc15711-86b3-441b-9746-6a391e08f1d7 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:42 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-9553c649-5e36-4b80-b246-6a406e9bd948 tempest-TestInstancesWithCinderVolumes-180007272 None] Created reservations ['3d60705e-e35b-474f-a077-65551b823eb0', 'c8270fb2-45ba-4f71-8dd7-dbef4ed050b4', '712c05c3-3a4d-4400-81f6-b503b0e31d77', '53ea6b85-e550-4090-9cab-3a183dff1596'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:21:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9553c649-5e36-4b80-b246-6a406e9bd948 tempest-TestInstancesWithCinderVolumes-180007272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:21:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9553c649-5e36-4b80-b246-6a406e9bd948 tempest-TestInstancesWithCinderVolumes-180007272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:21:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9553c649-5e36-4b80-b246-6a406e9bd948 tempest-TestInstancesWithCinderVolumes-180007272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:21:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9553c649-5e36-4b80-b246-6a406e9bd948 tempest-TestInstancesWithCinderVolumes-180007272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:21:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9553c649-5e36-4b80-b246-6a406e9bd948 tempest-TestInstancesWithCinderVolumes-180007272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:21:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9553c649-5e36-4b80-b246-6a406e9bd948 tempest-TestInstancesWithCinderVolumes-180007272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:42 devstack sudo[101705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.4dc15711-86b3-441b-9746-6a391e08f1d7
Nov 05 19:21:42 devstack sudo[101705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:42 devstack sudo[101706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:21:42 devstack sudo[101706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:42 devstack sudo[101706]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9553c649-5e36-4b80-b246-6a406e9bd948 tempest-TestInstancesWithCinderVolumes-180007272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.285s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:42 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-9553c649-5e36-4b80-b246-6a406e9bd948 tempest-TestInstancesWithCinderVolumes-180007272 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:21:42 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-9553c649-5e36-4b80-b246-6a406e9bd948 tempest-TestInstancesWithCinderVolumes-180007272 None] Deleted volume successfully.
Nov 05 19:21:42 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9553c649-5e36-4b80-b246-6a406e9bd948 tempest-TestInstancesWithCinderVolumes-180007272 None] Lock "cinder-45317731-362b-4362-8feb-37e3ea1ca53c-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:21:42 devstack sudo[101705]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d8b61c47-f879-443e-8498-a34bd727dfe5 tempest-VolumesSnapshotListTestJSON-319911770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.4dc15711-86b3-441b-9746-6a391e08f1d7" returned: 0 in 0.554s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-d8b61c47-f879-443e-8498-a34bd727dfe5 tempest-VolumesSnapshotListTestJSON-319911770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43337113-b9de-4335-b6d2-27dc92fdb6f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:21:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d8b61c47-f879-443e-8498-a34bd727dfe5 tempest-VolumesSnapshotListTestJSON-319911770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.4dc15711-86b3-441b-9746-6a391e08f1d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.3255a532-4e93-4b7e-8195-e4fc06d8346b 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:42 devstack sudo[101714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.4dc15711-86b3-441b-9746-6a391e08f1d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.3255a532-4e93-4b7e-8195-e4fc06d8346b 1G
Nov 05 19:21:42 devstack sudo[101714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:43 devstack sudo[101714]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d8b61c47-f879-443e-8498-a34bd727dfe5 tempest-VolumesSnapshotListTestJSON-319911770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.4dc15711-86b3-441b-9746-6a391e08f1d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.3255a532-4e93-4b7e-8195-e4fc06d8346b 1G" returned: 0 in 0.542s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d8b61c47-f879-443e-8498-a34bd727dfe5 tempest-VolumesSnapshotListTestJSON-319911770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.4dc15711-86b3-441b-9746-6a391e08f1d7 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.3255a532-4e93-4b7e-8195-e4fc06d8346b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:43 devstack sudo[101719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.4dc15711-86b3-441b-9746-6a391e08f1d7 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.3255a532-4e93-4b7e-8195-e4fc06d8346b
Nov 05 19:21:43 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:43 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d8b61c47-f879-443e-8498-a34bd727dfe5 tempest-VolumesSnapshotListTestJSON-319911770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.4dc15711-86b3-441b-9746-6a391e08f1d7 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.3255a532-4e93-4b7e-8195-e4fc06d8346b" returned: 0 in 0.388s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:43 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-d8b61c47-f879-443e-8498-a34bd727dfe5 tempest-VolumesSnapshotListTestJSON-319911770 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.3255a532-4e93-4b7e-8195-e4fc06d8346b is being set with open permissions: ugo+rw
Nov 05 19:21:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d8b61c47-f879-443e-8498-a34bd727dfe5 tempest-VolumesSnapshotListTestJSON-319911770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.3255a532-4e93-4b7e-8195-e4fc06d8346b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:43 devstack sudo[101730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.3255a532-4e93-4b7e-8195-e4fc06d8346b
Nov 05 19:21:43 devstack sudo[101730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:43 devstack sudo[101730]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d8b61c47-f879-443e-8498-a34bd727dfe5 tempest-VolumesSnapshotListTestJSON-319911770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.3255a532-4e93-4b7e-8195-e4fc06d8346b" returned: 0 in 0.269s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d8b61c47-f879-443e-8498-a34bd727dfe5 tempest-VolumesSnapshotListTestJSON-319911770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.949s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:21:43 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-d8b61c47-f879-443e-8498-a34bd727dfe5 tempest-VolumesSnapshotListTestJSON-319911770 None] Create snapshot completed successfully
Nov 05 19:21:45 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-692b3e91-fbaa-4da7-ac69-3d6b7f77c6d5 req-c8f982e2-b15f-478b-978c-879aa5bd3162 tempest-TestInstancesWithCinderVolumes-180007272 None] Terminate volume connection completed successfully.
Nov 05 19:21:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-692b3e91-fbaa-4da7-ac69-3d6b7f77c6d5 req-c8f982e2-b15f-478b-978c-879aa5bd3162 tempest-TestInstancesWithCinderVolumes-180007272 None] Deleting attachment 8c362c1a-e1eb-4ebe-a461-14411e03f686. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 19:21:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cc6b4c80-cacb-409e-9219-852891727ee9 tempest-TestInstancesWithCinderVolumes-180007272 None] Acquiring lock "cinder-b0a21a9a-2804-4b20-98a1-fe03c6d22a98-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:21:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cc6b4c80-cacb-409e-9219-852891727ee9 tempest-TestInstancesWithCinderVolumes-180007272 None] Lock "cinder-b0a21a9a-2804-4b20-98a1-fe03c6d22a98-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:21:46 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cc6b4c80-cacb-409e-9219-852891727ee9 tempest-TestInstancesWithCinderVolumes-180007272 None] Acquiring lock "cinder-quobyte-b0a21a9a-2804-4b20-98a1-fe03c6d22a98" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:21:46 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cc6b4c80-cacb-409e-9219-852891727ee9 tempest-TestInstancesWithCinderVolumes-180007272 None] Lock "cinder-quobyte-b0a21a9a-2804-4b20-98a1-fe03c6d22a98" acquired by "delete_volume" :: waited 0.034s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:21:46 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[838cc738-3986-494b-ac29-eeaee2b0cd95]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:21:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cc6b4c80-cacb-409e-9219-852891727ee9 tempest-TestInstancesWithCinderVolumes-180007272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b0a21a9a-2804-4b20-98a1-fe03c6d22a98 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:46 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8a06f766-49a1-4eb2-b113-94e7535b61a6 tempest-VolumesSnapshotListTestJSON-319911770 None] Acquiring lock "cinder-3255a532-4e93-4b7e-8195-e4fc06d8346b-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:21:46 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8a06f766-49a1-4eb2-b113-94e7535b61a6 tempest-VolumesSnapshotListTestJSON-319911770 None] Lock "cinder-3255a532-4e93-4b7e-8195-e4fc06d8346b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:21:46 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8a06f766-49a1-4eb2-b113-94e7535b61a6 tempest-VolumesSnapshotListTestJSON-319911770 None] Acquiring lock "cinder-quobyte-43337113-b9de-4335-b6d2-27dc92fdb6f9" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:21:46 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8a06f766-49a1-4eb2-b113-94e7535b61a6 tempest-VolumesSnapshotListTestJSON-319911770 None] Lock "cinder-quobyte-43337113-b9de-4335-b6d2-27dc92fdb6f9" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:21:46 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8a06f766-49a1-4eb2-b113-94e7535b61a6 tempest-VolumesSnapshotListTestJSON-319911770 None] Acquiring lock "cinder-quobyte-3255a532-4e93-4b7e-8195-e4fc06d8346b" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:21:46 devstack sudo[101753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b0a21a9a-2804-4b20-98a1-fe03c6d22a98
Nov 05 19:21:46 devstack sudo[101753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:46 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8a06f766-49a1-4eb2-b113-94e7535b61a6 tempest-VolumesSnapshotListTestJSON-319911770 None] Lock "cinder-quobyte-3255a532-4e93-4b7e-8195-e4fc06d8346b" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:21:46 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-8a06f766-49a1-4eb2-b113-94e7535b61a6 tempest-VolumesSnapshotListTestJSON-319911770 None] Deleting offline snapshot 3255a532-4e93-4b7e-8195-e4fc06d8346b of volume 43337113-b9de-4335-b6d2-27dc92fdb6f9 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:21:46 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-8a06f766-49a1-4eb2-b113-94e7535b61a6 tempest-VolumesSnapshotListTestJSON-319911770 None] snapshot_file for this snap is: volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.3255a532-4e93-4b7e-8195-e4fc06d8346b {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:21:46 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9caa10-54e4-4548-ab90-f2dc113934c8]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:21:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8a06f766-49a1-4eb2-b113-94e7535b61a6 tempest-VolumesSnapshotListTestJSON-319911770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.3255a532-4e93-4b7e-8195-e4fc06d8346b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:46 devstack sudo[101755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.3255a532-4e93-4b7e-8195-e4fc06d8346b
Nov 05 19:21:46 devstack sudo[101755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:46 devstack sudo[101753]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cc6b4c80-cacb-409e-9219-852891727ee9 tempest-TestInstancesWithCinderVolumes-180007272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b0a21a9a-2804-4b20-98a1-fe03c6d22a98" returned: 0 in 0.477s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cc6b4c80-cacb-409e-9219-852891727ee9 tempest-TestInstancesWithCinderVolumes-180007272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b0a21a9a-2804-4b20-98a1-fe03c6d22a98 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:46 devstack sudo[101760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b0a21a9a-2804-4b20-98a1-fe03c6d22a98
Nov 05 19:21:46 devstack sudo[101760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:46 devstack sudo[101760]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cc6b4c80-cacb-409e-9219-852891727ee9 tempest-TestInstancesWithCinderVolumes-180007272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b0a21a9a-2804-4b20-98a1-fe03c6d22a98" returned: 0 in 0.294s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:46 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cc6b4c80-cacb-409e-9219-852891727ee9 tempest-TestInstancesWithCinderVolumes-180007272 None] Lock "cinder-quobyte-b0a21a9a-2804-4b20-98a1-fe03c6d22a98" released by "delete_volume" :: held 0.851s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:21:46 devstack sudo[101755]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:46 devstack cinder-volume[87184]: WARNING cinder.quota [None req-cc6b4c80-cacb-409e-9219-852891727ee9 tempest-TestInstancesWithCinderVolumes-180007272 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2067076764-1235549272 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2067076764-1235549272, it is now deprecated. Please use the default quota class for default quota.
Nov 05 19:21:46 devstack cinder-volume[87184]: WARNING cinder.quota [None req-cc6b4c80-cacb-409e-9219-852891727ee9 tempest-TestInstancesWithCinderVolumes-180007272 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2067076764-1235549272 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2067076764-1235549272, it is now deprecated. Please use the default quota class for default quota.
Nov 05 19:21:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8a06f766-49a1-4eb2-b113-94e7535b61a6 tempest-VolumesSnapshotListTestJSON-319911770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.3255a532-4e93-4b7e-8195-e4fc06d8346b" returned: 0 in 0.606s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:46 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-8a06f766-49a1-4eb2-b113-94e7535b61a6 tempest-VolumesSnapshotListTestJSON-319911770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43337113-b9de-4335-b6d2-27dc92fdb6f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:21:47 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-cc6b4c80-cacb-409e-9219-852891727ee9 tempest-TestInstancesWithCinderVolumes-180007272 None] Created reservations ['4c389e18-3b7f-4c02-8928-b08eaa2ba247', '3e0179d3-113e-46df-b6e7-d892c30be3ba', 'e984b03a-8b57-42d8-86cb-7c705964f785', 'b3521dd5-7ba0-43d7-ab77-c8e644bd514f'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:21:47 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c06302-aa91-4b8b-be26-3f542a79335a]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:21:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8a06f766-49a1-4eb2-b113-94e7535b61a6 tempest-VolumesSnapshotListTestJSON-319911770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.4dc15711-86b3-441b-9746-6a391e08f1d7 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cc6b4c80-cacb-409e-9219-852891727ee9 tempest-TestInstancesWithCinderVolumes-180007272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:21:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cc6b4c80-cacb-409e-9219-852891727ee9 tempest-TestInstancesWithCinderVolumes-180007272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:21:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-cc6b4c80-cacb-409e-9219-852891727ee9 tempest-TestInstancesWithCinderVolumes-180007272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:21:47 devstack sudo[101766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.4dc15711-86b3-441b-9746-6a391e08f1d7
Nov 05 19:21:47 devstack sudo[101766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-cc6b4c80-cacb-409e-9219-852891727ee9 tempest-TestInstancesWithCinderVolumes-180007272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:21:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cc6b4c80-cacb-409e-9219-852891727ee9 tempest-TestInstancesWithCinderVolumes-180007272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:21:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cc6b4c80-cacb-409e-9219-852891727ee9 tempest-TestInstancesWithCinderVolumes-180007272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:47 devstack sudo[101768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:21:47 devstack sudo[101768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:47 devstack sudo[101768]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cc6b4c80-cacb-409e-9219-852891727ee9 tempest-TestInstancesWithCinderVolumes-180007272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.365s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:47 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-cc6b4c80-cacb-409e-9219-852891727ee9 tempest-TestInstancesWithCinderVolumes-180007272 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:21:47 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-cc6b4c80-cacb-409e-9219-852891727ee9 tempest-TestInstancesWithCinderVolumes-180007272 None] Deleted volume successfully.
Nov 05 19:21:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cc6b4c80-cacb-409e-9219-852891727ee9 tempest-TestInstancesWithCinderVolumes-180007272 None] Lock "cinder-b0a21a9a-2804-4b20-98a1-fe03c6d22a98-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:21:47 devstack sudo[101766]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8a06f766-49a1-4eb2-b113-94e7535b61a6 tempest-VolumesSnapshotListTestJSON-319911770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.4dc15711-86b3-441b-9746-6a391e08f1d7" returned: 0 in 0.684s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-8a06f766-49a1-4eb2-b113-94e7535b61a6 tempest-VolumesSnapshotListTestJSON-319911770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43337113-b9de-4335-b6d2-27dc92fdb6f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:21:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8a06f766-49a1-4eb2-b113-94e7535b61a6 tempest-VolumesSnapshotListTestJSON-319911770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.3255a532-4e93-4b7e-8195-e4fc06d8346b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:47 devstack sudo[101776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.3255a532-4e93-4b7e-8195-e4fc06d8346b
Nov 05 19:21:47 devstack sudo[101776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:48 devstack sudo[101776]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8a06f766-49a1-4eb2-b113-94e7535b61a6 tempest-VolumesSnapshotListTestJSON-319911770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.3255a532-4e93-4b7e-8195-e4fc06d8346b" returned: 0 in 0.559s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8a06f766-49a1-4eb2-b113-94e7535b61a6 tempest-VolumesSnapshotListTestJSON-319911770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.3255a532-4e93-4b7e-8195-e4fc06d8346b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:48 devstack sudo[101782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.3255a532-4e93-4b7e-8195-e4fc06d8346b
Nov 05 19:21:48 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:48 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8a06f766-49a1-4eb2-b113-94e7535b61a6 tempest-VolumesSnapshotListTestJSON-319911770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.3255a532-4e93-4b7e-8195-e4fc06d8346b" returned: 0 in 0.285s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8a06f766-49a1-4eb2-b113-94e7535b61a6 tempest-VolumesSnapshotListTestJSON-319911770 None] Lock "cinder-quobyte-3255a532-4e93-4b7e-8195-e4fc06d8346b" released by "_delete_snapshot" :: held 2.310s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:21:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8a06f766-49a1-4eb2-b113-94e7535b61a6 tempest-VolumesSnapshotListTestJSON-319911770 None] Lock "cinder-quobyte-43337113-b9de-4335-b6d2-27dc92fdb6f9" released by "delete_snapshot" :: held 2.358s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:21:48 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-8a06f766-49a1-4eb2-b113-94e7535b61a6 tempest-VolumesSnapshotListTestJSON-319911770 None] Created reservations ['51ca66f0-4dff-4d14-b8a2-7a0644b17db1', '204c41c6-b236-4331-83cc-06fc63df240c', '806a0e8b-e4fb-4e0d-ba71-c4a78b821096', '64103e3c-b618-4217-9560-137b98ae6d08'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:21:48 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-8a06f766-49a1-4eb2-b113-94e7535b61a6 tempest-VolumesSnapshotListTestJSON-319911770 None] Delete snapshot completed successfully.
Nov 05 19:21:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8a06f766-49a1-4eb2-b113-94e7535b61a6 tempest-VolumesSnapshotListTestJSON-319911770 None] Lock "cinder-3255a532-4e93-4b7e-8195-e4fc06d8346b-delete_snapshot" released by "delete_snapshot" :: held 2.533s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:21:49 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b9f90c81-23a1-470c-90f9-ceb79c7ae708 tempest-VolumesSnapshotListTestJSON-319911770 None] Acquiring lock "cinder-4dc15711-86b3-441b-9746-6a391e08f1d7-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:21:49 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b9f90c81-23a1-470c-90f9-ceb79c7ae708 tempest-VolumesSnapshotListTestJSON-319911770 None] Lock "cinder-4dc15711-86b3-441b-9746-6a391e08f1d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:21:49 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b9f90c81-23a1-470c-90f9-ceb79c7ae708 tempest-VolumesSnapshotListTestJSON-319911770 None] Acquiring lock "cinder-quobyte-43337113-b9de-4335-b6d2-27dc92fdb6f9" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:21:49 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b9f90c81-23a1-470c-90f9-ceb79c7ae708 tempest-VolumesSnapshotListTestJSON-319911770 None] Lock "cinder-quobyte-43337113-b9de-4335-b6d2-27dc92fdb6f9" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:21:49 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b9f90c81-23a1-470c-90f9-ceb79c7ae708 tempest-VolumesSnapshotListTestJSON-319911770 None] Acquiring lock "cinder-quobyte-4dc15711-86b3-441b-9746-6a391e08f1d7" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:21:49 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b9f90c81-23a1-470c-90f9-ceb79c7ae708 tempest-VolumesSnapshotListTestJSON-319911770 None] Lock "cinder-quobyte-4dc15711-86b3-441b-9746-6a391e08f1d7" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:21:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-b9f90c81-23a1-470c-90f9-ceb79c7ae708 tempest-VolumesSnapshotListTestJSON-319911770 None] Deleting offline snapshot 4dc15711-86b3-441b-9746-6a391e08f1d7 of volume 43337113-b9de-4335-b6d2-27dc92fdb6f9 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:21:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-b9f90c81-23a1-470c-90f9-ceb79c7ae708 tempest-VolumesSnapshotListTestJSON-319911770 None] snapshot_file for this snap is: volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.4dc15711-86b3-441b-9746-6a391e08f1d7 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:21:49 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8942db8-c725-4d06-b67e-68d660e4ac76]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:21:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b9f90c81-23a1-470c-90f9-ceb79c7ae708 tempest-VolumesSnapshotListTestJSON-319911770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.4dc15711-86b3-441b-9746-6a391e08f1d7 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:49 devstack sudo[101814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.4dc15711-86b3-441b-9746-6a391e08f1d7
Nov 05 19:21:49 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:50 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b9f90c81-23a1-470c-90f9-ceb79c7ae708 tempest-VolumesSnapshotListTestJSON-319911770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.4dc15711-86b3-441b-9746-6a391e08f1d7" returned: 0 in 0.724s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-b9f90c81-23a1-470c-90f9-ceb79c7ae708 tempest-VolumesSnapshotListTestJSON-319911770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43337113-b9de-4335-b6d2-27dc92fdb6f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:21:50 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[84805b62-7c00-4e3d-bfaa-a2382bb97bcf]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:21:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b9f90c81-23a1-470c-90f9-ceb79c7ae708 tempest-VolumesSnapshotListTestJSON-319911770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.b004748e-5a35-4ebc-aad0-7cb9ec9ee12a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:50 devstack sudo[101850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.b004748e-5a35-4ebc-aad0-7cb9ec9ee12a
Nov 05 19:21:50 devstack sudo[101850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:51 devstack sudo[101850]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b9f90c81-23a1-470c-90f9-ceb79c7ae708 tempest-VolumesSnapshotListTestJSON-319911770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.b004748e-5a35-4ebc-aad0-7cb9ec9ee12a" returned: 0 in 0.550s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:51 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-b9f90c81-23a1-470c-90f9-ceb79c7ae708 tempest-VolumesSnapshotListTestJSON-319911770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43337113-b9de-4335-b6d2-27dc92fdb6f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:21:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b9f90c81-23a1-470c-90f9-ceb79c7ae708 tempest-VolumesSnapshotListTestJSON-319911770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.4dc15711-86b3-441b-9746-6a391e08f1d7 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:51 devstack sudo[101857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.4dc15711-86b3-441b-9746-6a391e08f1d7
Nov 05 19:21:51 devstack sudo[101857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:51 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-06779897-3cd9-4efb-b2af-3cfbe1717766 req-86d2c8a9-0d84-4ab6-9c23-ba06bf44883c tempest-TestInstancesWithCinderVolumes-180007272 None] Terminate volume connection completed successfully.
Nov 05 19:21:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-06779897-3cd9-4efb-b2af-3cfbe1717766 req-86d2c8a9-0d84-4ab6-9c23-ba06bf44883c tempest-TestInstancesWithCinderVolumes-180007272 None] Deleting attachment 7a650b57-b348-403a-a623-ca267ddec6c3. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 19:21:51 devstack sudo[101857]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b9f90c81-23a1-470c-90f9-ceb79c7ae708 tempest-VolumesSnapshotListTestJSON-319911770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.4dc15711-86b3-441b-9746-6a391e08f1d7" returned: 0 in 0.497s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b9f90c81-23a1-470c-90f9-ceb79c7ae708 tempest-VolumesSnapshotListTestJSON-319911770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.4dc15711-86b3-441b-9746-6a391e08f1d7 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:51 devstack sudo[101863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.4dc15711-86b3-441b-9746-6a391e08f1d7
Nov 05 19:21:51 devstack sudo[101863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:51 devstack sudo[101863]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b9f90c81-23a1-470c-90f9-ceb79c7ae708 tempest-VolumesSnapshotListTestJSON-319911770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.4dc15711-86b3-441b-9746-6a391e08f1d7" returned: 0 in 0.292s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b9f90c81-23a1-470c-90f9-ceb79c7ae708 tempest-VolumesSnapshotListTestJSON-319911770 None] Lock "cinder-quobyte-4dc15711-86b3-441b-9746-6a391e08f1d7" released by "_delete_snapshot" :: held 2.321s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:21:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b9f90c81-23a1-470c-90f9-ceb79c7ae708 tempest-VolumesSnapshotListTestJSON-319911770 None] Lock "cinder-quobyte-43337113-b9de-4335-b6d2-27dc92fdb6f9" released by "delete_snapshot" :: held 2.359s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:21:51 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-b9f90c81-23a1-470c-90f9-ceb79c7ae708 tempest-VolumesSnapshotListTestJSON-319911770 None] Created reservations ['5d8c20ed-3155-433d-b7c0-692afe5f1dc0', 'ac06a0a1-5ca0-49b7-8c2d-a5aacafa1d36', '8d2659f6-8864-4989-a37f-ea932c37a126', '32d56c83-bc00-4864-801b-07a68d4c26bb'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:21:52 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b9f90c81-23a1-470c-90f9-ceb79c7ae708 tempest-VolumesSnapshotListTestJSON-319911770 None] Delete snapshot completed successfully.
Nov 05 19:21:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b9f90c81-23a1-470c-90f9-ceb79c7ae708 tempest-VolumesSnapshotListTestJSON-319911770 None] Lock "cinder-4dc15711-86b3-441b-9746-6a391e08f1d7-delete_snapshot" released by "delete_snapshot" :: held 2.528s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:21:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-413c5dd8-40b7-4eae-b43a-355e52d96ed0 tempest-TestInstancesWithCinderVolumes-180007272 None] Acquiring lock "cinder-a7eaa07e-8892-494e-aa1c-9abc8bd39dee-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:21:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-413c5dd8-40b7-4eae-b43a-355e52d96ed0 tempest-TestInstancesWithCinderVolumes-180007272 None] Lock "cinder-a7eaa07e-8892-494e-aa1c-9abc8bd39dee-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:21:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-413c5dd8-40b7-4eae-b43a-355e52d96ed0 tempest-TestInstancesWithCinderVolumes-180007272 None] Acquiring lock "cinder-quobyte-a7eaa07e-8892-494e-aa1c-9abc8bd39dee" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:21:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-413c5dd8-40b7-4eae-b43a-355e52d96ed0 tempest-TestInstancesWithCinderVolumes-180007272 None] Lock "cinder-quobyte-a7eaa07e-8892-494e-aa1c-9abc8bd39dee" acquired by "delete_volume" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:21:52 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2a0e42-b77f-46b6-aedf-06b018a8064b]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:21:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-413c5dd8-40b7-4eae-b43a-355e52d96ed0 tempest-TestInstancesWithCinderVolumes-180007272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a7eaa07e-8892-494e-aa1c-9abc8bd39dee {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:52 devstack sudo[101866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a7eaa07e-8892-494e-aa1c-9abc8bd39dee
Nov 05 19:21:52 devstack sudo[101866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:52 devstack sudo[101866]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-413c5dd8-40b7-4eae-b43a-355e52d96ed0 tempest-TestInstancesWithCinderVolumes-180007272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a7eaa07e-8892-494e-aa1c-9abc8bd39dee" returned: 0 in 0.375s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-413c5dd8-40b7-4eae-b43a-355e52d96ed0 tempest-TestInstancesWithCinderVolumes-180007272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a7eaa07e-8892-494e-aa1c-9abc8bd39dee {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:52 devstack sudo[101871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a7eaa07e-8892-494e-aa1c-9abc8bd39dee
Nov 05 19:21:52 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8eeb971b-a414-4097-8025-6f97dcee9f4e tempest-VolumesSnapshotListTestJSON-319911770 None] Acquiring lock "cinder-b004748e-5a35-4ebc-aad0-7cb9ec9ee12a-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:21:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8eeb971b-a414-4097-8025-6f97dcee9f4e tempest-VolumesSnapshotListTestJSON-319911770 None] Lock "cinder-b004748e-5a35-4ebc-aad0-7cb9ec9ee12a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:21:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8eeb971b-a414-4097-8025-6f97dcee9f4e tempest-VolumesSnapshotListTestJSON-319911770 None] Acquiring lock "cinder-quobyte-43337113-b9de-4335-b6d2-27dc92fdb6f9" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:21:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8eeb971b-a414-4097-8025-6f97dcee9f4e tempest-VolumesSnapshotListTestJSON-319911770 None] Lock "cinder-quobyte-43337113-b9de-4335-b6d2-27dc92fdb6f9" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:21:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8eeb971b-a414-4097-8025-6f97dcee9f4e tempest-VolumesSnapshotListTestJSON-319911770 None] Acquiring lock "cinder-quobyte-b004748e-5a35-4ebc-aad0-7cb9ec9ee12a" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:21:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8eeb971b-a414-4097-8025-6f97dcee9f4e tempest-VolumesSnapshotListTestJSON-319911770 None] Lock "cinder-quobyte-b004748e-5a35-4ebc-aad0-7cb9ec9ee12a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:21:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-8eeb971b-a414-4097-8025-6f97dcee9f4e tempest-VolumesSnapshotListTestJSON-319911770 None] Deleting offline snapshot b004748e-5a35-4ebc-aad0-7cb9ec9ee12a of volume 43337113-b9de-4335-b6d2-27dc92fdb6f9 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:21:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-8eeb971b-a414-4097-8025-6f97dcee9f4e tempest-VolumesSnapshotListTestJSON-319911770 None] snapshot_file for this snap is: volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.b004748e-5a35-4ebc-aad0-7cb9ec9ee12a {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:21:52 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[717ec2d2-cbed-4ef5-b985-6f2f1155aa7e]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:21:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8eeb971b-a414-4097-8025-6f97dcee9f4e tempest-VolumesSnapshotListTestJSON-319911770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.b004748e-5a35-4ebc-aad0-7cb9ec9ee12a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:52 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-413c5dd8-40b7-4eae-b43a-355e52d96ed0 tempest-TestInstancesWithCinderVolumes-180007272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a7eaa07e-8892-494e-aa1c-9abc8bd39dee" returned: 0 in 0.295s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-413c5dd8-40b7-4eae-b43a-355e52d96ed0 tempest-TestInstancesWithCinderVolumes-180007272 None] Lock "cinder-quobyte-a7eaa07e-8892-494e-aa1c-9abc8bd39dee" released by "delete_volume" :: held 0.722s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:21:52 devstack cinder-volume[87184]: WARNING cinder.quota [None req-413c5dd8-40b7-4eae-b43a-355e52d96ed0 tempest-TestInstancesWithCinderVolumes-180007272 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1407680997-1909198796 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1407680997-1909198796, it is now deprecated. Please use the default quota class for default quota.
Nov 05 19:21:52 devstack cinder-volume[87184]: WARNING cinder.quota [None req-413c5dd8-40b7-4eae-b43a-355e52d96ed0 tempest-TestInstancesWithCinderVolumes-180007272 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1407680997-1909198796 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1407680997-1909198796, it is now deprecated. Please use the default quota class for default quota.
Nov 05 19:21:52 devstack sudo[101873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.b004748e-5a35-4ebc-aad0-7cb9ec9ee12a
Nov 05 19:21:52 devstack sudo[101873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:53 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-413c5dd8-40b7-4eae-b43a-355e52d96ed0 tempest-TestInstancesWithCinderVolumes-180007272 None] Created reservations ['1b1c5f59-735d-4fc5-bf43-40b044c2f563', '5c9e4f2b-f424-495d-984c-a44310125aab', 'a7c10996-2f24-43ab-9a55-aeea079d824f', '262ad61e-d8a9-45d5-8ae6-a3dda0a80c87'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:21:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-413c5dd8-40b7-4eae-b43a-355e52d96ed0 tempest-TestInstancesWithCinderVolumes-180007272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:21:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-413c5dd8-40b7-4eae-b43a-355e52d96ed0 tempest-TestInstancesWithCinderVolumes-180007272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:21:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-413c5dd8-40b7-4eae-b43a-355e52d96ed0 tempest-TestInstancesWithCinderVolumes-180007272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:21:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-413c5dd8-40b7-4eae-b43a-355e52d96ed0 tempest-TestInstancesWithCinderVolumes-180007272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:21:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-413c5dd8-40b7-4eae-b43a-355e52d96ed0 tempest-TestInstancesWithCinderVolumes-180007272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:21:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-413c5dd8-40b7-4eae-b43a-355e52d96ed0 tempest-TestInstancesWithCinderVolumes-180007272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:53 devstack sudo[101876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:21:53 devstack sudo[101876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:53 devstack sudo[101873]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8eeb971b-a414-4097-8025-6f97dcee9f4e tempest-VolumesSnapshotListTestJSON-319911770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.b004748e-5a35-4ebc-aad0-7cb9ec9ee12a" returned: 0 in 0.429s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-8eeb971b-a414-4097-8025-6f97dcee9f4e tempest-VolumesSnapshotListTestJSON-319911770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43337113-b9de-4335-b6d2-27dc92fdb6f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:21:53 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4b997b-d5fa-4c14-aa83-29f205e1dd08]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:21:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8eeb971b-a414-4097-8025-6f97dcee9f4e tempest-VolumesSnapshotListTestJSON-319911770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:53 devstack sudo[101876]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-413c5dd8-40b7-4eae-b43a-355e52d96ed0 tempest-TestInstancesWithCinderVolumes-180007272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.341s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:53 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-413c5dd8-40b7-4eae-b43a-355e52d96ed0 tempest-TestInstancesWithCinderVolumes-180007272 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:21:53 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-413c5dd8-40b7-4eae-b43a-355e52d96ed0 tempest-TestInstancesWithCinderVolumes-180007272 None] Deleted volume successfully.
Nov 05 19:21:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-413c5dd8-40b7-4eae-b43a-355e52d96ed0 tempest-TestInstancesWithCinderVolumes-180007272 None] Lock "cinder-a7eaa07e-8892-494e-aa1c-9abc8bd39dee-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:21:53 devstack sudo[101881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9
Nov 05 19:21:53 devstack sudo[101881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:53 devstack sudo[101881]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8eeb971b-a414-4097-8025-6f97dcee9f4e tempest-VolumesSnapshotListTestJSON-319911770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9" returned: 0 in 0.489s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8eeb971b-a414-4097-8025-6f97dcee9f4e tempest-VolumesSnapshotListTestJSON-319911770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.b004748e-5a35-4ebc-aad0-7cb9ec9ee12a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:53 devstack sudo[101887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.b004748e-5a35-4ebc-aad0-7cb9ec9ee12a
Nov 05 19:21:53 devstack sudo[101887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:54 devstack sudo[101887]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8eeb971b-a414-4097-8025-6f97dcee9f4e tempest-VolumesSnapshotListTestJSON-319911770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.b004748e-5a35-4ebc-aad0-7cb9ec9ee12a" returned: 0 in 0.378s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8eeb971b-a414-4097-8025-6f97dcee9f4e tempest-VolumesSnapshotListTestJSON-319911770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.b004748e-5a35-4ebc-aad0-7cb9ec9ee12a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:54 devstack sudo[101893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.b004748e-5a35-4ebc-aad0-7cb9ec9ee12a
Nov 05 19:21:54 devstack sudo[101893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:54 devstack sudo[101893]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8eeb971b-a414-4097-8025-6f97dcee9f4e tempest-VolumesSnapshotListTestJSON-319911770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9.b004748e-5a35-4ebc-aad0-7cb9ec9ee12a" returned: 0 in 0.272s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:54 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8eeb971b-a414-4097-8025-6f97dcee9f4e tempest-VolumesSnapshotListTestJSON-319911770 None] Lock "cinder-quobyte-b004748e-5a35-4ebc-aad0-7cb9ec9ee12a" released by "_delete_snapshot" :: held 1.715s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:21:54 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8eeb971b-a414-4097-8025-6f97dcee9f4e tempest-VolumesSnapshotListTestJSON-319911770 None] Lock "cinder-quobyte-43337113-b9de-4335-b6d2-27dc92fdb6f9" released by "delete_snapshot" :: held 1.747s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:21:54 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-8eeb971b-a414-4097-8025-6f97dcee9f4e tempest-VolumesSnapshotListTestJSON-319911770 None] Created reservations ['ce444e12-bd6c-465c-b79d-a3de44432605', 'f5b9fef6-8a02-4f73-9ff1-4bbf18dbdb68', '8b492744-ac64-4b8d-b6b3-8fac83cd7bbe', '2c17c27e-aef7-4f9a-bfb1-7eb7a4884f7d'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:21:54 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-8eeb971b-a414-4097-8025-6f97dcee9f4e tempest-VolumesSnapshotListTestJSON-319911770 None] Delete snapshot completed successfully.
Nov 05 19:21:54 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8eeb971b-a414-4097-8025-6f97dcee9f4e tempest-VolumesSnapshotListTestJSON-319911770 None] Lock "cinder-b004748e-5a35-4ebc-aad0-7cb9ec9ee12a-delete_snapshot" released by "delete_snapshot" :: held 1.912s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:21:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4a1e9ebd-4802-4756-9f13-6dccf05532ff tempest-VolumesSnapshotListTestJSON-319911770 None] Acquiring lock "cinder-43337113-b9de-4335-b6d2-27dc92fdb6f9-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:21:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4a1e9ebd-4802-4756-9f13-6dccf05532ff tempest-VolumesSnapshotListTestJSON-319911770 None] Lock "cinder-43337113-b9de-4335-b6d2-27dc92fdb6f9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:21:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4a1e9ebd-4802-4756-9f13-6dccf05532ff tempest-VolumesSnapshotListTestJSON-319911770 None] Acquiring lock "cinder-quobyte-43337113-b9de-4335-b6d2-27dc92fdb6f9" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:21:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4a1e9ebd-4802-4756-9f13-6dccf05532ff tempest-VolumesSnapshotListTestJSON-319911770 None] Lock "cinder-quobyte-43337113-b9de-4335-b6d2-27dc92fdb6f9" acquired by "delete_volume" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:21:55 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf505ea-5dc9-4a69-8b16-393c75df40ef]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:21:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4a1e9ebd-4802-4756-9f13-6dccf05532ff tempest-VolumesSnapshotListTestJSON-319911770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:55 devstack sudo[101896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9
Nov 05 19:21:55 devstack sudo[101896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:55 devstack sudo[101896]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4a1e9ebd-4802-4756-9f13-6dccf05532ff tempest-VolumesSnapshotListTestJSON-319911770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9" returned: 0 in 0.415s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4a1e9ebd-4802-4756-9f13-6dccf05532ff tempest-VolumesSnapshotListTestJSON-319911770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:55 devstack sudo[101901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9
Nov 05 19:21:55 devstack sudo[101901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:55 devstack sudo[101901]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4a1e9ebd-4802-4756-9f13-6dccf05532ff tempest-VolumesSnapshotListTestJSON-319911770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-43337113-b9de-4335-b6d2-27dc92fdb6f9" returned: 0 in 0.307s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4a1e9ebd-4802-4756-9f13-6dccf05532ff tempest-VolumesSnapshotListTestJSON-319911770 None] Lock "cinder-quobyte-43337113-b9de-4335-b6d2-27dc92fdb6f9" released by "delete_volume" :: held 0.795s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:21:56 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-4a1e9ebd-4802-4756-9f13-6dccf05532ff tempest-VolumesSnapshotListTestJSON-319911770 None] Created reservations ['4e411654-6ac0-4ff6-976d-cd5e1d2dae68', '9d7f8464-f359-45df-be69-2728ac31b52d', 'bbc37106-fba2-4c76-a40a-130f34bd35d1', 'b7a388ac-dfd2-4df5-a329-4c92971c3e7b'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:21:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4a1e9ebd-4802-4756-9f13-6dccf05532ff tempest-VolumesSnapshotListTestJSON-319911770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:21:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4a1e9ebd-4802-4756-9f13-6dccf05532ff tempest-VolumesSnapshotListTestJSON-319911770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:21:56 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4a1e9ebd-4802-4756-9f13-6dccf05532ff tempest-VolumesSnapshotListTestJSON-319911770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:21:56 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4a1e9ebd-4802-4756-9f13-6dccf05532ff tempest-VolumesSnapshotListTestJSON-319911770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:21:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4a1e9ebd-4802-4756-9f13-6dccf05532ff tempest-VolumesSnapshotListTestJSON-319911770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:21:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4a1e9ebd-4802-4756-9f13-6dccf05532ff tempest-VolumesSnapshotListTestJSON-319911770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:21:56 devstack sudo[101905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:21:56 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:21:56 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root
Nov 05 19:21:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4a1e9ebd-4802-4756-9f13-6dccf05532ff tempest-VolumesSnapshotListTestJSON-319911770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.287s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:21:56 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-4a1e9ebd-4802-4756-9f13-6dccf05532ff tempest-VolumesSnapshotListTestJSON-319911770 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:21:56 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-4a1e9ebd-4802-4756-9f13-6dccf05532ff tempest-VolumesSnapshotListTestJSON-319911770 None] Deleted volume successfully.
Nov 05 19:21:56 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4a1e9ebd-4802-4756-9f13-6dccf05532ff tempest-VolumesSnapshotListTestJSON-319911770 None] Lock "cinder-43337113-b9de-4335-b6d2-27dc92fdb6f9-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:22:00 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b89fcfb-7cfd-409a-be49-8362eea5ec15 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:22:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4b89fcfb-7cfd-409a-be49-8362eea5ec15 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Flow 'volume_create_manager' (7d649ad6-f048-4b53-9eac-ab96b14ec87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:22:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4b89fcfb-7cfd-409a-be49-8362eea5ec15 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a463f3db-500f-47ff-8fb9-3dae413c837e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4b89fcfb-7cfd-409a-be49-8362eea5ec15 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a463f3db-500f-47ff-8fb9-3dae413c837e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1383694735',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=891e5f4b-7dae-4886-964c-7b657b4b726d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7825d1ed157644ae8a08befa3d4cfc87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:22:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:22:01Z,use_quota=True,user_id='c727130f5f2b4d0a885ef8bf0543e31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4b89fcfb-7cfd-409a-be49-8362eea5ec15 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3101591d-6348-4885-9d47-e82a70fd8208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4b89fcfb-7cfd-409a-be49-8362eea5ec15 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3101591d-6348-4885-9d47-e82a70fd8208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4b89fcfb-7cfd-409a-be49-8362eea5ec15 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23e7a521-2b06-4619-9128-632b285b7e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4b89fcfb-7cfd-409a-be49-8362eea5ec15 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23e7a521-2b06-4619-9128-632b285b7e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '891e5f4b-7dae-4886-964c-7b657b4b726d', 'volume_name': 'volume-891e5f4b-7dae-4886-964c-7b657b4b726d', 'volume_size': 2}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4b89fcfb-7cfd-409a-be49-8362eea5ec15 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (499ca55a-53cb-4417-888a-a5fd78102ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4b89fcfb-7cfd-409a-be49-8362eea5ec15 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (499ca55a-53cb-4417-888a-a5fd78102ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4b89fcfb-7cfd-409a-be49-8362eea5ec15 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (378fc7f1-ce9e-4c49-a483-f31985a86f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:00 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-4b89fcfb-7cfd-409a-be49-8362eea5ec15 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Volume 891e5f4b-7dae-4886-964c-7b657b4b726d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-891e5f4b-7dae-4886-964c-7b657b4b726d', 'volume_size': 2}
Nov 05 19:22:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4b89fcfb-7cfd-409a-be49-8362eea5ec15 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:22:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4b89fcfb-7cfd-409a-be49-8362eea5ec15 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:22:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4b89fcfb-7cfd-409a-be49-8362eea5ec15 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1383694735',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=891e5f4b-7dae-4886-964c-7b657b4b726d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7825d1ed157644ae8a08befa3d4cfc87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:22:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:22:01Z,use_quota=True,user_id='c727130f5f2b4d0a885ef8bf0543e31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:22:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-4b89fcfb-7cfd-409a-be49-8362eea5ec15 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Creating volume 891e5f4b-7dae-4886-964c-7b657b4b726d {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:22:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4b89fcfb-7cfd-409a-be49-8362eea5ec15 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:22:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4b89fcfb-7cfd-409a-be49-8362eea5ec15 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:22:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4b89fcfb-7cfd-409a-be49-8362eea5ec15 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:22:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4b89fcfb-7cfd-409a-be49-8362eea5ec15 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:22:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4b89fcfb-7cfd-409a-be49-8362eea5ec15 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:22:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4b89fcfb-7cfd-409a-be49-8362eea5ec15 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:22:00 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-4b89fcfb-7cfd-409a-be49-8362eea5ec15 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:22:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4b89fcfb-7cfd-409a-be49-8362eea5ec15 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d 2147483648 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:00 devstack sudo[101912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d 2147483648
Nov 05 19:22:00 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:01 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4b89fcfb-7cfd-409a-be49-8362eea5ec15 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d 2147483648" returned: 0 in 0.510s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4b89fcfb-7cfd-409a-be49-8362eea5ec15 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:01 devstack sudo[101918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d
Nov 05 19:22:01 devstack sudo[101918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:01 devstack sudo[101918]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4b89fcfb-7cfd-409a-be49-8362eea5ec15 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d" returned: 0 in 0.259s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4b89fcfb-7cfd-409a-be49-8362eea5ec15 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:22:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4b89fcfb-7cfd-409a-be49-8362eea5ec15 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:22:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4b89fcfb-7cfd-409a-be49-8362eea5ec15 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (378fc7f1-ce9e-4c49-a483-f31985a86f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-891e5f4b-7dae-4886-964c-7b657b4b726d', 'volume_size': 2}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4b89fcfb-7cfd-409a-be49-8362eea5ec15 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5d09914-b71d-4332-b86f-497cfdca63ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:01 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-4b89fcfb-7cfd-409a-be49-8362eea5ec15 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Volume volume-891e5f4b-7dae-4886-964c-7b657b4b726d (891e5f4b-7dae-4886-964c-7b657b4b726d): created successfully
Nov 05 19:22:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4b89fcfb-7cfd-409a-be49-8362eea5ec15 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5d09914-b71d-4332-b86f-497cfdca63ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4b89fcfb-7cfd-409a-be49-8362eea5ec15 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Flow 'volume_create_manager' (7d649ad6-f048-4b53-9eac-ab96b14ec87f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:22:01 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-4b89fcfb-7cfd-409a-be49-8362eea5ec15 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Created volume successfully.
Nov 05 19:22:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-70fbb391-1e4c-440c-977c-a63462148366 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:22:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-70fbb391-1e4c-440c-977c-a63462148366 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:22:02 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-70fbb391-1e4c-440c-977c-a63462148366 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Creating offline snapshot bdaee5b5-9116-4e7c-a18a-d06689a72660 of volume 891e5f4b-7dae-4886-964c-7b657b4b726d {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:22:02 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff397d46-98a5-4be3-ae0a-5b1eec9a1563]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:22:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-70fbb391-1e4c-440c-977c-a63462148366 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:02 devstack sudo[101921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d
Nov 05 19:22:02 devstack sudo[101921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:03 devstack sudo[101921]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-70fbb391-1e4c-440c-977c-a63462148366 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d" returned: 0 in 0.418s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-70fbb391-1e4c-440c-977c-a63462148366 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d.bdaee5b5-9116-4e7c-a18a-d06689a72660 2G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:03 devstack sudo[101926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d.bdaee5b5-9116-4e7c-a18a-d06689a72660 2G
Nov 05 19:22:03 devstack sudo[101926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:03 devstack sudo[101926]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-70fbb391-1e4c-440c-977c-a63462148366 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d.bdaee5b5-9116-4e7c-a18a-d06689a72660 2G" returned: 0 in 0.444s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-70fbb391-1e4c-440c-977c-a63462148366 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-891e5f4b-7dae-4886-964c-7b657b4b726d -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d.bdaee5b5-9116-4e7c-a18a-d06689a72660 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:03 devstack sudo[101933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-891e5f4b-7dae-4886-964c-7b657b4b726d -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d.bdaee5b5-9116-4e7c-a18a-d06689a72660
Nov 05 19:22:03 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:04 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-70fbb391-1e4c-440c-977c-a63462148366 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-891e5f4b-7dae-4886-964c-7b657b4b726d -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d.bdaee5b5-9116-4e7c-a18a-d06689a72660" returned: 0 in 0.315s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:04 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-70fbb391-1e4c-440c-977c-a63462148366 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d.bdaee5b5-9116-4e7c-a18a-d06689a72660 is being set with open permissions: ugo+rw
Nov 05 19:22:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-70fbb391-1e4c-440c-977c-a63462148366 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d.bdaee5b5-9116-4e7c-a18a-d06689a72660 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:04 devstack sudo[101938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d.bdaee5b5-9116-4e7c-a18a-d06689a72660
Nov 05 19:22:04 devstack sudo[101938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:04 devstack sudo[101938]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-70fbb391-1e4c-440c-977c-a63462148366 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d.bdaee5b5-9116-4e7c-a18a-d06689a72660" returned: 0 in 0.267s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-70fbb391-1e4c-440c-977c-a63462148366 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:04 devstack sudo[101941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d.info
Nov 05 19:22:04 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:04 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-70fbb391-1e4c-440c-977c-a63462148366 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d.info" returned: 0 in 0.290s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:04 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-70fbb391-1e4c-440c-977c-a63462148366 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d.info is being set with open permissions: ugo+rw
Nov 05 19:22:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-70fbb391-1e4c-440c-977c-a63462148366 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:04 devstack sudo[101944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d.info
Nov 05 19:22:04 devstack sudo[101944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:04 devstack sudo[101944]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-70fbb391-1e4c-440c-977c-a63462148366 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d.info" returned: 0 in 0.264s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-70fbb391-1e4c-440c-977c-a63462148366 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.123s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:22:04 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-70fbb391-1e4c-440c-977c-a63462148366 tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Create snapshot completed successfully
Nov 05 19:22:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:22:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:22:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:22:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:22:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:22:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:22:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:05 devstack sudo[101947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:22:05 devstack sudo[101947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:05 devstack sudo[101947]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.273s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:05 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:22:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:22:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread count: 28 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 19:22:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread info: [<_MainThread(MainThread, started 126882883072128)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126882770872512)>, <Thread(Thread-3 (stat_writer), started daemon 126882769837376)>, <Thread(Rabbit-heartbeat, started daemon 126882768896256)>, <Thread(Thread-5 (_runner), started daemon 126882768980928)>, <Thread(Thread-7 (_runner), started daemon 126882767016448)>, <Thread(fd_logger, started daemon 126882764561216)>, <Thread(privsep_reader, started daemon 126882764568576)>, <Thread(tpool_thread_0, started daemon 126882759292608)>, <Thread(tpool_thread_1, started daemon 126882750899904)>, <Thread(tpool_thread_2, started daemon 126882742507200)>, <Thread(tpool_thread_3, started daemon 126882734114496)>, <Thread(tpool_thread_4, started daemon 126882725721792)>, <Thread(tpool_thread_5, started daemon 126882717329088)>, <Thread(tpool_thread_6, started daemon 126882708920000)>, <Thread(tpool_thread_7, started daemon 126882700510912)>, <Thread(tpool_thread_8, started daemon 126882692101824)>, <Thread(tpool_thread_9, started daemon 126882683692736)>, <Thread(tpool_thread_10, started daemon 126882675283648)>, <Thread(tpool_thread_11, started daemon 126882666874560)>, <Thread(tpool_thread_12, started daemon 126882658465472)>, <Thread(tpool_thread_13, started daemon 126882650056384)>, <Thread(tpool_thread_14, started daemon 126882641647296)>, <Thread(tpool_thread_15, started daemon 126882633238208)>, <Thread(tpool_thread_16, started daemon 126882624829120)>, <Thread(tpool_thread_17, started daemon 126882616420032)>, <Thread(tpool_thread_18, started daemon 126882608010944)>, <Thread(tpool_thread_19, started daemon 126882599601856)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 19:22:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2b7baded-f1c8-4205-88df-9686cf80092b tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Acquiring lock "cinder-bdaee5b5-9116-4e7c-a18a-d06689a72660-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:22:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2b7baded-f1c8-4205-88df-9686cf80092b tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Lock "cinder-bdaee5b5-9116-4e7c-a18a-d06689a72660-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:22:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2b7baded-f1c8-4205-88df-9686cf80092b tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Acquiring lock "cinder-quobyte-891e5f4b-7dae-4886-964c-7b657b4b726d" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:22:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2b7baded-f1c8-4205-88df-9686cf80092b tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Lock "cinder-quobyte-891e5f4b-7dae-4886-964c-7b657b4b726d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:22:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2b7baded-f1c8-4205-88df-9686cf80092b tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Acquiring lock "cinder-quobyte-bdaee5b5-9116-4e7c-a18a-d06689a72660" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:22:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2b7baded-f1c8-4205-88df-9686cf80092b tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Lock "cinder-quobyte-bdaee5b5-9116-4e7c-a18a-d06689a72660" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:22:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-2b7baded-f1c8-4205-88df-9686cf80092b tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Deleting offline snapshot bdaee5b5-9116-4e7c-a18a-d06689a72660 of volume 891e5f4b-7dae-4886-964c-7b657b4b726d {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:22:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-2b7baded-f1c8-4205-88df-9686cf80092b tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] snapshot_file for this snap is: volume-891e5f4b-7dae-4886-964c-7b657b4b726d.bdaee5b5-9116-4e7c-a18a-d06689a72660 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:22:06 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb17772e-7783-4198-8dbb-a7f1af64b080]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:22:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2b7baded-f1c8-4205-88df-9686cf80092b tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d.bdaee5b5-9116-4e7c-a18a-d06689a72660 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:06 devstack sudo[101950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d.bdaee5b5-9116-4e7c-a18a-d06689a72660
Nov 05 19:22:06 devstack sudo[101950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:06 devstack sudo[101950]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2b7baded-f1c8-4205-88df-9686cf80092b tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d.bdaee5b5-9116-4e7c-a18a-d06689a72660" returned: 0 in 0.380s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-2b7baded-f1c8-4205-88df-9686cf80092b tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-891e5f4b-7dae-4886-964c-7b657b4b726d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:22:06 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c84783b-fa51-4be3-99a1-79f93ed3a812]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:22:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2b7baded-f1c8-4205-88df-9686cf80092b tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:06 devstack sudo[101955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d
Nov 05 19:22:06 devstack sudo[101955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:06 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-41fe1086-7c9e-491e-9f25-9eb9bc2818f2 tempest-CreateVolumesFromImageTest-1403174987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:22:06 devstack sudo[101955]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-41fe1086-7c9e-491e-9f25-9eb9bc2818f2 tempest-CreateVolumesFromImageTest-1403174987 None] Flow 'volume_create_manager' (11d2f311-0d43-493d-8caa-6ea0370de511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-41fe1086-7c9e-491e-9f25-9eb9bc2818f2 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bd5b076-ddf0-4e37-8529-fc6a7e0b8fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2b7baded-f1c8-4205-88df-9686cf80092b tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d" returned: 0 in 0.411s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2b7baded-f1c8-4205-88df-9686cf80092b tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d.bdaee5b5-9116-4e7c-a18a-d06689a72660 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-41fe1086-7c9e-491e-9f25-9eb9bc2818f2 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bd5b076-ddf0-4e37-8529-fc6a7e0b8fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-394213852',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89125780-7017-4f5d-b487-b81e7ebdc9cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e26698c2bfdf4320b55cf9b7f6e010fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:22:07Z,use_quota=True,user_id='a9eb617a74654a959106685bddb8a329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:07 devstack sudo[101960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d.bdaee5b5-9116-4e7c-a18a-d06689a72660
Nov 05 19:22:07 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-41fe1086-7c9e-491e-9f25-9eb9bc2818f2 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97cbd7cc-2f41-47d0-8855-f8d5b141496f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-41fe1086-7c9e-491e-9f25-9eb9bc2818f2 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97cbd7cc-2f41-47d0-8855-f8d5b141496f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-41fe1086-7c9e-491e-9f25-9eb9bc2818f2 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (788b4065-6811-4e25-b318-4824dc727e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-41fe1086-7c9e-491e-9f25-9eb9bc2818f2 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (788b4065-6811-4e25-b318-4824dc727e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89125780-7017-4f5d-b487-b81e7ebdc9cc', 'volume_name': 'volume-89125780-7017-4f5d-b487-b81e7ebdc9cc', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-41fe1086-7c9e-491e-9f25-9eb9bc2818f2 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e7bf2c4-8fb3-4328-9d96-3e9cc72a2642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-41fe1086-7c9e-491e-9f25-9eb9bc2818f2 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e7bf2c4-8fb3-4328-9d96-3e9cc72a2642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-41fe1086-7c9e-491e-9f25-9eb9bc2818f2 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f007154-7cf9-4435-836e-2be1394c0d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:07 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-41fe1086-7c9e-491e-9f25-9eb9bc2818f2 tempest-CreateVolumesFromImageTest-1403174987 None] Volume 89125780-7017-4f5d-b487-b81e7ebdc9cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89125780-7017-4f5d-b487-b81e7ebdc9cc', 'volume_size': 1}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-41fe1086-7c9e-491e-9f25-9eb9bc2818f2 tempest-CreateVolumesFromImageTest-1403174987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-41fe1086-7c9e-491e-9f25-9eb9bc2818f2 tempest-CreateVolumesFromImageTest-1403174987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-41fe1086-7c9e-491e-9f25-9eb9bc2818f2 tempest-CreateVolumesFromImageTest-1403174987 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-394213852',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89125780-7017-4f5d-b487-b81e7ebdc9cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e26698c2bfdf4320b55cf9b7f6e010fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:22:07Z,use_quota=True,user_id='a9eb617a74654a959106685bddb8a329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-41fe1086-7c9e-491e-9f25-9eb9bc2818f2 tempest-CreateVolumesFromImageTest-1403174987 None] Creating volume 89125780-7017-4f5d-b487-b81e7ebdc9cc {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-41fe1086-7c9e-491e-9f25-9eb9bc2818f2 tempest-CreateVolumesFromImageTest-1403174987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-41fe1086-7c9e-491e-9f25-9eb9bc2818f2 tempest-CreateVolumesFromImageTest-1403174987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-41fe1086-7c9e-491e-9f25-9eb9bc2818f2 tempest-CreateVolumesFromImageTest-1403174987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-41fe1086-7c9e-491e-9f25-9eb9bc2818f2 tempest-CreateVolumesFromImageTest-1403174987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-41fe1086-7c9e-491e-9f25-9eb9bc2818f2 tempest-CreateVolumesFromImageTest-1403174987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-41fe1086-7c9e-491e-9f25-9eb9bc2818f2 tempest-CreateVolumesFromImageTest-1403174987 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:22:07 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-41fe1086-7c9e-491e-9f25-9eb9bc2818f2 tempest-CreateVolumesFromImageTest-1403174987 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-41fe1086-7c9e-491e-9f25-9eb9bc2818f2 tempest-CreateVolumesFromImageTest-1403174987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-89125780-7017-4f5d-b487-b81e7ebdc9cc 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:07 devstack sudo[101962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-89125780-7017-4f5d-b487-b81e7ebdc9cc 1073741824
Nov 05 19:22:07 devstack sudo[101962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-c345b5c2-276c-479c-a443-dc81d459f6d6 tempest-CreateVolumesFromImageTest-1403174987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c345b5c2-276c-479c-a443-dc81d459f6d6 tempest-CreateVolumesFromImageTest-1403174987 None] Flow 'volume_create_manager' (a2e98f04-1bcf-4558-b132-f70e4a144db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c345b5c2-276c-479c-a443-dc81d459f6d6 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f97b2c0f-2679-4c98-988d-57c6b0b06d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c345b5c2-276c-479c-a443-dc81d459f6d6 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f97b2c0f-2679-4c98-988d-57c6b0b06d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-450679099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a8f342c-3572-4e8c-995b-e12d9da4f1f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e26698c2bfdf4320b55cf9b7f6e010fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:22:07Z,use_quota=True,user_id='a9eb617a74654a959106685bddb8a329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c345b5c2-276c-479c-a443-dc81d459f6d6 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32f26781-4961-4c8b-85c6-21229fad0e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:07 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c345b5c2-276c-479c-a443-dc81d459f6d6 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32f26781-4961-4c8b-85c6-21229fad0e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c345b5c2-276c-479c-a443-dc81d459f6d6 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4327dae-4b1e-4fa7-9ff4-82291cfcd47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c345b5c2-276c-479c-a443-dc81d459f6d6 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4327dae-4b1e-4fa7-9ff4-82291cfcd47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a8f342c-3572-4e8c-995b-e12d9da4f1f2', 'volume_name': 'volume-9a8f342c-3572-4e8c-995b-e12d9da4f1f2', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c345b5c2-276c-479c-a443-dc81d459f6d6 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5fab8db-5b65-4274-9b5e-bcadf2df36a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c345b5c2-276c-479c-a443-dc81d459f6d6 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5fab8db-5b65-4274-9b5e-bcadf2df36a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c345b5c2-276c-479c-a443-dc81d459f6d6 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee794347-6236-4460-8440-5167afd62104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:07 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-c345b5c2-276c-479c-a443-dc81d459f6d6 tempest-CreateVolumesFromImageTest-1403174987 None] Volume 9a8f342c-3572-4e8c-995b-e12d9da4f1f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a8f342c-3572-4e8c-995b-e12d9da4f1f2', 'volume_size': 1}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c345b5c2-276c-479c-a443-dc81d459f6d6 tempest-CreateVolumesFromImageTest-1403174987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2b7baded-f1c8-4205-88df-9686cf80092b tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d.bdaee5b5-9116-4e7c-a18a-d06689a72660" returned: 0 in 0.488s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2b7baded-f1c8-4205-88df-9686cf80092b tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d.bdaee5b5-9116-4e7c-a18a-d06689a72660 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:07 devstack sudo[101972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d.bdaee5b5-9116-4e7c-a18a-d06689a72660
Nov 05 19:22:07 devstack sudo[101972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:07 devstack sudo[101962]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-41fe1086-7c9e-491e-9f25-9eb9bc2818f2 tempest-CreateVolumesFromImageTest-1403174987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-89125780-7017-4f5d-b487-b81e7ebdc9cc 1073741824" returned: 0 in 0.597s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-41fe1086-7c9e-491e-9f25-9eb9bc2818f2 tempest-CreateVolumesFromImageTest-1403174987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-89125780-7017-4f5d-b487-b81e7ebdc9cc {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:07 devstack sudo[101975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-89125780-7017-4f5d-b487-b81e7ebdc9cc
Nov 05 19:22:07 devstack sudo[101975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:07 devstack sudo[101972]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6ed82b3-50d8-4136-afcf-1c32e2f79ebb tempest-CreateVolumesFromImageTest-1403174987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b6ed82b3-50d8-4136-afcf-1c32e2f79ebb tempest-CreateVolumesFromImageTest-1403174987 None] Flow 'volume_create_manager' (263365bf-95a2-4fd6-a3c8-8d363c8467e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b6ed82b3-50d8-4136-afcf-1c32e2f79ebb tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d6a9879-74e9-4ee2-9f52-619dea6873e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2b7baded-f1c8-4205-88df-9686cf80092b tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d.bdaee5b5-9116-4e7c-a18a-d06689a72660" returned: 0 in 0.329s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b6ed82b3-50d8-4136-afcf-1c32e2f79ebb tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d6a9879-74e9-4ee2-9f52-619dea6873e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-306826626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3231a729-94e8-45c1-ad43-30c72a83a78b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e26698c2bfdf4320b55cf9b7f6e010fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:22:08Z,use_quota=True,user_id='a9eb617a74654a959106685bddb8a329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b6ed82b3-50d8-4136-afcf-1c32e2f79ebb tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eef236ee-5854-4079-9bb1-2bd9df8db62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b6ed82b3-50d8-4136-afcf-1c32e2f79ebb tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eef236ee-5854-4079-9bb1-2bd9df8db62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b6ed82b3-50d8-4136-afcf-1c32e2f79ebb tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ce80917-e6c9-4552-8bce-e8642aed4c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b6ed82b3-50d8-4136-afcf-1c32e2f79ebb tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ce80917-e6c9-4552-8bce-e8642aed4c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3231a729-94e8-45c1-ad43-30c72a83a78b', 'volume_name': 'volume-3231a729-94e8-45c1-ad43-30c72a83a78b', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b6ed82b3-50d8-4136-afcf-1c32e2f79ebb tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d23a2f1-bbb0-4844-a617-50ba4bdb17ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b6ed82b3-50d8-4136-afcf-1c32e2f79ebb tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d23a2f1-bbb0-4844-a617-50ba4bdb17ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b6ed82b3-50d8-4136-afcf-1c32e2f79ebb tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5888fef0-6fab-4291-b19d-31c5b91e770e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:07 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-b6ed82b3-50d8-4136-afcf-1c32e2f79ebb tempest-CreateVolumesFromImageTest-1403174987 None] Volume 3231a729-94e8-45c1-ad43-30c72a83a78b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3231a729-94e8-45c1-ad43-30c72a83a78b', 'volume_size': 1}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b6ed82b3-50d8-4136-afcf-1c32e2f79ebb tempest-CreateVolumesFromImageTest-1403174987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2b7baded-f1c8-4205-88df-9686cf80092b tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Lock "cinder-quobyte-bdaee5b5-9116-4e7c-a18a-d06689a72660" released by "_delete_snapshot" :: held 1.797s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:22:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2b7baded-f1c8-4205-88df-9686cf80092b tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Lock "cinder-quobyte-891e5f4b-7dae-4886-964c-7b657b4b726d" released by "delete_snapshot" :: held 1.825s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-2b7baded-f1c8-4205-88df-9686cf80092b tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Created reservations ['ef6a5450-26e1-4777-9aa1-adeec406e973', 'c3162fdc-2442-43b6-b1e6-73799610850d', 'c7991278-0ff0-4977-afd3-1df6d308fb02', '06d5e6e9-0d7a-4726-a19d-4331568bd3eb'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:22:08 devstack sudo[101975]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-41fe1086-7c9e-491e-9f25-9eb9bc2818f2 tempest-CreateVolumesFromImageTest-1403174987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-89125780-7017-4f5d-b487-b81e7ebdc9cc" returned: 0 in 0.352s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-41fe1086-7c9e-491e-9f25-9eb9bc2818f2 tempest-CreateVolumesFromImageTest-1403174987 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-41fe1086-7c9e-491e-9f25-9eb9bc2818f2 tempest-CreateVolumesFromImageTest-1403174987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c345b5c2-276c-479c-a443-dc81d459f6d6 tempest-CreateVolumesFromImageTest-1403174987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.598s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c345b5c2-276c-479c-a443-dc81d459f6d6 tempest-CreateVolumesFromImageTest-1403174987 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-450679099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a8f342c-3572-4e8c-995b-e12d9da4f1f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e26698c2bfdf4320b55cf9b7f6e010fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:22:07Z,use_quota=True,user_id='a9eb617a74654a959106685bddb8a329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-c345b5c2-276c-479c-a443-dc81d459f6d6 tempest-CreateVolumesFromImageTest-1403174987 None] Creating volume 9a8f342c-3572-4e8c-995b-e12d9da4f1f2 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c345b5c2-276c-479c-a443-dc81d459f6d6 tempest-CreateVolumesFromImageTest-1403174987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c345b5c2-276c-479c-a443-dc81d459f6d6 tempest-CreateVolumesFromImageTest-1403174987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c345b5c2-276c-479c-a443-dc81d459f6d6 tempest-CreateVolumesFromImageTest-1403174987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c345b5c2-276c-479c-a443-dc81d459f6d6 tempest-CreateVolumesFromImageTest-1403174987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c345b5c2-276c-479c-a443-dc81d459f6d6 tempest-CreateVolumesFromImageTest-1403174987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c345b5c2-276c-479c-a443-dc81d459f6d6 tempest-CreateVolumesFromImageTest-1403174987 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:22:08 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-c345b5c2-276c-479c-a443-dc81d459f6d6 tempest-CreateVolumesFromImageTest-1403174987 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c345b5c2-276c-479c-a443-dc81d459f6d6 tempest-CreateVolumesFromImageTest-1403174987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9a8f342c-3572-4e8c-995b-e12d9da4f1f2 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:08 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-2b7baded-f1c8-4205-88df-9686cf80092b tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Delete snapshot completed successfully.
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-41fe1086-7c9e-491e-9f25-9eb9bc2818f2 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f007154-7cf9-4435-836e-2be1394c0d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89125780-7017-4f5d-b487-b81e7ebdc9cc', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:08 devstack sudo[101978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9a8f342c-3572-4e8c-995b-e12d9da4f1f2 1073741824
Nov 05 19:22:08 devstack sudo[101978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-41fe1086-7c9e-491e-9f25-9eb9bc2818f2 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbab041d-49b7-4cce-a4c2-8aead6cebbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2b7baded-f1c8-4205-88df-9686cf80092b tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Lock "cinder-bdaee5b5-9116-4e7c-a18a-d06689a72660-delete_snapshot" released by "delete_snapshot" :: held 2.063s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:22:08 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-41fe1086-7c9e-491e-9f25-9eb9bc2818f2 tempest-CreateVolumesFromImageTest-1403174987 None] Volume volume-89125780-7017-4f5d-b487-b81e7ebdc9cc (89125780-7017-4f5d-b487-b81e7ebdc9cc): created successfully
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-41fe1086-7c9e-491e-9f25-9eb9bc2818f2 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbab041d-49b7-4cce-a4c2-8aead6cebbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-41fe1086-7c9e-491e-9f25-9eb9bc2818f2 tempest-CreateVolumesFromImageTest-1403174987 None] Flow 'volume_create_manager' (11d2f311-0d43-493d-8caa-6ea0370de511) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:22:08 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-41fe1086-7c9e-491e-9f25-9eb9bc2818f2 tempest-CreateVolumesFromImageTest-1403174987 None] Created volume successfully.
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b05fbc7-6aec-428a-a160-c381c4cbdf29 tempest-CreateVolumesFromImageTest-1403174987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4b05fbc7-6aec-428a-a160-c381c4cbdf29 tempest-CreateVolumesFromImageTest-1403174987 None] Flow 'volume_create_manager' (d22a3a7b-55d8-47ec-bbe1-e7a5f27e9ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4b05fbc7-6aec-428a-a160-c381c4cbdf29 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b3e0c98-ae79-4c02-a1a2-7a547ee3a8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4b05fbc7-6aec-428a-a160-c381c4cbdf29 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b3e0c98-ae79-4c02-a1a2-7a547ee3a8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-873506257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a217d4c-1959-406d-9254-48cb3a89582f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e26698c2bfdf4320b55cf9b7f6e010fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:22:08Z,use_quota=True,user_id='a9eb617a74654a959106685bddb8a329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4b05fbc7-6aec-428a-a160-c381c4cbdf29 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (133fcb2d-29a9-4f13-b9e9-685a6caf6263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4b05fbc7-6aec-428a-a160-c381c4cbdf29 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (133fcb2d-29a9-4f13-b9e9-685a6caf6263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4b05fbc7-6aec-428a-a160-c381c4cbdf29 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b10c55a9-b14a-44fd-8e57-0960eefb6ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4b05fbc7-6aec-428a-a160-c381c4cbdf29 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b10c55a9-b14a-44fd-8e57-0960eefb6ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a217d4c-1959-406d-9254-48cb3a89582f', 'volume_name': 'volume-0a217d4c-1959-406d-9254-48cb3a89582f', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4b05fbc7-6aec-428a-a160-c381c4cbdf29 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ce7e5b8-222b-4781-8ffc-c44aa426e7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4b05fbc7-6aec-428a-a160-c381c4cbdf29 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ce7e5b8-222b-4781-8ffc-c44aa426e7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4b05fbc7-6aec-428a-a160-c381c4cbdf29 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96f3c323-2ad4-402b-844c-ca3ce8015547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:08 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-4b05fbc7-6aec-428a-a160-c381c4cbdf29 tempest-CreateVolumesFromImageTest-1403174987 None] Volume 0a217d4c-1959-406d-9254-48cb3a89582f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a217d4c-1959-406d-9254-48cb3a89582f', 'volume_size': 1}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4b05fbc7-6aec-428a-a160-c381c4cbdf29 tempest-CreateVolumesFromImageTest-1403174987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-28500a01-94bb-4b67-8bb6-8b35611d75bd tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Acquiring lock "cinder-891e5f4b-7dae-4886-964c-7b657b4b726d-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-28500a01-94bb-4b67-8bb6-8b35611d75bd tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Lock "cinder-891e5f4b-7dae-4886-964c-7b657b4b726d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-28500a01-94bb-4b67-8bb6-8b35611d75bd tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Acquiring lock "cinder-quobyte-891e5f4b-7dae-4886-964c-7b657b4b726d" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-28500a01-94bb-4b67-8bb6-8b35611d75bd tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Lock "cinder-quobyte-891e5f4b-7dae-4886-964c-7b657b4b726d" acquired by "delete_volume" :: waited 0.015s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a96abee-6e4d-4f4c-8fe2-7a2ca436820b]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28500a01-94bb-4b67-8bb6-8b35611d75bd tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9243d62-1c49-4674-a27a-37f55068ff27 tempest-CreateVolumesFromImageTest-1403174987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b9243d62-1c49-4674-a27a-37f55068ff27 tempest-CreateVolumesFromImageTest-1403174987 None] Flow 'volume_create_manager' (883d2cbe-22c8-4f54-a5be-e65518388e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b9243d62-1c49-4674-a27a-37f55068ff27 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38e1193d-eb73-436d-af1d-9da8c631cd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:08 devstack sudo[101978]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c345b5c2-276c-479c-a443-dc81d459f6d6 tempest-CreateVolumesFromImageTest-1403174987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9a8f342c-3572-4e8c-995b-e12d9da4f1f2 1073741824" returned: 0 in 0.597s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b9243d62-1c49-4674-a27a-37f55068ff27 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38e1193d-eb73-436d-af1d-9da8c631cd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-760651234',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=348177c0-be1e-42dd-bc97-39ef123f23d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e26698c2bfdf4320b55cf9b7f6e010fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:22:09Z,use_quota=True,user_id='a9eb617a74654a959106685bddb8a329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b9243d62-1c49-4674-a27a-37f55068ff27 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b98ffeb-fb87-46dd-be6d-fa2e84e9642a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b9243d62-1c49-4674-a27a-37f55068ff27 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b98ffeb-fb87-46dd-be6d-fa2e84e9642a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b9243d62-1c49-4674-a27a-37f55068ff27 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2ea4a0b-9d6d-428c-a1bf-bf1b6f299f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b9243d62-1c49-4674-a27a-37f55068ff27 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2ea4a0b-9d6d-428c-a1bf-bf1b6f299f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '348177c0-be1e-42dd-bc97-39ef123f23d3', 'volume_name': 'volume-348177c0-be1e-42dd-bc97-39ef123f23d3', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b9243d62-1c49-4674-a27a-37f55068ff27 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc8be97b-9685-4b94-a2de-9273523e9292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:08 devstack sudo[101984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d
Nov 05 19:22:08 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b9243d62-1c49-4674-a27a-37f55068ff27 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc8be97b-9685-4b94-a2de-9273523e9292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b9243d62-1c49-4674-a27a-37f55068ff27 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c5310be-1f23-49de-9c6c-f7af3cd0c3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:08 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-b9243d62-1c49-4674-a27a-37f55068ff27 tempest-CreateVolumesFromImageTest-1403174987 None] Volume 348177c0-be1e-42dd-bc97-39ef123f23d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-348177c0-be1e-42dd-bc97-39ef123f23d3', 'volume_size': 1}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b9243d62-1c49-4674-a27a-37f55068ff27 tempest-CreateVolumesFromImageTest-1403174987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:22:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c345b5c2-276c-479c-a443-dc81d459f6d6 tempest-CreateVolumesFromImageTest-1403174987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9a8f342c-3572-4e8c-995b-e12d9da4f1f2 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:08 devstack sudo[101986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9a8f342c-3572-4e8c-995b-e12d9da4f1f2
Nov 05 19:22:08 devstack sudo[101986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:09 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28500a01-94bb-4b67-8bb6-8b35611d75bd tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d" returned: 0 in 0.393s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28500a01-94bb-4b67-8bb6-8b35611d75bd tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:09 devstack sudo[101992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d
Nov 05 19:22:09 devstack sudo[101992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:09 devstack sudo[101986]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c345b5c2-276c-479c-a443-dc81d459f6d6 tempest-CreateVolumesFromImageTest-1403174987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9a8f342c-3572-4e8c-995b-e12d9da4f1f2" returned: 0 in 0.277s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c345b5c2-276c-479c-a443-dc81d459f6d6 tempest-CreateVolumesFromImageTest-1403174987 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c345b5c2-276c-479c-a443-dc81d459f6d6 tempest-CreateVolumesFromImageTest-1403174987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b6ed82b3-50d8-4136-afcf-1c32e2f79ebb tempest-CreateVolumesFromImageTest-1403174987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.170s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b6ed82b3-50d8-4136-afcf-1c32e2f79ebb tempest-CreateVolumesFromImageTest-1403174987 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-306826626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3231a729-94e8-45c1-ad43-30c72a83a78b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e26698c2bfdf4320b55cf9b7f6e010fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:22:08Z,use_quota=True,user_id='a9eb617a74654a959106685bddb8a329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-b6ed82b3-50d8-4136-afcf-1c32e2f79ebb tempest-CreateVolumesFromImageTest-1403174987 None] Creating volume 3231a729-94e8-45c1-ad43-30c72a83a78b {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b6ed82b3-50d8-4136-afcf-1c32e2f79ebb tempest-CreateVolumesFromImageTest-1403174987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b6ed82b3-50d8-4136-afcf-1c32e2f79ebb tempest-CreateVolumesFromImageTest-1403174987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b6ed82b3-50d8-4136-afcf-1c32e2f79ebb tempest-CreateVolumesFromImageTest-1403174987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b6ed82b3-50d8-4136-afcf-1c32e2f79ebb tempest-CreateVolumesFromImageTest-1403174987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b6ed82b3-50d8-4136-afcf-1c32e2f79ebb tempest-CreateVolumesFromImageTest-1403174987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b6ed82b3-50d8-4136-afcf-1c32e2f79ebb tempest-CreateVolumesFromImageTest-1403174987 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:22:09 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-b6ed82b3-50d8-4136-afcf-1c32e2f79ebb tempest-CreateVolumesFromImageTest-1403174987 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b6ed82b3-50d8-4136-afcf-1c32e2f79ebb tempest-CreateVolumesFromImageTest-1403174987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3231a729-94e8-45c1-ad43-30c72a83a78b 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:09 devstack sudo[101994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3231a729-94e8-45c1-ad43-30c72a83a78b 1073741824
Nov 05 19:22:09 devstack sudo[101994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c345b5c2-276c-479c-a443-dc81d459f6d6 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee794347-6236-4460-8440-5167afd62104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a8f342c-3572-4e8c-995b-e12d9da4f1f2', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c345b5c2-276c-479c-a443-dc81d459f6d6 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e3246d0-f02f-4c44-b980-c7660c254a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:09 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-c345b5c2-276c-479c-a443-dc81d459f6d6 tempest-CreateVolumesFromImageTest-1403174987 None] Volume volume-9a8f342c-3572-4e8c-995b-e12d9da4f1f2 (9a8f342c-3572-4e8c-995b-e12d9da4f1f2): created successfully
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c345b5c2-276c-479c-a443-dc81d459f6d6 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e3246d0-f02f-4c44-b980-c7660c254a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c345b5c2-276c-479c-a443-dc81d459f6d6 tempest-CreateVolumesFromImageTest-1403174987 None] Flow 'volume_create_manager' (a2e98f04-1bcf-4558-b132-f70e4a144db3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:22:09 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-c345b5c2-276c-479c-a443-dc81d459f6d6 tempest-CreateVolumesFromImageTest-1403174987 None] Created volume successfully.
Nov 05 19:22:09 devstack sudo[101992]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28500a01-94bb-4b67-8bb6-8b35611d75bd tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-891e5f4b-7dae-4886-964c-7b657b4b726d" returned: 0 in 0.293s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-28500a01-94bb-4b67-8bb6-8b35611d75bd tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Lock "cinder-quobyte-891e5f4b-7dae-4886-964c-7b657b4b726d" released by "delete_volume" :: held 0.775s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-28500a01-94bb-4b67-8bb6-8b35611d75bd tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Created reservations ['3cd9f367-e55b-4f79-9999-6a2642c24fdc', 'dd0f1164-e689-4fa1-abe4-b1218672bc76', '83acd52e-32fe-4cf4-b759-01000356ee5a', '23a0802e-7287-4146-94c5-51b735eee5ca'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28500a01-94bb-4b67-8bb6-8b35611d75bd tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28500a01-94bb-4b67-8bb6-8b35611d75bd tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28500a01-94bb-4b67-8bb6-8b35611d75bd tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28500a01-94bb-4b67-8bb6-8b35611d75bd tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28500a01-94bb-4b67-8bb6-8b35611d75bd tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28500a01-94bb-4b67-8bb6-8b35611d75bd tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:09 devstack sudo[102000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:22:09 devstack sudo[102000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:09 devstack sudo[101994]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b6ed82b3-50d8-4136-afcf-1c32e2f79ebb tempest-CreateVolumesFromImageTest-1403174987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3231a729-94e8-45c1-ad43-30c72a83a78b 1073741824" returned: 0 in 0.483s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b6ed82b3-50d8-4136-afcf-1c32e2f79ebb tempest-CreateVolumesFromImageTest-1403174987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3231a729-94e8-45c1-ad43-30c72a83a78b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:09 devstack sudo[102003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3231a729-94e8-45c1-ad43-30c72a83a78b
Nov 05 19:22:09 devstack sudo[102003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:09 devstack sudo[102000]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28500a01-94bb-4b67-8bb6-8b35611d75bd tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.326s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-28500a01-94bb-4b67-8bb6-8b35611d75bd tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:22:09 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-28500a01-94bb-4b67-8bb6-8b35611d75bd tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Deleted volume successfully.
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-28500a01-94bb-4b67-8bb6-8b35611d75bd tempest-VolumesSnapshotNegativeTestJSON-2116264197 None] Lock "cinder-891e5f4b-7dae-4886-964c-7b657b4b726d-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:22:09 devstack sudo[102003]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b6ed82b3-50d8-4136-afcf-1c32e2f79ebb tempest-CreateVolumesFromImageTest-1403174987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3231a729-94e8-45c1-ad43-30c72a83a78b" returned: 0 in 0.291s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b6ed82b3-50d8-4136-afcf-1c32e2f79ebb tempest-CreateVolumesFromImageTest-1403174987 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b6ed82b3-50d8-4136-afcf-1c32e2f79ebb tempest-CreateVolumesFromImageTest-1403174987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4b05fbc7-6aec-428a-a160-c381c4cbdf29 tempest-CreateVolumesFromImageTest-1403174987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.543s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4b05fbc7-6aec-428a-a160-c381c4cbdf29 tempest-CreateVolumesFromImageTest-1403174987 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-873506257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a217d4c-1959-406d-9254-48cb3a89582f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e26698c2bfdf4320b55cf9b7f6e010fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:22:08Z,use_quota=True,user_id='a9eb617a74654a959106685bddb8a329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-4b05fbc7-6aec-428a-a160-c381c4cbdf29 tempest-CreateVolumesFromImageTest-1403174987 None] Creating volume 0a217d4c-1959-406d-9254-48cb3a89582f {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4b05fbc7-6aec-428a-a160-c381c4cbdf29 tempest-CreateVolumesFromImageTest-1403174987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4b05fbc7-6aec-428a-a160-c381c4cbdf29 tempest-CreateVolumesFromImageTest-1403174987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4b05fbc7-6aec-428a-a160-c381c4cbdf29 tempest-CreateVolumesFromImageTest-1403174987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4b05fbc7-6aec-428a-a160-c381c4cbdf29 tempest-CreateVolumesFromImageTest-1403174987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4b05fbc7-6aec-428a-a160-c381c4cbdf29 tempest-CreateVolumesFromImageTest-1403174987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4b05fbc7-6aec-428a-a160-c381c4cbdf29 tempest-CreateVolumesFromImageTest-1403174987 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:22:09 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-4b05fbc7-6aec-428a-a160-c381c4cbdf29 tempest-CreateVolumesFromImageTest-1403174987 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4b05fbc7-6aec-428a-a160-c381c4cbdf29 tempest-CreateVolumesFromImageTest-1403174987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0a217d4c-1959-406d-9254-48cb3a89582f 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b6ed82b3-50d8-4136-afcf-1c32e2f79ebb tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5888fef0-6fab-4291-b19d-31c5b91e770e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3231a729-94e8-45c1-ad43-30c72a83a78b', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:09 devstack sudo[102007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0a217d4c-1959-406d-9254-48cb3a89582f 1073741824
Nov 05 19:22:09 devstack sudo[102007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b6ed82b3-50d8-4136-afcf-1c32e2f79ebb tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb8210ba-acdd-441c-a32e-1989b372682c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:09 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-b6ed82b3-50d8-4136-afcf-1c32e2f79ebb tempest-CreateVolumesFromImageTest-1403174987 None] Volume volume-3231a729-94e8-45c1-ad43-30c72a83a78b (3231a729-94e8-45c1-ad43-30c72a83a78b): created successfully
Nov 05 19:22:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b6ed82b3-50d8-4136-afcf-1c32e2f79ebb tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb8210ba-acdd-441c-a32e-1989b372682c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b6ed82b3-50d8-4136-afcf-1c32e2f79ebb tempest-CreateVolumesFromImageTest-1403174987 None] Flow 'volume_create_manager' (263365bf-95a2-4fd6-a3c8-8d363c8467e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:22:10 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b6ed82b3-50d8-4136-afcf-1c32e2f79ebb tempest-CreateVolumesFromImageTest-1403174987 None] Created volume successfully.
Nov 05 19:22:10 devstack sudo[102007]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4b05fbc7-6aec-428a-a160-c381c4cbdf29 tempest-CreateVolumesFromImageTest-1403174987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0a217d4c-1959-406d-9254-48cb3a89582f 1073741824" returned: 0 in 0.471s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4b05fbc7-6aec-428a-a160-c381c4cbdf29 tempest-CreateVolumesFromImageTest-1403174987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0a217d4c-1959-406d-9254-48cb3a89582f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:10 devstack sudo[102013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0a217d4c-1959-406d-9254-48cb3a89582f
Nov 05 19:22:10 devstack sudo[102013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:10 devstack sudo[102013]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4b05fbc7-6aec-428a-a160-c381c4cbdf29 tempest-CreateVolumesFromImageTest-1403174987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0a217d4c-1959-406d-9254-48cb3a89582f" returned: 0 in 0.254s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4b05fbc7-6aec-428a-a160-c381c4cbdf29 tempest-CreateVolumesFromImageTest-1403174987 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:22:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4b05fbc7-6aec-428a-a160-c381c4cbdf29 tempest-CreateVolumesFromImageTest-1403174987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:22:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b9243d62-1c49-4674-a27a-37f55068ff27 tempest-CreateVolumesFromImageTest-1403174987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.929s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:22:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b9243d62-1c49-4674-a27a-37f55068ff27 tempest-CreateVolumesFromImageTest-1403174987 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-760651234',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=348177c0-be1e-42dd-bc97-39ef123f23d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e26698c2bfdf4320b55cf9b7f6e010fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:22:09Z,use_quota=True,user_id='a9eb617a74654a959106685bddb8a329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:22:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-b9243d62-1c49-4674-a27a-37f55068ff27 tempest-CreateVolumesFromImageTest-1403174987 None] Creating volume 348177c0-be1e-42dd-bc97-39ef123f23d3 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:22:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b9243d62-1c49-4674-a27a-37f55068ff27 tempest-CreateVolumesFromImageTest-1403174987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:22:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b9243d62-1c49-4674-a27a-37f55068ff27 tempest-CreateVolumesFromImageTest-1403174987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:22:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b9243d62-1c49-4674-a27a-37f55068ff27 tempest-CreateVolumesFromImageTest-1403174987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:22:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b9243d62-1c49-4674-a27a-37f55068ff27 tempest-CreateVolumesFromImageTest-1403174987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:22:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b9243d62-1c49-4674-a27a-37f55068ff27 tempest-CreateVolumesFromImageTest-1403174987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:22:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b9243d62-1c49-4674-a27a-37f55068ff27 tempest-CreateVolumesFromImageTest-1403174987 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:22:10 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-b9243d62-1c49-4674-a27a-37f55068ff27 tempest-CreateVolumesFromImageTest-1403174987 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:22:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b9243d62-1c49-4674-a27a-37f55068ff27 tempest-CreateVolumesFromImageTest-1403174987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-348177c0-be1e-42dd-bc97-39ef123f23d3 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:10 devstack sudo[102016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-348177c0-be1e-42dd-bc97-39ef123f23d3 1073741824
Nov 05 19:22:10 devstack sudo[102016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4b05fbc7-6aec-428a-a160-c381c4cbdf29 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96f3c323-2ad4-402b-844c-ca3ce8015547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a217d4c-1959-406d-9254-48cb3a89582f', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4b05fbc7-6aec-428a-a160-c381c4cbdf29 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9a16e0a-38a8-4de4-a220-7828ecbf1e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:10 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-4b05fbc7-6aec-428a-a160-c381c4cbdf29 tempest-CreateVolumesFromImageTest-1403174987 None] Volume volume-0a217d4c-1959-406d-9254-48cb3a89582f (0a217d4c-1959-406d-9254-48cb3a89582f): created successfully
Nov 05 19:22:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4b05fbc7-6aec-428a-a160-c381c4cbdf29 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9a16e0a-38a8-4de4-a220-7828ecbf1e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4b05fbc7-6aec-428a-a160-c381c4cbdf29 tempest-CreateVolumesFromImageTest-1403174987 None] Flow 'volume_create_manager' (d22a3a7b-55d8-47ec-bbe1-e7a5f27e9ad9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:22:10 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-4b05fbc7-6aec-428a-a160-c381c4cbdf29 tempest-CreateVolumesFromImageTest-1403174987 None] Created volume successfully.
Nov 05 19:22:11 devstack sudo[102016]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b9243d62-1c49-4674-a27a-37f55068ff27 tempest-CreateVolumesFromImageTest-1403174987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-348177c0-be1e-42dd-bc97-39ef123f23d3 1073741824" returned: 0 in 0.503s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b9243d62-1c49-4674-a27a-37f55068ff27 tempest-CreateVolumesFromImageTest-1403174987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-348177c0-be1e-42dd-bc97-39ef123f23d3 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:11 devstack sudo[102023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-348177c0-be1e-42dd-bc97-39ef123f23d3
Nov 05 19:22:11 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:11 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b9243d62-1c49-4674-a27a-37f55068ff27 tempest-CreateVolumesFromImageTest-1403174987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-348177c0-be1e-42dd-bc97-39ef123f23d3" returned: 0 in 0.257s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b9243d62-1c49-4674-a27a-37f55068ff27 tempest-CreateVolumesFromImageTest-1403174987 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:22:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b9243d62-1c49-4674-a27a-37f55068ff27 tempest-CreateVolumesFromImageTest-1403174987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:22:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b9243d62-1c49-4674-a27a-37f55068ff27 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c5310be-1f23-49de-9c6c-f7af3cd0c3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-348177c0-be1e-42dd-bc97-39ef123f23d3', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b9243d62-1c49-4674-a27a-37f55068ff27 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49e2f65d-2cad-4955-9533-ba7fb2dfd731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:11 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-b9243d62-1c49-4674-a27a-37f55068ff27 tempest-CreateVolumesFromImageTest-1403174987 None] Volume volume-348177c0-be1e-42dd-bc97-39ef123f23d3 (348177c0-be1e-42dd-bc97-39ef123f23d3): created successfully
Nov 05 19:22:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b9243d62-1c49-4674-a27a-37f55068ff27 tempest-CreateVolumesFromImageTest-1403174987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49e2f65d-2cad-4955-9533-ba7fb2dfd731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b9243d62-1c49-4674-a27a-37f55068ff27 tempest-CreateVolumesFromImageTest-1403174987 None] Flow 'volume_create_manager' (883d2cbe-22c8-4f54-a5be-e65518388e45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:22:11 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b9243d62-1c49-4674-a27a-37f55068ff27 tempest-CreateVolumesFromImageTest-1403174987 None] Created volume successfully.
Nov 05 19:22:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-46916773-1ef4-4aad-886e-1cd90ce709fe tempest-CreateVolumesFromImageTest-1403174987 None] Acquiring lock "cinder-348177c0-be1e-42dd-bc97-39ef123f23d3-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:22:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-46916773-1ef4-4aad-886e-1cd90ce709fe tempest-CreateVolumesFromImageTest-1403174987 None] Lock "cinder-348177c0-be1e-42dd-bc97-39ef123f23d3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:22:12 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=106,cinder:INSERT=30,cinder:UPDATE=119,cinder:DELETE=11 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:22:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-46916773-1ef4-4aad-886e-1cd90ce709fe tempest-CreateVolumesFromImageTest-1403174987 None] Acquiring lock "cinder-quobyte-348177c0-be1e-42dd-bc97-39ef123f23d3" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:22:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-46916773-1ef4-4aad-886e-1cd90ce709fe tempest-CreateVolumesFromImageTest-1403174987 None] Lock "cinder-quobyte-348177c0-be1e-42dd-bc97-39ef123f23d3" acquired by "delete_volume" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:22:12 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f8a8a6-a363-4512-8113-8c847856601e]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:22:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-46916773-1ef4-4aad-886e-1cd90ce709fe tempest-CreateVolumesFromImageTest-1403174987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-348177c0-be1e-42dd-bc97-39ef123f23d3 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:12 devstack sudo[102026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-348177c0-be1e-42dd-bc97-39ef123f23d3
Nov 05 19:22:12 devstack sudo[102026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:12 devstack sudo[102026]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-46916773-1ef4-4aad-886e-1cd90ce709fe tempest-CreateVolumesFromImageTest-1403174987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-348177c0-be1e-42dd-bc97-39ef123f23d3" returned: 0 in 0.406s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-46916773-1ef4-4aad-886e-1cd90ce709fe tempest-CreateVolumesFromImageTest-1403174987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-348177c0-be1e-42dd-bc97-39ef123f23d3 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:12 devstack sudo[102031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-348177c0-be1e-42dd-bc97-39ef123f23d3
Nov 05 19:22:12 devstack sudo[102031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:12 devstack sudo[102031]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-46916773-1ef4-4aad-886e-1cd90ce709fe tempest-CreateVolumesFromImageTest-1403174987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-348177c0-be1e-42dd-bc97-39ef123f23d3" returned: 0 in 0.265s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-46916773-1ef4-4aad-886e-1cd90ce709fe tempest-CreateVolumesFromImageTest-1403174987 None] Lock "cinder-quobyte-348177c0-be1e-42dd-bc97-39ef123f23d3" released by "delete_volume" :: held 0.721s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:22:12 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=130,cinder:UPDATE=134,cinder:DELETE=11,cinder:INSERT=31 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:22:12 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-46916773-1ef4-4aad-886e-1cd90ce709fe tempest-CreateVolumesFromImageTest-1403174987 None] Created reservations ['8d577d31-a3b0-4ea9-8100-dda17c59e11c', '60dfab6c-104f-4ce4-a028-e84f11c903bd', '9df76890-2bac-432a-8ba2-bbef96f17bd5', 'e97011d2-0c91-4734-8cdb-f74994199a4b'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:22:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-46916773-1ef4-4aad-886e-1cd90ce709fe tempest-CreateVolumesFromImageTest-1403174987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:22:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-46916773-1ef4-4aad-886e-1cd90ce709fe tempest-CreateVolumesFromImageTest-1403174987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:22:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-46916773-1ef4-4aad-886e-1cd90ce709fe tempest-CreateVolumesFromImageTest-1403174987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:22:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-46916773-1ef4-4aad-886e-1cd90ce709fe tempest-CreateVolumesFromImageTest-1403174987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:22:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-46916773-1ef4-4aad-886e-1cd90ce709fe tempest-CreateVolumesFromImageTest-1403174987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:22:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-46916773-1ef4-4aad-886e-1cd90ce709fe tempest-CreateVolumesFromImageTest-1403174987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:13 devstack sudo[102034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:22:13 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-be8b8fda-c348-43e5-99fd-d74dcfce42a4 tempest-CreateVolumesFromImageTest-1403174987 None] Acquiring lock "cinder-0a217d4c-1959-406d-9254-48cb3a89582f-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:22:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-be8b8fda-c348-43e5-99fd-d74dcfce42a4 tempest-CreateVolumesFromImageTest-1403174987 None] Lock "cinder-0a217d4c-1959-406d-9254-48cb3a89582f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:22:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-be8b8fda-c348-43e5-99fd-d74dcfce42a4 tempest-CreateVolumesFromImageTest-1403174987 None] Acquiring lock "cinder-quobyte-0a217d4c-1959-406d-9254-48cb3a89582f" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:22:13 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-46916773-1ef4-4aad-886e-1cd90ce709fe tempest-CreateVolumesFromImageTest-1403174987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.334s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:13 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-46916773-1ef4-4aad-886e-1cd90ce709fe tempest-CreateVolumesFromImageTest-1403174987 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:22:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-be8b8fda-c348-43e5-99fd-d74dcfce42a4 tempest-CreateVolumesFromImageTest-1403174987 None] Lock "cinder-quobyte-0a217d4c-1959-406d-9254-48cb3a89582f" acquired by "delete_volume" :: waited 0.029s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:22:13 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-46916773-1ef4-4aad-886e-1cd90ce709fe tempest-CreateVolumesFromImageTest-1403174987 None] Deleted volume successfully.
Nov 05 19:22:13 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[06841b65-0050-45ce-a517-7de0afaccf46]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:22:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be8b8fda-c348-43e5-99fd-d74dcfce42a4 tempest-CreateVolumesFromImageTest-1403174987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0a217d4c-1959-406d-9254-48cb3a89582f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-46916773-1ef4-4aad-886e-1cd90ce709fe tempest-CreateVolumesFromImageTest-1403174987 None] Lock "cinder-348177c0-be1e-42dd-bc97-39ef123f23d3-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:22:13 devstack sudo[102037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0a217d4c-1959-406d-9254-48cb3a89582f
Nov 05 19:22:13 devstack sudo[102037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:13 devstack sudo[102037]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be8b8fda-c348-43e5-99fd-d74dcfce42a4 tempest-CreateVolumesFromImageTest-1403174987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0a217d4c-1959-406d-9254-48cb3a89582f" returned: 0 in 0.388s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be8b8fda-c348-43e5-99fd-d74dcfce42a4 tempest-CreateVolumesFromImageTest-1403174987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0a217d4c-1959-406d-9254-48cb3a89582f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:13 devstack sudo[102042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0a217d4c-1959-406d-9254-48cb3a89582f
Nov 05 19:22:13 devstack sudo[102042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:14 devstack sudo[102042]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be8b8fda-c348-43e5-99fd-d74dcfce42a4 tempest-CreateVolumesFromImageTest-1403174987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0a217d4c-1959-406d-9254-48cb3a89582f" returned: 0 in 0.261s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-be8b8fda-c348-43e5-99fd-d74dcfce42a4 tempest-CreateVolumesFromImageTest-1403174987 None] Lock "cinder-quobyte-0a217d4c-1959-406d-9254-48cb3a89582f" released by "delete_volume" :: held 0.726s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:22:14 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-be8b8fda-c348-43e5-99fd-d74dcfce42a4 tempest-CreateVolumesFromImageTest-1403174987 None] Created reservations ['4e834e0f-6daf-4bf1-a6fd-060b2eb460c9', 'b9d651bb-3fd1-48de-bf5f-df01aea86f15', '7931da66-ebb6-43fe-b930-90f03dcbd75b', '10dedac8-4c82-4c8d-8197-fdfa83bbb928'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:22:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-be8b8fda-c348-43e5-99fd-d74dcfce42a4 tempest-CreateVolumesFromImageTest-1403174987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:22:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-be8b8fda-c348-43e5-99fd-d74dcfce42a4 tempest-CreateVolumesFromImageTest-1403174987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:22:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-be8b8fda-c348-43e5-99fd-d74dcfce42a4 tempest-CreateVolumesFromImageTest-1403174987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:22:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-be8b8fda-c348-43e5-99fd-d74dcfce42a4 tempest-CreateVolumesFromImageTest-1403174987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:22:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-be8b8fda-c348-43e5-99fd-d74dcfce42a4 tempest-CreateVolumesFromImageTest-1403174987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:22:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be8b8fda-c348-43e5-99fd-d74dcfce42a4 tempest-CreateVolumesFromImageTest-1403174987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:14 devstack sudo[102045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:22:14 devstack sudo[102045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6b90242c-f287-4ae3-b7c2-4e2c52e8dc18 tempest-CreateVolumesFromImageTest-1403174987 None] Acquiring lock "cinder-3231a729-94e8-45c1-ad43-30c72a83a78b-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:22:14 devstack sudo[102045]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6b90242c-f287-4ae3-b7c2-4e2c52e8dc18 tempest-CreateVolumesFromImageTest-1403174987 None] Lock "cinder-3231a729-94e8-45c1-ad43-30c72a83a78b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:22:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be8b8fda-c348-43e5-99fd-d74dcfce42a4 tempest-CreateVolumesFromImageTest-1403174987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.288s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:14 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-be8b8fda-c348-43e5-99fd-d74dcfce42a4 tempest-CreateVolumesFromImageTest-1403174987 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:22:14 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-be8b8fda-c348-43e5-99fd-d74dcfce42a4 tempest-CreateVolumesFromImageTest-1403174987 None] Deleted volume successfully.
Nov 05 19:22:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-be8b8fda-c348-43e5-99fd-d74dcfce42a4 tempest-CreateVolumesFromImageTest-1403174987 None] Lock "cinder-0a217d4c-1959-406d-9254-48cb3a89582f-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:22:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6b90242c-f287-4ae3-b7c2-4e2c52e8dc18 tempest-CreateVolumesFromImageTest-1403174987 None] Acquiring lock "cinder-quobyte-3231a729-94e8-45c1-ad43-30c72a83a78b" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:22:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6b90242c-f287-4ae3-b7c2-4e2c52e8dc18 tempest-CreateVolumesFromImageTest-1403174987 None] Lock "cinder-quobyte-3231a729-94e8-45c1-ad43-30c72a83a78b" acquired by "delete_volume" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:22:14 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7796ff99-150b-4d51-9ca0-ca29e1d01bb5]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:22:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6b90242c-f287-4ae3-b7c2-4e2c52e8dc18 tempest-CreateVolumesFromImageTest-1403174987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3231a729-94e8-45c1-ad43-30c72a83a78b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:14 devstack sudo[102048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3231a729-94e8-45c1-ad43-30c72a83a78b
Nov 05 19:22:14 devstack sudo[102048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:15 devstack sudo[102048]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6b90242c-f287-4ae3-b7c2-4e2c52e8dc18 tempest-CreateVolumesFromImageTest-1403174987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3231a729-94e8-45c1-ad43-30c72a83a78b" returned: 0 in 0.378s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6b90242c-f287-4ae3-b7c2-4e2c52e8dc18 tempest-CreateVolumesFromImageTest-1403174987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3231a729-94e8-45c1-ad43-30c72a83a78b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:15 devstack sudo[102053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3231a729-94e8-45c1-ad43-30c72a83a78b
Nov 05 19:22:15 devstack sudo[102053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:15 devstack sudo[102053]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6b90242c-f287-4ae3-b7c2-4e2c52e8dc18 tempest-CreateVolumesFromImageTest-1403174987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3231a729-94e8-45c1-ad43-30c72a83a78b" returned: 0 in 0.268s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6b90242c-f287-4ae3-b7c2-4e2c52e8dc18 tempest-CreateVolumesFromImageTest-1403174987 None] Lock "cinder-quobyte-3231a729-94e8-45c1-ad43-30c72a83a78b" released by "delete_volume" :: held 0.700s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:22:15 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-6b90242c-f287-4ae3-b7c2-4e2c52e8dc18 tempest-CreateVolumesFromImageTest-1403174987 None] Created reservations ['a2c00ce1-6452-4c66-bcf4-cbad847628b3', 'b3f7ad0b-f7ef-40d3-a41e-5b86158e12f7', '0de7214e-7ad4-402e-9c7d-1007987cdc95', '60c494ab-834f-447b-9822-5ab042c1178d'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:22:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6b90242c-f287-4ae3-b7c2-4e2c52e8dc18 tempest-CreateVolumesFromImageTest-1403174987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:22:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6b90242c-f287-4ae3-b7c2-4e2c52e8dc18 tempest-CreateVolumesFromImageTest-1403174987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:22:15 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6b90242c-f287-4ae3-b7c2-4e2c52e8dc18 tempest-CreateVolumesFromImageTest-1403174987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:22:15 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6b90242c-f287-4ae3-b7c2-4e2c52e8dc18 tempest-CreateVolumesFromImageTest-1403174987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:22:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6b90242c-f287-4ae3-b7c2-4e2c52e8dc18 tempest-CreateVolumesFromImageTest-1403174987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:22:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6b90242c-f287-4ae3-b7c2-4e2c52e8dc18 tempest-CreateVolumesFromImageTest-1403174987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:15 devstack sudo[102056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:22:15 devstack sudo[102056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:15 devstack sudo[102056]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6b90242c-f287-4ae3-b7c2-4e2c52e8dc18 tempest-CreateVolumesFromImageTest-1403174987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.276s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:15 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-6b90242c-f287-4ae3-b7c2-4e2c52e8dc18 tempest-CreateVolumesFromImageTest-1403174987 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:22:15 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-6b90242c-f287-4ae3-b7c2-4e2c52e8dc18 tempest-CreateVolumesFromImageTest-1403174987 None] Deleted volume successfully.
Nov 05 19:22:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4f2bd279-b15c-4f75-b4b1-21e7562efd30 tempest-CreateVolumesFromImageTest-1403174987 None] Acquiring lock "cinder-9a8f342c-3572-4e8c-995b-e12d9da4f1f2-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:22:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4f2bd279-b15c-4f75-b4b1-21e7562efd30 tempest-CreateVolumesFromImageTest-1403174987 None] Lock "cinder-9a8f342c-3572-4e8c-995b-e12d9da4f1f2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:22:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6b90242c-f287-4ae3-b7c2-4e2c52e8dc18 tempest-CreateVolumesFromImageTest-1403174987 None] Lock "cinder-3231a729-94e8-45c1-ad43-30c72a83a78b-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:22:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4f2bd279-b15c-4f75-b4b1-21e7562efd30 tempest-CreateVolumesFromImageTest-1403174987 None] Acquiring lock "cinder-quobyte-9a8f342c-3572-4e8c-995b-e12d9da4f1f2" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:22:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4f2bd279-b15c-4f75-b4b1-21e7562efd30 tempest-CreateVolumesFromImageTest-1403174987 None] Lock "cinder-quobyte-9a8f342c-3572-4e8c-995b-e12d9da4f1f2" acquired by "delete_volume" :: waited 0.023s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:22:15 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b000109-48f9-4981-953b-8f6689ed5f28]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:22:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4f2bd279-b15c-4f75-b4b1-21e7562efd30 tempest-CreateVolumesFromImageTest-1403174987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9a8f342c-3572-4e8c-995b-e12d9da4f1f2 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:16 devstack sudo[102059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9a8f342c-3572-4e8c-995b-e12d9da4f1f2
Nov 05 19:22:16 devstack sudo[102059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:16 devstack sudo[102059]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4f2bd279-b15c-4f75-b4b1-21e7562efd30 tempest-CreateVolumesFromImageTest-1403174987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9a8f342c-3572-4e8c-995b-e12d9da4f1f2" returned: 0 in 0.386s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4f2bd279-b15c-4f75-b4b1-21e7562efd30 tempest-CreateVolumesFromImageTest-1403174987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9a8f342c-3572-4e8c-995b-e12d9da4f1f2 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:16 devstack sudo[102064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9a8f342c-3572-4e8c-995b-e12d9da4f1f2
Nov 05 19:22:16 devstack sudo[102064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:16 devstack sudo[102064]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4f2bd279-b15c-4f75-b4b1-21e7562efd30 tempest-CreateVolumesFromImageTest-1403174987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-9a8f342c-3572-4e8c-995b-e12d9da4f1f2" returned: 0 in 0.250s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4f2bd279-b15c-4f75-b4b1-21e7562efd30 tempest-CreateVolumesFromImageTest-1403174987 None] Lock "cinder-quobyte-9a8f342c-3572-4e8c-995b-e12d9da4f1f2" released by "delete_volume" :: held 0.684s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:22:16 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-4f2bd279-b15c-4f75-b4b1-21e7562efd30 tempest-CreateVolumesFromImageTest-1403174987 None] Created reservations ['8e995b93-5166-4402-8563-164596704192', '0bcdfc69-76a2-40bd-a672-595de2c85905', 'b7b27424-022f-48d2-a9c9-ed61fcdc888f', '45f72c5b-3fbd-4ddd-ae8d-69c7b5ab8c54'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:22:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4f2bd279-b15c-4f75-b4b1-21e7562efd30 tempest-CreateVolumesFromImageTest-1403174987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:22:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4f2bd279-b15c-4f75-b4b1-21e7562efd30 tempest-CreateVolumesFromImageTest-1403174987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:22:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4f2bd279-b15c-4f75-b4b1-21e7562efd30 tempest-CreateVolumesFromImageTest-1403174987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:22:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4f2bd279-b15c-4f75-b4b1-21e7562efd30 tempest-CreateVolumesFromImageTest-1403174987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:22:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4f2bd279-b15c-4f75-b4b1-21e7562efd30 tempest-CreateVolumesFromImageTest-1403174987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:22:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4f2bd279-b15c-4f75-b4b1-21e7562efd30 tempest-CreateVolumesFromImageTest-1403174987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:16 devstack sudo[102067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:22:16 devstack sudo[102067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:17 devstack sudo[102067]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4f2bd279-b15c-4f75-b4b1-21e7562efd30 tempest-CreateVolumesFromImageTest-1403174987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.336s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:17 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-4f2bd279-b15c-4f75-b4b1-21e7562efd30 tempest-CreateVolumesFromImageTest-1403174987 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:22:17 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-4f2bd279-b15c-4f75-b4b1-21e7562efd30 tempest-CreateVolumesFromImageTest-1403174987 None] Deleted volume successfully.
Nov 05 19:22:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3be1a783-99be-4f33-a8bb-0cb27edb3044 tempest-CreateVolumesFromImageTest-1403174987 None] Acquiring lock "cinder-89125780-7017-4f5d-b487-b81e7ebdc9cc-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:22:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4f2bd279-b15c-4f75-b4b1-21e7562efd30 tempest-CreateVolumesFromImageTest-1403174987 None] Lock "cinder-9a8f342c-3572-4e8c-995b-e12d9da4f1f2-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:22:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3be1a783-99be-4f33-a8bb-0cb27edb3044 tempest-CreateVolumesFromImageTest-1403174987 None] Lock "cinder-89125780-7017-4f5d-b487-b81e7ebdc9cc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:22:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3be1a783-99be-4f33-a8bb-0cb27edb3044 tempest-CreateVolumesFromImageTest-1403174987 None] Acquiring lock "cinder-quobyte-89125780-7017-4f5d-b487-b81e7ebdc9cc" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:22:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3be1a783-99be-4f33-a8bb-0cb27edb3044 tempest-CreateVolumesFromImageTest-1403174987 None] Lock "cinder-quobyte-89125780-7017-4f5d-b487-b81e7ebdc9cc" acquired by "delete_volume" :: waited 0.016s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:22:17 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[089415ac-c406-4e18-ace4-c6a7e657f2ae]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:22:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3be1a783-99be-4f33-a8bb-0cb27edb3044 tempest-CreateVolumesFromImageTest-1403174987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-89125780-7017-4f5d-b487-b81e7ebdc9cc {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:17 devstack sudo[102070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-89125780-7017-4f5d-b487-b81e7ebdc9cc
Nov 05 19:22:17 devstack sudo[102070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:17 devstack sudo[102070]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3be1a783-99be-4f33-a8bb-0cb27edb3044 tempest-CreateVolumesFromImageTest-1403174987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-89125780-7017-4f5d-b487-b81e7ebdc9cc" returned: 0 in 0.379s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3be1a783-99be-4f33-a8bb-0cb27edb3044 tempest-CreateVolumesFromImageTest-1403174987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-89125780-7017-4f5d-b487-b81e7ebdc9cc {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:17 devstack sudo[102076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-89125780-7017-4f5d-b487-b81e7ebdc9cc
Nov 05 19:22:17 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:17 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3be1a783-99be-4f33-a8bb-0cb27edb3044 tempest-CreateVolumesFromImageTest-1403174987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-89125780-7017-4f5d-b487-b81e7ebdc9cc" returned: 0 in 0.261s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3be1a783-99be-4f33-a8bb-0cb27edb3044 tempest-CreateVolumesFromImageTest-1403174987 None] Lock "cinder-quobyte-89125780-7017-4f5d-b487-b81e7ebdc9cc" released by "delete_volume" :: held 0.688s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:22:17 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-3be1a783-99be-4f33-a8bb-0cb27edb3044 tempest-CreateVolumesFromImageTest-1403174987 None] Created reservations ['cd53dba5-d9ec-448a-acd4-51d251de9db6', 'da08ab65-da76-4f8d-b34d-05e0c51d58aa', '737830e0-9994-428b-aa28-6043aeb32e84', '037c835d-b484-46f9-b395-6d1de037f83d'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:22:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3be1a783-99be-4f33-a8bb-0cb27edb3044 tempest-CreateVolumesFromImageTest-1403174987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:22:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3be1a783-99be-4f33-a8bb-0cb27edb3044 tempest-CreateVolumesFromImageTest-1403174987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:22:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3be1a783-99be-4f33-a8bb-0cb27edb3044 tempest-CreateVolumesFromImageTest-1403174987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:22:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3be1a783-99be-4f33-a8bb-0cb27edb3044 tempest-CreateVolumesFromImageTest-1403174987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:22:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3be1a783-99be-4f33-a8bb-0cb27edb3044 tempest-CreateVolumesFromImageTest-1403174987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:22:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3be1a783-99be-4f33-a8bb-0cb27edb3044 tempest-CreateVolumesFromImageTest-1403174987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:17 devstack sudo[102079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:22:17 devstack sudo[102079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:18 devstack sudo[102079]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3be1a783-99be-4f33-a8bb-0cb27edb3044 tempest-CreateVolumesFromImageTest-1403174987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.303s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:18 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-3be1a783-99be-4f33-a8bb-0cb27edb3044 tempest-CreateVolumesFromImageTest-1403174987 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:22:18 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-3be1a783-99be-4f33-a8bb-0cb27edb3044 tempest-CreateVolumesFromImageTest-1403174987 None] Deleted volume successfully.
Nov 05 19:22:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-3be1a783-99be-4f33-a8bb-0cb27edb3044 tempest-CreateVolumesFromImageTest-1403174987 None] Lock "cinder-89125780-7017-4f5d-b487-b81e7ebdc9cc-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:22:23 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-00988bca-11bb-47b6-b16f-763a948088df req-f3d66036-50a5-4577-a9ca-cfa5cd57f47d tempest-TestShelveInstance-431802604 None] Terminate volume connection completed successfully.
Nov 05 19:22:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-00988bca-11bb-47b6-b16f-763a948088df req-f3d66036-50a5-4577-a9ca-cfa5cd57f47d tempest-TestShelveInstance-431802604 None] Deleting attachment 9dcd736e-66b6-4afd-b817-f799aa37bc5f. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 19:22:23 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-00988bca-11bb-47b6-b16f-763a948088df req-151ad240-ed84-4957-9990-b5b6cf8d8619 tempest-TestShelveInstance-431802604 None] Acquiring lock "cinder-5f353428-8629-4c58-8d0a-58c0ea9574ef-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:22:23 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-00988bca-11bb-47b6-b16f-763a948088df req-151ad240-ed84-4957-9990-b5b6cf8d8619 tempest-TestShelveInstance-431802604 None] Lock "cinder-5f353428-8629-4c58-8d0a-58c0ea9574ef-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:22:23 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-00988bca-11bb-47b6-b16f-763a948088df req-151ad240-ed84-4957-9990-b5b6cf8d8619 tempest-TestShelveInstance-431802604 None] Acquiring lock "cinder-quobyte-5f353428-8629-4c58-8d0a-58c0ea9574ef" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:22:23 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-00988bca-11bb-47b6-b16f-763a948088df req-151ad240-ed84-4957-9990-b5b6cf8d8619 tempest-TestShelveInstance-431802604 None] Lock "cinder-quobyte-5f353428-8629-4c58-8d0a-58c0ea9574ef" acquired by "delete_volume" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:22:23 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[749e6a91-0403-4d4a-afa4-97ff98c2832b]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:22:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-00988bca-11bb-47b6-b16f-763a948088df req-151ad240-ed84-4957-9990-b5b6cf8d8619 tempest-TestShelveInstance-431802604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5f353428-8629-4c58-8d0a-58c0ea9574ef {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:23 devstack sudo[102109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5f353428-8629-4c58-8d0a-58c0ea9574ef
Nov 05 19:22:23 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:24 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-00ff15d5-31eb-4b2b-8bf3-7443f48f841c tempest-ProjectReaderTests-669636630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:22:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-00ff15d5-31eb-4b2b-8bf3-7443f48f841c tempest-ProjectReaderTests-669636630 None] Flow 'volume_create_manager' (5046395c-d17a-4554-84a5-472a792ab24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:22:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-00ff15d5-31eb-4b2b-8bf3-7443f48f841c tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f4663b2-e817-458f-8421-3529e8c61036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-00ff15d5-31eb-4b2b-8bf3-7443f48f841c tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f4663b2-e817-458f-8421-3529e8c61036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1274220305',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=549f5819-8aa3-4ad1-abf3-3ddf03dd3957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f1d6b494c3452784135983c1fde525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:22:24Z,use_quota=True,user_id='30a0b27e3fca4b4c9e981f995a6059bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-00ff15d5-31eb-4b2b-8bf3-7443f48f841c tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (858bfa35-a450-4b28-9f79-9ed736c33c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-00ff15d5-31eb-4b2b-8bf3-7443f48f841c tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (858bfa35-a450-4b28-9f79-9ed736c33c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-00ff15d5-31eb-4b2b-8bf3-7443f48f841c tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (974bbdc5-129b-4433-b6a4-85a2b4c37b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-00ff15d5-31eb-4b2b-8bf3-7443f48f841c tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (974bbdc5-129b-4433-b6a4-85a2b4c37b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '549f5819-8aa3-4ad1-abf3-3ddf03dd3957', 'volume_name': 'volume-549f5819-8aa3-4ad1-abf3-3ddf03dd3957', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-00ff15d5-31eb-4b2b-8bf3-7443f48f841c tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b792af30-79f4-436c-b37e-d08d68602be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:24 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-00ff15d5-31eb-4b2b-8bf3-7443f48f841c tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b792af30-79f4-436c-b37e-d08d68602be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-00ff15d5-31eb-4b2b-8bf3-7443f48f841c tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (004fd0b4-1895-4281-8d89-3a1b86f28924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:24 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-00ff15d5-31eb-4b2b-8bf3-7443f48f841c tempest-ProjectReaderTests-669636630 None] Volume 549f5819-8aa3-4ad1-abf3-3ddf03dd3957: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-549f5819-8aa3-4ad1-abf3-3ddf03dd3957', 'volume_size': 1}
Nov 05 19:22:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-00ff15d5-31eb-4b2b-8bf3-7443f48f841c tempest-ProjectReaderTests-669636630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:22:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-00ff15d5-31eb-4b2b-8bf3-7443f48f841c tempest-ProjectReaderTests-669636630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:22:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-00ff15d5-31eb-4b2b-8bf3-7443f48f841c tempest-ProjectReaderTests-669636630 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1274220305',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=549f5819-8aa3-4ad1-abf3-3ddf03dd3957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f1d6b494c3452784135983c1fde525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:22:24Z,use_quota=True,user_id='30a0b27e3fca4b4c9e981f995a6059bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:22:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-00ff15d5-31eb-4b2b-8bf3-7443f48f841c tempest-ProjectReaderTests-669636630 None] Creating volume 549f5819-8aa3-4ad1-abf3-3ddf03dd3957 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:22:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-00ff15d5-31eb-4b2b-8bf3-7443f48f841c tempest-ProjectReaderTests-669636630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:22:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-00ff15d5-31eb-4b2b-8bf3-7443f48f841c tempest-ProjectReaderTests-669636630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:22:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-00ff15d5-31eb-4b2b-8bf3-7443f48f841c tempest-ProjectReaderTests-669636630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:22:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-00ff15d5-31eb-4b2b-8bf3-7443f48f841c tempest-ProjectReaderTests-669636630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:22:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-00ff15d5-31eb-4b2b-8bf3-7443f48f841c tempest-ProjectReaderTests-669636630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:22:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-00ff15d5-31eb-4b2b-8bf3-7443f48f841c tempest-ProjectReaderTests-669636630 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:22:24 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-00ff15d5-31eb-4b2b-8bf3-7443f48f841c tempest-ProjectReaderTests-669636630 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:22:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-00ff15d5-31eb-4b2b-8bf3-7443f48f841c tempest-ProjectReaderTests-669636630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-549f5819-8aa3-4ad1-abf3-3ddf03dd3957 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-00988bca-11bb-47b6-b16f-763a948088df req-151ad240-ed84-4957-9990-b5b6cf8d8619 tempest-TestShelveInstance-431802604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5f353428-8629-4c58-8d0a-58c0ea9574ef" returned: 0 in 0.568s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-00988bca-11bb-47b6-b16f-763a948088df req-151ad240-ed84-4957-9990-b5b6cf8d8619 tempest-TestShelveInstance-431802604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5f353428-8629-4c58-8d0a-58c0ea9574ef {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:24 devstack sudo[102114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-549f5819-8aa3-4ad1-abf3-3ddf03dd3957 1073741824
Nov 05 19:22:24 devstack sudo[102114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:24 devstack sudo[102116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5f353428-8629-4c58-8d0a-58c0ea9574ef
Nov 05 19:22:24 devstack sudo[102116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:24 devstack sudo[102116]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-00988bca-11bb-47b6-b16f-763a948088df req-151ad240-ed84-4957-9990-b5b6cf8d8619 tempest-TestShelveInstance-431802604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5f353428-8629-4c58-8d0a-58c0ea9574ef" returned: 0 in 0.337s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-00988bca-11bb-47b6-b16f-763a948088df req-151ad240-ed84-4957-9990-b5b6cf8d8619 tempest-TestShelveInstance-431802604 None] Lock "cinder-quobyte-5f353428-8629-4c58-8d0a-58c0ea9574ef" released by "delete_volume" :: held 1.002s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:22:24 devstack cinder-volume[87184]: DEBUG cinder.quota [req-00988bca-11bb-47b6-b16f-763a948088df req-151ad240-ed84-4957-9990-b5b6cf8d8619 tempest-TestShelveInstance-431802604 None] Created reservations ['c5b9ba32-7fb5-4b41-a06d-fae8ec33496d', '77dfbd92-fa67-41f7-a88c-96e8b817277b', '763c94d4-eb6c-494d-b95b-61543a10d301', 'c58725d8-6450-4a0d-8ee2-500b26d50553'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:22:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-00988bca-11bb-47b6-b16f-763a948088df req-151ad240-ed84-4957-9990-b5b6cf8d8619 tempest-TestShelveInstance-431802604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:22:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-00988bca-11bb-47b6-b16f-763a948088df req-151ad240-ed84-4957-9990-b5b6cf8d8619 tempest-TestShelveInstance-431802604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:22:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [req-00988bca-11bb-47b6-b16f-763a948088df req-151ad240-ed84-4957-9990-b5b6cf8d8619 tempest-TestShelveInstance-431802604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:22:24 devstack sudo[102114]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [req-00988bca-11bb-47b6-b16f-763a948088df req-151ad240-ed84-4957-9990-b5b6cf8d8619 tempest-TestShelveInstance-431802604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:22:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-00988bca-11bb-47b6-b16f-763a948088df req-151ad240-ed84-4957-9990-b5b6cf8d8619 tempest-TestShelveInstance-431802604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:22:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-00988bca-11bb-47b6-b16f-763a948088df req-151ad240-ed84-4957-9990-b5b6cf8d8619 tempest-TestShelveInstance-431802604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-00ff15d5-31eb-4b2b-8bf3-7443f48f841c tempest-ProjectReaderTests-669636630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-549f5819-8aa3-4ad1-abf3-3ddf03dd3957 1073741824" returned: 0 in 0.639s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:24 devstack sudo[102123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:22:24 devstack sudo[102123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-00ff15d5-31eb-4b2b-8bf3-7443f48f841c tempest-ProjectReaderTests-669636630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-549f5819-8aa3-4ad1-abf3-3ddf03dd3957 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:24 devstack sudo[102125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-549f5819-8aa3-4ad1-abf3-3ddf03dd3957
Nov 05 19:22:24 devstack sudo[102125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:25 devstack sudo[102123]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [req-00988bca-11bb-47b6-b16f-763a948088df req-151ad240-ed84-4957-9990-b5b6cf8d8619 tempest-TestShelveInstance-431802604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.362s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:25 devstack cinder-volume[87184]: DEBUG cinder.manager [req-00988bca-11bb-47b6-b16f-763a948088df req-151ad240-ed84-4957-9990-b5b6cf8d8619 tempest-TestShelveInstance-431802604 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:22:25 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-00988bca-11bb-47b6-b16f-763a948088df req-151ad240-ed84-4957-9990-b5b6cf8d8619 tempest-TestShelveInstance-431802604 None] Deleted volume successfully.
Nov 05 19:22:25 devstack cinder-volume[87184]: DEBUG cinder.coordination [req-00988bca-11bb-47b6-b16f-763a948088df req-151ad240-ed84-4957-9990-b5b6cf8d8619 tempest-TestShelveInstance-431802604 None] Lock "cinder-5f353428-8629-4c58-8d0a-58c0ea9574ef-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:22:25 devstack sudo[102125]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-00ff15d5-31eb-4b2b-8bf3-7443f48f841c tempest-ProjectReaderTests-669636630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-549f5819-8aa3-4ad1-abf3-3ddf03dd3957" returned: 0 in 0.370s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-00ff15d5-31eb-4b2b-8bf3-7443f48f841c tempest-ProjectReaderTests-669636630 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:22:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-00ff15d5-31eb-4b2b-8bf3-7443f48f841c tempest-ProjectReaderTests-669636630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:22:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-00ff15d5-31eb-4b2b-8bf3-7443f48f841c tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (004fd0b4-1895-4281-8d89-3a1b86f28924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-549f5819-8aa3-4ad1-abf3-3ddf03dd3957', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-00ff15d5-31eb-4b2b-8bf3-7443f48f841c tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e959da82-3227-4d6d-b582-ef127ef076b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:25 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-00ff15d5-31eb-4b2b-8bf3-7443f48f841c tempest-ProjectReaderTests-669636630 None] Volume volume-549f5819-8aa3-4ad1-abf3-3ddf03dd3957 (549f5819-8aa3-4ad1-abf3-3ddf03dd3957): created successfully
Nov 05 19:22:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-00ff15d5-31eb-4b2b-8bf3-7443f48f841c tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e959da82-3227-4d6d-b582-ef127ef076b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-00ff15d5-31eb-4b2b-8bf3-7443f48f841c tempest-ProjectReaderTests-669636630 None] Flow 'volume_create_manager' (5046395c-d17a-4554-84a5-472a792ab24c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:22:25 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-00ff15d5-31eb-4b2b-8bf3-7443f48f841c tempest-ProjectReaderTests-669636630 None] Created volume successfully.
Nov 05 19:22:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d0023229-e924-4647-8d3f-9624b61a52b4 tempest-ProjectReaderTests-669636630 None] Acquiring lock "cinder-549f5819-8aa3-4ad1-abf3-3ddf03dd3957-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:22:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d0023229-e924-4647-8d3f-9624b61a52b4 tempest-ProjectReaderTests-669636630 None] Lock "cinder-549f5819-8aa3-4ad1-abf3-3ddf03dd3957-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:22:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d0023229-e924-4647-8d3f-9624b61a52b4 tempest-ProjectReaderTests-669636630 None] Acquiring lock "cinder-quobyte-549f5819-8aa3-4ad1-abf3-3ddf03dd3957" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:22:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d0023229-e924-4647-8d3f-9624b61a52b4 tempest-ProjectReaderTests-669636630 None] Lock "cinder-quobyte-549f5819-8aa3-4ad1-abf3-3ddf03dd3957" acquired by "delete_volume" :: waited 0.046s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:22:26 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7066bf28-3da5-4808-9d21-ee653a3c5f96]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:22:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d0023229-e924-4647-8d3f-9624b61a52b4 tempest-ProjectReaderTests-669636630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-549f5819-8aa3-4ad1-abf3-3ddf03dd3957 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:26 devstack sudo[102130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-549f5819-8aa3-4ad1-abf3-3ddf03dd3957
Nov 05 19:22:26 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:27 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d0023229-e924-4647-8d3f-9624b61a52b4 tempest-ProjectReaderTests-669636630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-549f5819-8aa3-4ad1-abf3-3ddf03dd3957" returned: 0 in 0.410s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d0023229-e924-4647-8d3f-9624b61a52b4 tempest-ProjectReaderTests-669636630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-549f5819-8aa3-4ad1-abf3-3ddf03dd3957 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:27 devstack sudo[102135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-549f5819-8aa3-4ad1-abf3-3ddf03dd3957
Nov 05 19:22:27 devstack sudo[102135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:27 devstack sudo[102135]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d0023229-e924-4647-8d3f-9624b61a52b4 tempest-ProjectReaderTests-669636630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-549f5819-8aa3-4ad1-abf3-3ddf03dd3957" returned: 0 in 0.332s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d0023229-e924-4647-8d3f-9624b61a52b4 tempest-ProjectReaderTests-669636630 None] Lock "cinder-quobyte-549f5819-8aa3-4ad1-abf3-3ddf03dd3957" released by "delete_volume" :: held 0.837s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:22:27 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-d0023229-e924-4647-8d3f-9624b61a52b4 tempest-ProjectReaderTests-669636630 None] Created reservations ['304d2f1e-9553-4932-ab39-bc8eb2c0c5b7', 'cf844974-e5ae-468d-af30-7e0fab2c1010', '0eb4929b-9360-4153-9046-4f05ac0da4aa', '06b9bbee-3dc5-48a8-837a-fabb79386f66'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:22:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d0023229-e924-4647-8d3f-9624b61a52b4 tempest-ProjectReaderTests-669636630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:22:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d0023229-e924-4647-8d3f-9624b61a52b4 tempest-ProjectReaderTests-669636630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:22:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d0023229-e924-4647-8d3f-9624b61a52b4 tempest-ProjectReaderTests-669636630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:22:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d0023229-e924-4647-8d3f-9624b61a52b4 tempest-ProjectReaderTests-669636630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:22:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d0023229-e924-4647-8d3f-9624b61a52b4 tempest-ProjectReaderTests-669636630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:22:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d0023229-e924-4647-8d3f-9624b61a52b4 tempest-ProjectReaderTests-669636630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:27 devstack sudo[102139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:22:27 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:27 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d0023229-e924-4647-8d3f-9624b61a52b4 tempest-ProjectReaderTests-669636630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.299s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:27 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-d0023229-e924-4647-8d3f-9624b61a52b4 tempest-ProjectReaderTests-669636630 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:22:27 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-d0023229-e924-4647-8d3f-9624b61a52b4 tempest-ProjectReaderTests-669636630 None] Deleted volume successfully.
Nov 05 19:22:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d0023229-e924-4647-8d3f-9624b61a52b4 tempest-ProjectReaderTests-669636630 None] Lock "cinder-549f5819-8aa3-4ad1-abf3-3ddf03dd3957-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:22:28 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-be3114c3-aa89-49b3-a53d-4d7071f18362 tempest-ProjectReaderTests-669636630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:22:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-be3114c3-aa89-49b3-a53d-4d7071f18362 tempest-ProjectReaderTests-669636630 None] Flow 'volume_create_manager' (32e47453-9a11-410b-b6f3-9187136ee82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:22:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-be3114c3-aa89-49b3-a53d-4d7071f18362 tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bc4471a-eab2-4182-b6a4-70a6df4d6edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-be3114c3-aa89-49b3-a53d-4d7071f18362 tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bc4471a-eab2-4182-b6a4-70a6df4d6edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-342676704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e4bb7a-5a6f-4c70-b78c-fc01db7761ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f1d6b494c3452784135983c1fde525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:22:28Z,use_quota=True,user_id='30a0b27e3fca4b4c9e981f995a6059bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-be3114c3-aa89-49b3-a53d-4d7071f18362 tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f21f6b92-26d9-479a-a86b-2429a2d458db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-be3114c3-aa89-49b3-a53d-4d7071f18362 tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f21f6b92-26d9-479a-a86b-2429a2d458db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-be3114c3-aa89-49b3-a53d-4d7071f18362 tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da6e97e-6a06-4914-b65f-4e8d4c230f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-be3114c3-aa89-49b3-a53d-4d7071f18362 tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da6e97e-6a06-4914-b65f-4e8d4c230f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96e4bb7a-5a6f-4c70-b78c-fc01db7761ad', 'volume_name': 'volume-96e4bb7a-5a6f-4c70-b78c-fc01db7761ad', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-be3114c3-aa89-49b3-a53d-4d7071f18362 tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bdb6e10-daf2-4df9-8970-f41c5bd220ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-be3114c3-aa89-49b3-a53d-4d7071f18362 tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bdb6e10-daf2-4df9-8970-f41c5bd220ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-be3114c3-aa89-49b3-a53d-4d7071f18362 tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd32182-2a50-4376-ba13-ccdaa625b1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:28 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-be3114c3-aa89-49b3-a53d-4d7071f18362 tempest-ProjectReaderTests-669636630 None] Volume 96e4bb7a-5a6f-4c70-b78c-fc01db7761ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96e4bb7a-5a6f-4c70-b78c-fc01db7761ad', 'volume_size': 1}
Nov 05 19:22:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-be3114c3-aa89-49b3-a53d-4d7071f18362 tempest-ProjectReaderTests-669636630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:22:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-be3114c3-aa89-49b3-a53d-4d7071f18362 tempest-ProjectReaderTests-669636630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:22:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-be3114c3-aa89-49b3-a53d-4d7071f18362 tempest-ProjectReaderTests-669636630 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-342676704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e4bb7a-5a6f-4c70-b78c-fc01db7761ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f1d6b494c3452784135983c1fde525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:22:28Z,use_quota=True,user_id='30a0b27e3fca4b4c9e981f995a6059bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:22:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-be3114c3-aa89-49b3-a53d-4d7071f18362 tempest-ProjectReaderTests-669636630 None] Creating volume 96e4bb7a-5a6f-4c70-b78c-fc01db7761ad {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:22:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-be3114c3-aa89-49b3-a53d-4d7071f18362 tempest-ProjectReaderTests-669636630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:22:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-be3114c3-aa89-49b3-a53d-4d7071f18362 tempest-ProjectReaderTests-669636630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:22:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-be3114c3-aa89-49b3-a53d-4d7071f18362 tempest-ProjectReaderTests-669636630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:22:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-be3114c3-aa89-49b3-a53d-4d7071f18362 tempest-ProjectReaderTests-669636630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:22:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-be3114c3-aa89-49b3-a53d-4d7071f18362 tempest-ProjectReaderTests-669636630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:22:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-be3114c3-aa89-49b3-a53d-4d7071f18362 tempest-ProjectReaderTests-669636630 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:22:28 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-be3114c3-aa89-49b3-a53d-4d7071f18362 tempest-ProjectReaderTests-669636630 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:22:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be3114c3-aa89-49b3-a53d-4d7071f18362 tempest-ProjectReaderTests-669636630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-96e4bb7a-5a6f-4c70-b78c-fc01db7761ad 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:28 devstack sudo[102142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-96e4bb7a-5a6f-4c70-b78c-fc01db7761ad 1073741824
Nov 05 19:22:28 devstack sudo[102142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:28 devstack sudo[102142]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be3114c3-aa89-49b3-a53d-4d7071f18362 tempest-ProjectReaderTests-669636630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-96e4bb7a-5a6f-4c70-b78c-fc01db7761ad 1073741824" returned: 0 in 0.573s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be3114c3-aa89-49b3-a53d-4d7071f18362 tempest-ProjectReaderTests-669636630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-96e4bb7a-5a6f-4c70-b78c-fc01db7761ad {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:28 devstack sudo[102151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-96e4bb7a-5a6f-4c70-b78c-fc01db7761ad
Nov 05 19:22:28 devstack sudo[102151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:29 devstack sudo[102151]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be3114c3-aa89-49b3-a53d-4d7071f18362 tempest-ProjectReaderTests-669636630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-96e4bb7a-5a6f-4c70-b78c-fc01db7761ad" returned: 0 in 0.294s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:29 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-be3114c3-aa89-49b3-a53d-4d7071f18362 tempest-ProjectReaderTests-669636630 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:22:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-be3114c3-aa89-49b3-a53d-4d7071f18362 tempest-ProjectReaderTests-669636630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:22:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-be3114c3-aa89-49b3-a53d-4d7071f18362 tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd32182-2a50-4376-ba13-ccdaa625b1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96e4bb7a-5a6f-4c70-b78c-fc01db7761ad', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-be3114c3-aa89-49b3-a53d-4d7071f18362 tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6985b9a7-bb82-44a7-b3fb-da96e4be11c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:29 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-be3114c3-aa89-49b3-a53d-4d7071f18362 tempest-ProjectReaderTests-669636630 None] Volume volume-96e4bb7a-5a6f-4c70-b78c-fc01db7761ad (96e4bb7a-5a6f-4c70-b78c-fc01db7761ad): created successfully
Nov 05 19:22:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-be3114c3-aa89-49b3-a53d-4d7071f18362 tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6985b9a7-bb82-44a7-b3fb-da96e4be11c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-be3114c3-aa89-49b3-a53d-4d7071f18362 tempest-ProjectReaderTests-669636630 None] Flow 'volume_create_manager' (32e47453-9a11-410b-b6f3-9187136ee82e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:22:29 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-be3114c3-aa89-49b3-a53d-4d7071f18362 tempest-ProjectReaderTests-669636630 None] Created volume successfully.
Nov 05 19:22:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6b664f09-bbb2-40ac-afb1-158fd1d519b8 tempest-ProjectReaderTests-669636630 None] Acquiring lock "cinder-96e4bb7a-5a6f-4c70-b78c-fc01db7761ad-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:22:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6b664f09-bbb2-40ac-afb1-158fd1d519b8 tempest-ProjectReaderTests-669636630 None] Lock "cinder-96e4bb7a-5a6f-4c70-b78c-fc01db7761ad-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:22:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6b664f09-bbb2-40ac-afb1-158fd1d519b8 tempest-ProjectReaderTests-669636630 None] Acquiring lock "cinder-quobyte-96e4bb7a-5a6f-4c70-b78c-fc01db7761ad" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:22:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6b664f09-bbb2-40ac-afb1-158fd1d519b8 tempest-ProjectReaderTests-669636630 None] Lock "cinder-quobyte-96e4bb7a-5a6f-4c70-b78c-fc01db7761ad" acquired by "delete_volume" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:22:30 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa66cf74-0b78-4a9d-8394-dc5b560db238]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:22:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6b664f09-bbb2-40ac-afb1-158fd1d519b8 tempest-ProjectReaderTests-669636630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-96e4bb7a-5a6f-4c70-b78c-fc01db7761ad {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:30 devstack sudo[102155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-96e4bb7a-5a6f-4c70-b78c-fc01db7761ad
Nov 05 19:22:30 devstack sudo[102155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:30 devstack sudo[102155]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6b664f09-bbb2-40ac-afb1-158fd1d519b8 tempest-ProjectReaderTests-669636630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-96e4bb7a-5a6f-4c70-b78c-fc01db7761ad" returned: 0 in 0.431s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6b664f09-bbb2-40ac-afb1-158fd1d519b8 tempest-ProjectReaderTests-669636630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-96e4bb7a-5a6f-4c70-b78c-fc01db7761ad {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:30 devstack sudo[102160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-96e4bb7a-5a6f-4c70-b78c-fc01db7761ad
Nov 05 19:22:30 devstack sudo[102160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:31 devstack sudo[102160]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6b664f09-bbb2-40ac-afb1-158fd1d519b8 tempest-ProjectReaderTests-669636630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-96e4bb7a-5a6f-4c70-b78c-fc01db7761ad" returned: 0 in 0.261s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6b664f09-bbb2-40ac-afb1-158fd1d519b8 tempest-ProjectReaderTests-669636630 None] Lock "cinder-quobyte-96e4bb7a-5a6f-4c70-b78c-fc01db7761ad" released by "delete_volume" :: held 0.748s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:22:31 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-6b664f09-bbb2-40ac-afb1-158fd1d519b8 tempest-ProjectReaderTests-669636630 None] Created reservations ['a3841fca-1384-439b-8b52-5125f00c5bf0', '54b458cc-c684-4cd0-adcc-5660f4bec253', '360bcf91-62cf-4b4a-a1a7-f3a7a65d26e0', 'e7fc5218-820f-421e-9d9a-491151de67df'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:22:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6b664f09-bbb2-40ac-afb1-158fd1d519b8 tempest-ProjectReaderTests-669636630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:22:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6b664f09-bbb2-40ac-afb1-158fd1d519b8 tempest-ProjectReaderTests-669636630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:22:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6b664f09-bbb2-40ac-afb1-158fd1d519b8 tempest-ProjectReaderTests-669636630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:22:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6b664f09-bbb2-40ac-afb1-158fd1d519b8 tempest-ProjectReaderTests-669636630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:22:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6b664f09-bbb2-40ac-afb1-158fd1d519b8 tempest-ProjectReaderTests-669636630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:22:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6b664f09-bbb2-40ac-afb1-158fd1d519b8 tempest-ProjectReaderTests-669636630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:31 devstack sudo[102164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:22:31 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:31 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6b664f09-bbb2-40ac-afb1-158fd1d519b8 tempest-ProjectReaderTests-669636630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.317s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:31 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-6b664f09-bbb2-40ac-afb1-158fd1d519b8 tempest-ProjectReaderTests-669636630 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:22:31 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-6b664f09-bbb2-40ac-afb1-158fd1d519b8 tempest-ProjectReaderTests-669636630 None] Deleted volume successfully.
Nov 05 19:22:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6b664f09-bbb2-40ac-afb1-158fd1d519b8 tempest-ProjectReaderTests-669636630 None] Lock "cinder-96e4bb7a-5a6f-4c70-b78c-fc01db7761ad-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:22:32 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-14095185-9cc2-49c6-85a3-a9049b44b7d8 tempest-ProjectReaderTests-669636630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:22:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14095185-9cc2-49c6-85a3-a9049b44b7d8 tempest-ProjectReaderTests-669636630 None] Flow 'volume_create_manager' (57e80d37-1737-4fb9-aa6c-c619bf98fcaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:22:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14095185-9cc2-49c6-85a3-a9049b44b7d8 tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71eb457b-e72e-4714-8b39-967c6704935c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14095185-9cc2-49c6-85a3-a9049b44b7d8 tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71eb457b-e72e-4714-8b39-967c6704935c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1673853477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc4e741b-2b91-4fd2-a0f5-a7a52582d2dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f1d6b494c3452784135983c1fde525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:22:32Z,use_quota=True,user_id='30a0b27e3fca4b4c9e981f995a6059bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14095185-9cc2-49c6-85a3-a9049b44b7d8 tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9726f5b1-10dc-43c9-86ba-7d994b8bb536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14095185-9cc2-49c6-85a3-a9049b44b7d8 tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9726f5b1-10dc-43c9-86ba-7d994b8bb536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14095185-9cc2-49c6-85a3-a9049b44b7d8 tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bce7ec66-a5fc-4de5-a625-9402890d54e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14095185-9cc2-49c6-85a3-a9049b44b7d8 tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bce7ec66-a5fc-4de5-a625-9402890d54e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc4e741b-2b91-4fd2-a0f5-a7a52582d2dd', 'volume_name': 'volume-cc4e741b-2b91-4fd2-a0f5-a7a52582d2dd', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14095185-9cc2-49c6-85a3-a9049b44b7d8 tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70f4fb57-0120-4312-a5bd-7a3f5cfd3025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14095185-9cc2-49c6-85a3-a9049b44b7d8 tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70f4fb57-0120-4312-a5bd-7a3f5cfd3025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14095185-9cc2-49c6-85a3-a9049b44b7d8 tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8387054-101e-4189-b8ea-d08e990d9154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:32 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-14095185-9cc2-49c6-85a3-a9049b44b7d8 tempest-ProjectReaderTests-669636630 None] Volume cc4e741b-2b91-4fd2-a0f5-a7a52582d2dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc4e741b-2b91-4fd2-a0f5-a7a52582d2dd', 'volume_size': 1}
Nov 05 19:22:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-14095185-9cc2-49c6-85a3-a9049b44b7d8 tempest-ProjectReaderTests-669636630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:22:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-14095185-9cc2-49c6-85a3-a9049b44b7d8 tempest-ProjectReaderTests-669636630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:22:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-14095185-9cc2-49c6-85a3-a9049b44b7d8 tempest-ProjectReaderTests-669636630 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1673853477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc4e741b-2b91-4fd2-a0f5-a7a52582d2dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f1d6b494c3452784135983c1fde525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:22:32Z,use_quota=True,user_id='30a0b27e3fca4b4c9e981f995a6059bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:22:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-14095185-9cc2-49c6-85a3-a9049b44b7d8 tempest-ProjectReaderTests-669636630 None] Creating volume cc4e741b-2b91-4fd2-a0f5-a7a52582d2dd {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:22:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-14095185-9cc2-49c6-85a3-a9049b44b7d8 tempest-ProjectReaderTests-669636630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:22:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-14095185-9cc2-49c6-85a3-a9049b44b7d8 tempest-ProjectReaderTests-669636630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:22:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-14095185-9cc2-49c6-85a3-a9049b44b7d8 tempest-ProjectReaderTests-669636630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:22:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-14095185-9cc2-49c6-85a3-a9049b44b7d8 tempest-ProjectReaderTests-669636630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:22:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-14095185-9cc2-49c6-85a3-a9049b44b7d8 tempest-ProjectReaderTests-669636630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:22:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-14095185-9cc2-49c6-85a3-a9049b44b7d8 tempest-ProjectReaderTests-669636630 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:22:32 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-14095185-9cc2-49c6-85a3-a9049b44b7d8 tempest-ProjectReaderTests-669636630 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:22:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-14095185-9cc2-49c6-85a3-a9049b44b7d8 tempest-ProjectReaderTests-669636630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cc4e741b-2b91-4fd2-a0f5-a7a52582d2dd 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:32 devstack sudo[102167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cc4e741b-2b91-4fd2-a0f5-a7a52582d2dd 1073741824
Nov 05 19:22:32 devstack sudo[102167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:32 devstack sudo[102167]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-14095185-9cc2-49c6-85a3-a9049b44b7d8 tempest-ProjectReaderTests-669636630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cc4e741b-2b91-4fd2-a0f5-a7a52582d2dd 1073741824" returned: 0 in 0.574s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-14095185-9cc2-49c6-85a3-a9049b44b7d8 tempest-ProjectReaderTests-669636630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cc4e741b-2b91-4fd2-a0f5-a7a52582d2dd {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:32 devstack sudo[102173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cc4e741b-2b91-4fd2-a0f5-a7a52582d2dd
Nov 05 19:22:32 devstack sudo[102173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:33 devstack sudo[102173]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-14095185-9cc2-49c6-85a3-a9049b44b7d8 tempest-ProjectReaderTests-669636630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cc4e741b-2b91-4fd2-a0f5-a7a52582d2dd" returned: 0 in 0.321s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-14095185-9cc2-49c6-85a3-a9049b44b7d8 tempest-ProjectReaderTests-669636630 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:22:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-14095185-9cc2-49c6-85a3-a9049b44b7d8 tempest-ProjectReaderTests-669636630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:22:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14095185-9cc2-49c6-85a3-a9049b44b7d8 tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8387054-101e-4189-b8ea-d08e990d9154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc4e741b-2b91-4fd2-a0f5-a7a52582d2dd', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14095185-9cc2-49c6-85a3-a9049b44b7d8 tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0b818ee-9038-4af8-82c3-c6b0e0f108bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:33 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-14095185-9cc2-49c6-85a3-a9049b44b7d8 tempest-ProjectReaderTests-669636630 None] Volume volume-cc4e741b-2b91-4fd2-a0f5-a7a52582d2dd (cc4e741b-2b91-4fd2-a0f5-a7a52582d2dd): created successfully
Nov 05 19:22:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14095185-9cc2-49c6-85a3-a9049b44b7d8 tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0b818ee-9038-4af8-82c3-c6b0e0f108bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-14095185-9cc2-49c6-85a3-a9049b44b7d8 tempest-ProjectReaderTests-669636630 None] Flow 'volume_create_manager' (57e80d37-1737-4fb9-aa6c-c619bf98fcaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:22:33 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-14095185-9cc2-49c6-85a3-a9049b44b7d8 tempest-ProjectReaderTests-669636630 None] Created volume successfully.
Nov 05 19:22:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-606a5194-d8f7-4bfe-b2dd-1ef70b2ee95f tempest-ProjectReaderTests-669636630 None] Acquiring lock "cinder-cc4e741b-2b91-4fd2-a0f5-a7a52582d2dd-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:22:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-606a5194-d8f7-4bfe-b2dd-1ef70b2ee95f tempest-ProjectReaderTests-669636630 None] Lock "cinder-cc4e741b-2b91-4fd2-a0f5-a7a52582d2dd-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:22:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-606a5194-d8f7-4bfe-b2dd-1ef70b2ee95f tempest-ProjectReaderTests-669636630 None] Acquiring lock "cinder-quobyte-cc4e741b-2b91-4fd2-a0f5-a7a52582d2dd" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:22:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-606a5194-d8f7-4bfe-b2dd-1ef70b2ee95f tempest-ProjectReaderTests-669636630 None] Lock "cinder-quobyte-cc4e741b-2b91-4fd2-a0f5-a7a52582d2dd" acquired by "delete_volume" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:22:34 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b318994c-a0b2-4e65-8cb2-ec7c31657891]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:22:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-606a5194-d8f7-4bfe-b2dd-1ef70b2ee95f tempest-ProjectReaderTests-669636630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cc4e741b-2b91-4fd2-a0f5-a7a52582d2dd {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:34 devstack sudo[102177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cc4e741b-2b91-4fd2-a0f5-a7a52582d2dd
Nov 05 19:22:34 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:34 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-606a5194-d8f7-4bfe-b2dd-1ef70b2ee95f tempest-ProjectReaderTests-669636630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cc4e741b-2b91-4fd2-a0f5-a7a52582d2dd" returned: 0 in 0.481s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-606a5194-d8f7-4bfe-b2dd-1ef70b2ee95f tempest-ProjectReaderTests-669636630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cc4e741b-2b91-4fd2-a0f5-a7a52582d2dd {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:34 devstack sudo[102182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cc4e741b-2b91-4fd2-a0f5-a7a52582d2dd
Nov 05 19:22:34 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:35 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-606a5194-d8f7-4bfe-b2dd-1ef70b2ee95f tempest-ProjectReaderTests-669636630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cc4e741b-2b91-4fd2-a0f5-a7a52582d2dd" returned: 0 in 0.336s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-606a5194-d8f7-4bfe-b2dd-1ef70b2ee95f tempest-ProjectReaderTests-669636630 None] Lock "cinder-quobyte-cc4e741b-2b91-4fd2-a0f5-a7a52582d2dd" released by "delete_volume" :: held 0.879s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:22:35 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-606a5194-d8f7-4bfe-b2dd-1ef70b2ee95f tempest-ProjectReaderTests-669636630 None] Created reservations ['825da095-a340-452e-baec-10ba39e02e57', '00d0476e-67d6-4b7a-bcdc-766917872b56', '4f6af247-2f97-4666-bad6-646312a27936', '7012c32a-f663-47a8-aa9d-f9f0f843cb28'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:22:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-606a5194-d8f7-4bfe-b2dd-1ef70b2ee95f tempest-ProjectReaderTests-669636630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:22:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-606a5194-d8f7-4bfe-b2dd-1ef70b2ee95f tempest-ProjectReaderTests-669636630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:22:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-606a5194-d8f7-4bfe-b2dd-1ef70b2ee95f tempest-ProjectReaderTests-669636630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:22:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-606a5194-d8f7-4bfe-b2dd-1ef70b2ee95f tempest-ProjectReaderTests-669636630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:22:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-606a5194-d8f7-4bfe-b2dd-1ef70b2ee95f tempest-ProjectReaderTests-669636630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:22:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-606a5194-d8f7-4bfe-b2dd-1ef70b2ee95f tempest-ProjectReaderTests-669636630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:35 devstack sudo[102185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:22:35 devstack sudo[102185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:35 devstack sudo[102185]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-606a5194-d8f7-4bfe-b2dd-1ef70b2ee95f tempest-ProjectReaderTests-669636630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.304s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:35 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-606a5194-d8f7-4bfe-b2dd-1ef70b2ee95f tempest-ProjectReaderTests-669636630 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:22:35 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-606a5194-d8f7-4bfe-b2dd-1ef70b2ee95f tempest-ProjectReaderTests-669636630 None] Deleted volume successfully.
Nov 05 19:22:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-606a5194-d8f7-4bfe-b2dd-1ef70b2ee95f tempest-ProjectReaderTests-669636630 None] Lock "cinder-cc4e741b-2b91-4fd2-a0f5-a7a52582d2dd-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:22:36 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-6559879b-ed0b-4ddb-af6f-6c28c0925f63 tempest-ProjectReaderTests-669636630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:22:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6559879b-ed0b-4ddb-af6f-6c28c0925f63 tempest-ProjectReaderTests-669636630 None] Flow 'volume_create_manager' (d614e28b-a66e-458a-aa86-be3529a518a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:22:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6559879b-ed0b-4ddb-af6f-6c28c0925f63 tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bcb9dc3-df9f-45ee-933e-83224f810341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:36 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffc0f95d-385b-4c66-843c-ca5ab762f2e9 tempest-TestStampPattern-248517944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:22:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ffc0f95d-385b-4c66-843c-ca5ab762f2e9 tempest-TestStampPattern-248517944 None] Flow 'volume_create_manager' (53e586ff-b3fd-4958-9085-264d7bdda1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:22:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ffc0f95d-385b-4c66-843c-ca5ab762f2e9 tempest-TestStampPattern-248517944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f75c409c-b1ff-44d0-8631-27b89c3a8354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6559879b-ed0b-4ddb-af6f-6c28c0925f63 tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bcb9dc3-df9f-45ee-933e-83224f810341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-926337995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ff91443-7c94-4dd0-93d9-326807b21787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f1d6b494c3452784135983c1fde525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:22:36Z,use_quota=True,user_id='30a0b27e3fca4b4c9e981f995a6059bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6559879b-ed0b-4ddb-af6f-6c28c0925f63 tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e6a84bd-9fac-41cc-bf32-7a3aa6131f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6559879b-ed0b-4ddb-af6f-6c28c0925f63 tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e6a84bd-9fac-41cc-bf32-7a3aa6131f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6559879b-ed0b-4ddb-af6f-6c28c0925f63 tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d742bd37-5382-446e-88c2-8e1a0f567998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6559879b-ed0b-4ddb-af6f-6c28c0925f63 tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d742bd37-5382-446e-88c2-8e1a0f567998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ff91443-7c94-4dd0-93d9-326807b21787', 'volume_name': 'volume-7ff91443-7c94-4dd0-93d9-326807b21787', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6559879b-ed0b-4ddb-af6f-6c28c0925f63 tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59e1ca7c-caed-4969-8fd2-b486d4ab572c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6559879b-ed0b-4ddb-af6f-6c28c0925f63 tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59e1ca7c-caed-4969-8fd2-b486d4ab572c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6559879b-ed0b-4ddb-af6f-6c28c0925f63 tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4519b478-b93c-4246-a1b6-a8c62f65742b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:36 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-6559879b-ed0b-4ddb-af6f-6c28c0925f63 tempest-ProjectReaderTests-669636630 None] Volume 7ff91443-7c94-4dd0-93d9-326807b21787: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ff91443-7c94-4dd0-93d9-326807b21787', 'volume_size': 1}
Nov 05 19:22:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6559879b-ed0b-4ddb-af6f-6c28c0925f63 tempest-ProjectReaderTests-669636630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:22:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6559879b-ed0b-4ddb-af6f-6c28c0925f63 tempest-ProjectReaderTests-669636630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:22:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6559879b-ed0b-4ddb-af6f-6c28c0925f63 tempest-ProjectReaderTests-669636630 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-926337995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ff91443-7c94-4dd0-93d9-326807b21787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f1d6b494c3452784135983c1fde525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:22:36Z,use_quota=True,user_id='30a0b27e3fca4b4c9e981f995a6059bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:22:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-6559879b-ed0b-4ddb-af6f-6c28c0925f63 tempest-ProjectReaderTests-669636630 None] Creating volume 7ff91443-7c94-4dd0-93d9-326807b21787 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:22:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6559879b-ed0b-4ddb-af6f-6c28c0925f63 tempest-ProjectReaderTests-669636630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:22:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6559879b-ed0b-4ddb-af6f-6c28c0925f63 tempest-ProjectReaderTests-669636630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:22:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6559879b-ed0b-4ddb-af6f-6c28c0925f63 tempest-ProjectReaderTests-669636630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:22:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6559879b-ed0b-4ddb-af6f-6c28c0925f63 tempest-ProjectReaderTests-669636630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:22:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6559879b-ed0b-4ddb-af6f-6c28c0925f63 tempest-ProjectReaderTests-669636630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:22:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6559879b-ed0b-4ddb-af6f-6c28c0925f63 tempest-ProjectReaderTests-669636630 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:22:36 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-6559879b-ed0b-4ddb-af6f-6c28c0925f63 tempest-ProjectReaderTests-669636630 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:22:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6559879b-ed0b-4ddb-af6f-6c28c0925f63 tempest-ProjectReaderTests-669636630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7ff91443-7c94-4dd0-93d9-326807b21787 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ffc0f95d-385b-4c66-843c-ca5ab762f2e9 tempest-TestStampPattern-248517944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f75c409c-b1ff-44d0-8631-27b89c3a8354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1598850222',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aadd5db7-ec82-49ae-8dc6-cd95e02e23e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e1ff786a63242a5b30d06170c6e5e14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:22:36Z,use_quota=True,user_id='a3476caf9a4742d9ba7f3303d8fce9e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:36 devstack sudo[102192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7ff91443-7c94-4dd0-93d9-326807b21787 1073741824
Nov 05 19:22:36 devstack sudo[102192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ffc0f95d-385b-4c66-843c-ca5ab762f2e9 tempest-TestStampPattern-248517944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (784cb51d-5470-4099-9e60-eb9ec67ad94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ffc0f95d-385b-4c66-843c-ca5ab762f2e9 tempest-TestStampPattern-248517944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (784cb51d-5470-4099-9e60-eb9ec67ad94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ffc0f95d-385b-4c66-843c-ca5ab762f2e9 tempest-TestStampPattern-248517944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d149d590-c9fe-4bb8-bbe1-9be6ff781460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ffc0f95d-385b-4c66-843c-ca5ab762f2e9 tempest-TestStampPattern-248517944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d149d590-c9fe-4bb8-bbe1-9be6ff781460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aadd5db7-ec82-49ae-8dc6-cd95e02e23e7', 'volume_name': 'volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ffc0f95d-385b-4c66-843c-ca5ab762f2e9 tempest-TestStampPattern-248517944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87faf0c3-099c-41cd-b032-1b3b4e153110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ffc0f95d-385b-4c66-843c-ca5ab762f2e9 tempest-TestStampPattern-248517944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87faf0c3-099c-41cd-b032-1b3b4e153110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ffc0f95d-385b-4c66-843c-ca5ab762f2e9 tempest-TestStampPattern-248517944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f679067e-68a0-4e02-ad6c-e9fbe5e44ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:36 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-ffc0f95d-385b-4c66-843c-ca5ab762f2e9 tempest-TestStampPattern-248517944 None] Volume aadd5db7-ec82-49ae-8dc6-cd95e02e23e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7', 'volume_size': 1}
Nov 05 19:22:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ffc0f95d-385b-4c66-843c-ca5ab762f2e9 tempest-TestStampPattern-248517944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:22:37 devstack sudo[102192]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6559879b-ed0b-4ddb-af6f-6c28c0925f63 tempest-ProjectReaderTests-669636630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7ff91443-7c94-4dd0-93d9-326807b21787 1073741824" returned: 0 in 0.625s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6559879b-ed0b-4ddb-af6f-6c28c0925f63 tempest-ProjectReaderTests-669636630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7ff91443-7c94-4dd0-93d9-326807b21787 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:37 devstack sudo[102201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7ff91443-7c94-4dd0-93d9-326807b21787
Nov 05 19:22:37 devstack sudo[102201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:37 devstack sudo[102201]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6559879b-ed0b-4ddb-af6f-6c28c0925f63 tempest-ProjectReaderTests-669636630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7ff91443-7c94-4dd0-93d9-326807b21787" returned: 0 in 0.309s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-6559879b-ed0b-4ddb-af6f-6c28c0925f63 tempest-ProjectReaderTests-669636630 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:22:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-6559879b-ed0b-4ddb-af6f-6c28c0925f63 tempest-ProjectReaderTests-669636630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:22:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ffc0f95d-385b-4c66-843c-ca5ab762f2e9 tempest-TestStampPattern-248517944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.916s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:22:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ffc0f95d-385b-4c66-843c-ca5ab762f2e9 tempest-TestStampPattern-248517944 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1598850222',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aadd5db7-ec82-49ae-8dc6-cd95e02e23e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e1ff786a63242a5b30d06170c6e5e14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:22:36Z,use_quota=True,user_id='a3476caf9a4742d9ba7f3303d8fce9e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:22:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-ffc0f95d-385b-4c66-843c-ca5ab762f2e9 tempest-TestStampPattern-248517944 None] Creating volume aadd5db7-ec82-49ae-8dc6-cd95e02e23e7 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:22:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ffc0f95d-385b-4c66-843c-ca5ab762f2e9 tempest-TestStampPattern-248517944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:22:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ffc0f95d-385b-4c66-843c-ca5ab762f2e9 tempest-TestStampPattern-248517944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:22:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ffc0f95d-385b-4c66-843c-ca5ab762f2e9 tempest-TestStampPattern-248517944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:22:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ffc0f95d-385b-4c66-843c-ca5ab762f2e9 tempest-TestStampPattern-248517944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:22:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ffc0f95d-385b-4c66-843c-ca5ab762f2e9 tempest-TestStampPattern-248517944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:22:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ffc0f95d-385b-4c66-843c-ca5ab762f2e9 tempest-TestStampPattern-248517944 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:22:37 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-ffc0f95d-385b-4c66-843c-ca5ab762f2e9 tempest-TestStampPattern-248517944 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:22:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ffc0f95d-385b-4c66-843c-ca5ab762f2e9 tempest-TestStampPattern-248517944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6559879b-ed0b-4ddb-af6f-6c28c0925f63 tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4519b478-b93c-4246-a1b6-a8c62f65742b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ff91443-7c94-4dd0-93d9-326807b21787', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6559879b-ed0b-4ddb-af6f-6c28c0925f63 tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9ce4005-46cf-4051-b3b2-332e2d2bca58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:37 devstack sudo[102206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7 1073741824
Nov 05 19:22:37 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:37 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-6559879b-ed0b-4ddb-af6f-6c28c0925f63 tempest-ProjectReaderTests-669636630 None] Volume volume-7ff91443-7c94-4dd0-93d9-326807b21787 (7ff91443-7c94-4dd0-93d9-326807b21787): created successfully
Nov 05 19:22:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6559879b-ed0b-4ddb-af6f-6c28c0925f63 tempest-ProjectReaderTests-669636630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9ce4005-46cf-4051-b3b2-332e2d2bca58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:37 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-6559879b-ed0b-4ddb-af6f-6c28c0925f63 tempest-ProjectReaderTests-669636630 None] Flow 'volume_create_manager' (d614e28b-a66e-458a-aa86-be3529a518a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:22:37 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-6559879b-ed0b-4ddb-af6f-6c28c0925f63 tempest-ProjectReaderTests-669636630 None] Created volume successfully.
Nov 05 19:22:38 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ffc0f95d-385b-4c66-843c-ca5ab762f2e9 tempest-TestStampPattern-248517944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7 1073741824" returned: 0 in 0.523s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ffc0f95d-385b-4c66-843c-ca5ab762f2e9 tempest-TestStampPattern-248517944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:38 devstack sudo[102214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7
Nov 05 19:22:38 devstack sudo[102214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cbb7cf2d-15f0-466f-8bb0-7b3660de909f tempest-ProjectReaderTests-669636630 None] Acquiring lock "cinder-7ff91443-7c94-4dd0-93d9-326807b21787-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:22:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cbb7cf2d-15f0-466f-8bb0-7b3660de909f tempest-ProjectReaderTests-669636630 None] Lock "cinder-7ff91443-7c94-4dd0-93d9-326807b21787-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:22:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cbb7cf2d-15f0-466f-8bb0-7b3660de909f tempest-ProjectReaderTests-669636630 None] Acquiring lock "cinder-quobyte-7ff91443-7c94-4dd0-93d9-326807b21787" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:22:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cbb7cf2d-15f0-466f-8bb0-7b3660de909f tempest-ProjectReaderTests-669636630 None] Lock "cinder-quobyte-7ff91443-7c94-4dd0-93d9-326807b21787" acquired by "delete_volume" :: waited 0.023s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:22:38 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b111b21-77a3-4a21-9d3f-2ea3c2f850c0]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:22:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cbb7cf2d-15f0-466f-8bb0-7b3660de909f tempest-ProjectReaderTests-669636630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7ff91443-7c94-4dd0-93d9-326807b21787 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:38 devstack sudo[102214]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ffc0f95d-385b-4c66-843c-ca5ab762f2e9 tempest-TestStampPattern-248517944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7" returned: 0 in 0.364s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ffc0f95d-385b-4c66-843c-ca5ab762f2e9 tempest-TestStampPattern-248517944 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:22:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ffc0f95d-385b-4c66-843c-ca5ab762f2e9 tempest-TestStampPattern-248517944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:22:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ffc0f95d-385b-4c66-843c-ca5ab762f2e9 tempest-TestStampPattern-248517944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f679067e-68a0-4e02-ad6c-e9fbe5e44ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ffc0f95d-385b-4c66-843c-ca5ab762f2e9 tempest-TestStampPattern-248517944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (306c0337-799d-4026-80e1-e871c8a68f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:38 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-ffc0f95d-385b-4c66-843c-ca5ab762f2e9 tempest-TestStampPattern-248517944 None] Volume volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7 (aadd5db7-ec82-49ae-8dc6-cd95e02e23e7): created successfully
Nov 05 19:22:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ffc0f95d-385b-4c66-843c-ca5ab762f2e9 tempest-TestStampPattern-248517944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (306c0337-799d-4026-80e1-e871c8a68f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ffc0f95d-385b-4c66-843c-ca5ab762f2e9 tempest-TestStampPattern-248517944 None] Flow 'volume_create_manager' (53e586ff-b3fd-4958-9085-264d7bdda1a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:22:38 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-ffc0f95d-385b-4c66-843c-ca5ab762f2e9 tempest-TestStampPattern-248517944 None] Created volume successfully.
Nov 05 19:22:38 devstack sudo[102217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7ff91443-7c94-4dd0-93d9-326807b21787
Nov 05 19:22:38 devstack sudo[102217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:38 devstack sudo[102217]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cbb7cf2d-15f0-466f-8bb0-7b3660de909f tempest-ProjectReaderTests-669636630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7ff91443-7c94-4dd0-93d9-326807b21787" returned: 0 in 0.484s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cbb7cf2d-15f0-466f-8bb0-7b3660de909f tempest-ProjectReaderTests-669636630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7ff91443-7c94-4dd0-93d9-326807b21787 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:38 devstack sudo[102229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7ff91443-7c94-4dd0-93d9-326807b21787
Nov 05 19:22:38 devstack sudo[102229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:39 devstack sudo[102229]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cbb7cf2d-15f0-466f-8bb0-7b3660de909f tempest-ProjectReaderTests-669636630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7ff91443-7c94-4dd0-93d9-326807b21787" returned: 0 in 0.267s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cbb7cf2d-15f0-466f-8bb0-7b3660de909f tempest-ProjectReaderTests-669636630 None] Lock "cinder-quobyte-7ff91443-7c94-4dd0-93d9-326807b21787" released by "delete_volume" :: held 0.810s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:22:39 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-cbb7cf2d-15f0-466f-8bb0-7b3660de909f tempest-ProjectReaderTests-669636630 None] Created reservations ['a7a501eb-0782-46c9-b45b-400715e7c488', 'fb3bfe65-275c-4cf6-9176-94340fb36e2b', 'd9068ac0-7d9b-4bb7-bad7-fbc6878e8681', 'bf90c207-20b4-43cb-9bf3-793fce2bc97b'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:22:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cbb7cf2d-15f0-466f-8bb0-7b3660de909f tempest-ProjectReaderTests-669636630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:22:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cbb7cf2d-15f0-466f-8bb0-7b3660de909f tempest-ProjectReaderTests-669636630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:22:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-cbb7cf2d-15f0-466f-8bb0-7b3660de909f tempest-ProjectReaderTests-669636630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:22:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-cbb7cf2d-15f0-466f-8bb0-7b3660de909f tempest-ProjectReaderTests-669636630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:22:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cbb7cf2d-15f0-466f-8bb0-7b3660de909f tempest-ProjectReaderTests-669636630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:22:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cbb7cf2d-15f0-466f-8bb0-7b3660de909f tempest-ProjectReaderTests-669636630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:39 devstack sudo[102244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:22:39 devstack sudo[102244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:39 devstack sudo[102244]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cbb7cf2d-15f0-466f-8bb0-7b3660de909f tempest-ProjectReaderTests-669636630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.310s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:39 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-cbb7cf2d-15f0-466f-8bb0-7b3660de909f tempest-ProjectReaderTests-669636630 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:22:39 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-cbb7cf2d-15f0-466f-8bb0-7b3660de909f tempest-ProjectReaderTests-669636630 None] Deleted volume successfully.
Nov 05 19:22:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cbb7cf2d-15f0-466f-8bb0-7b3660de909f tempest-ProjectReaderTests-669636630 None] Lock "cinder-7ff91443-7c94-4dd0-93d9-326807b21787-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:22:48 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:22:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Flow 'volume_create_manager' (450d222f-b504-4153-8a0b-6f32ea9176eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:22:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0f3e4f6-a1e2-4b67-90fe-3a2e4deb7e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0f3e4f6-a1e2-4b67-90fe-3a2e4deb7e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab422825-c66e-4cef-91bf-6740d7ca3170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='863cf7c0e0a442fdace51625d5408c4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:22:49Z,use_quota=True,user_id='86dd9470943f4237923dffd7b8b2aee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de2124e-24da-4590-b41b-82c974f0ce72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de2124e-24da-4590-b41b-82c974f0ce72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (221a0724-c884-4ea4-96a7-c155d8e92e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:48 devstack cinder-volume[87184]: DEBUG cinder.image.glance [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Creating Keystone auth plugin from conf {{(pid=87184) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 19:22:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (221a0724-c884-4ea4-96a7-c155d8e92e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ab422825-c66e-4cef-91bf-6740d7ca3170', 'volume_name': 'volume-ab422825-c66e-4cef-91bf-6740d7ca3170', 'volume_size': 1, 'image_id': '8d398422-038e-4fb2-a7f5-a0e12d88f78f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d398422-038e-4fb2-a7f5-a0e12d88f78f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ad84e96be65d7997274c4bc4fec03d72', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '863cf7c0e0a442fdace51625d5408c4f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'da6a1a39bd53e3c3650dfcd3737139e095397a61ddbda83850125488df242cdc440ba9f7d44fce763f14888f869d3161ebbd15d14aebb1de9644c8ac1d926005', 'id': '8d398422-038e-4fb2-a7f5-a0e12d88f78f', 'created_at': datetime.datetime(2026, 11, 5, 18, 22, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 18, 22, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d398422-038e-4fb2-a7f5-a0e12d88f78f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x736631d3f860>}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bd98e5a-65b7-45ed-aa31-cc8698f50938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bd98e5a-65b7-45ed-aa31-cc8698f50938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aa0683a-a25b-4c86-832a-db3fc65660c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:49 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Volume ab422825-c66e-4cef-91bf-6740d7ca3170: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ab422825-c66e-4cef-91bf-6740d7ca3170', 'volume_size': 1, 'image_id': '8d398422-038e-4fb2-a7f5-a0e12d88f78f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d398422-038e-4fb2-a7f5-a0e12d88f78f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ad84e96be65d7997274c4bc4fec03d72', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '863cf7c0e0a442fdace51625d5408c4f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'da6a1a39bd53e3c3650dfcd3737139e095397a61ddbda83850125488df242cdc440ba9f7d44fce763f14888f869d3161ebbd15d14aebb1de9644c8ac1d926005', 'id': '8d398422-038e-4fb2-a7f5-a0e12d88f78f', 'created_at': datetime.datetime(2026, 11, 5, 18, 22, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 18, 22, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d398422-038e-4fb2-a7f5-a0e12d88f78f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x736631d3f860>}
Nov 05 19:22:49 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Trying to clone ab422825-c66e-4cef-91bf-6740d7ca3170 from image 8d398422-038e-4fb2-a7f5-a0e12d88f78f at location (None, [{'url': 'file:///opt/stack/data/glance/images/8d398422-038e-4fb2-a7f5-a0e12d88f78f', 'metadata': {}}]). {{(pid=87184) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 19:22:49 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8d398422-038e-4fb2-a7f5-a0e12d88f78f_j9yujoq8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 19:22:49 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Image download 0.00 MB at 0.00 MB/s
Nov 05 19:22:49 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71e0711-bcc0-4521-9d26-ddbc6052e547]: (4, 'raw') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:22:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d398422-038e-4fb2-a7f5-a0e12d88f78f_j9yujoq8devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:49 devstack sudo[102334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d398422-038e-4fb2-a7f5-a0e12d88f78f_j9yujoq8devstack@QuobyteHD
Nov 05 19:22:49 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:49 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d398422-038e-4fb2-a7f5-a0e12d88f78f_j9yujoq8devstack@QuobyteHD" returned: 0 in 0.337s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d398422-038e-4fb2-a7f5-a0e12d88f78f_j9yujoq8devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:49 devstack sudo[102338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d398422-038e-4fb2-a7f5-a0e12d88f78f_j9yujoq8devstack@QuobyteHD
Nov 05 19:22:49 devstack sudo[102338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:50 devstack sudo[102338]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d398422-038e-4fb2-a7f5-a0e12d88f78f_j9yujoq8devstack@QuobyteHD" returned: 1 in 0.366s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d398422-038e-4fb2-a7f5-a0e12d88f78f_j9yujoq8devstack@QuobyteHD' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 19:22:50 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Temporary image 8d398422-038e-4fb2-a7f5-a0e12d88f78f is fetched for user 86dd9470943f4237923dffd7b8b2aee3. {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 19:22:50 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fed124f-2fb7-4af9-9f48-bc6262e5e07e]: (4, 'raw') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:22:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d398422-038e-4fb2-a7f5-a0e12d88f78f_j9yujoq8devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:50 devstack sudo[102343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d398422-038e-4fb2-a7f5-a0e12d88f78f_j9yujoq8devstack@QuobyteHD
Nov 05 19:22:50 devstack sudo[102343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:50 devstack sudo[102343]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d398422-038e-4fb2-a7f5-a0e12d88f78f_j9yujoq8devstack@QuobyteHD" returned: 0 in 0.344s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d398422-038e-4fb2-a7f5-a0e12d88f78f_j9yujoq8devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:50 devstack sudo[102347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d398422-038e-4fb2-a7f5-a0e12d88f78f_j9yujoq8devstack@QuobyteHD
Nov 05 19:22:50 devstack sudo[102347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:50 devstack sudo[102347]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d398422-038e-4fb2-a7f5-a0e12d88f78f_j9yujoq8devstack@QuobyteHD" returned: 1 in 0.319s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d398422-038e-4fb2-a7f5-a0e12d88f78f_j9yujoq8devstack@QuobyteHD' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 19:22:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:22:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:22:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab422825-c66e-4cef-91bf-6740d7ca3170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='863cf7c0e0a442fdace51625d5408c4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:22:49Z,use_quota=True,user_id='86dd9470943f4237923dffd7b8b2aee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:22:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Creating volume ab422825-c66e-4cef-91bf-6740d7ca3170 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:22:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:22:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:22:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:22:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:22:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:22:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:22:50 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:22:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ab422825-c66e-4cef-91bf-6740d7ca3170 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:50 devstack sudo[102352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ab422825-c66e-4cef-91bf-6740d7ca3170 1073741824
Nov 05 19:22:50 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:51 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ab422825-c66e-4cef-91bf-6740d7ca3170 1073741824" returned: 0 in 0.475s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ab422825-c66e-4cef-91bf-6740d7ca3170 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:51 devstack sudo[102393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ab422825-c66e-4cef-91bf-6740d7ca3170
Nov 05 19:22:51 devstack sudo[102393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:51 devstack sudo[102393]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ab422825-c66e-4cef-91bf-6740d7ca3170" returned: 0 in 0.264s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:51 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:22:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:22:51 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Attempting download of 8d398422-038e-4fb2-a7f5-a0e12d88f78f ((None, [{'url': 'file:///opt/stack/data/glance/images/8d398422-038e-4fb2-a7f5-a0e12d88f78f', 'metadata': {}}])) to volume ab422825-c66e-4cef-91bf-6740d7ca3170. {{(pid=87184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 19:22:51 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2453844-a15e-47e3-9fef-9b2361bed650]: (4, 'raw') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:22:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d398422-038e-4fb2-a7f5-a0e12d88f78f_ikf2kp2u {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:51 devstack sudo[102396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d398422-038e-4fb2-a7f5-a0e12d88f78f_ikf2kp2u
Nov 05 19:22:51 devstack sudo[102396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:52 devstack sudo[102396]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d398422-038e-4fb2-a7f5-a0e12d88f78f_ikf2kp2u" returned: 0 in 0.342s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d398422-038e-4fb2-a7f5-a0e12d88f78f_ikf2kp2u {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:52 devstack sudo[102400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d398422-038e-4fb2-a7f5-a0e12d88f78f_ikf2kp2u
Nov 05 19:22:52 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:52 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d398422-038e-4fb2-a7f5-a0e12d88f78f_ikf2kp2u" returned: 1 in 0.331s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d398422-038e-4fb2-a7f5-a0e12d88f78f_ikf2kp2u' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 19:22:52 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f801580-c28d-45de-a8d9-e59b7c4cdafe]: (4, 'raw') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:22:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d398422-038e-4fb2-a7f5-a0e12d88f78f_j9yujoq8devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:52 devstack sudo[102404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d398422-038e-4fb2-a7f5-a0e12d88f78f_j9yujoq8devstack@QuobyteHD
Nov 05 19:22:52 devstack sudo[102404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:52 devstack sudo[102404]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d398422-038e-4fb2-a7f5-a0e12d88f78f_j9yujoq8devstack@QuobyteHD" returned: 0 in 0.332s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d398422-038e-4fb2-a7f5-a0e12d88f78f_j9yujoq8devstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:52 devstack sudo[102408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d398422-038e-4fb2-a7f5-a0e12d88f78f_j9yujoq8devstack@QuobyteHD
Nov 05 19:22:52 devstack sudo[102408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:53 devstack sudo[102408]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d398422-038e-4fb2-a7f5-a0e12d88f78f_j9yujoq8devstack@QuobyteHD" returned: 1 in 0.348s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d398422-038e-4fb2-a7f5-a0e12d88f78f_j9yujoq8devstack@QuobyteHD' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 19:22:53 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] 8d398422-038e-4fb2-a7f5-a0e12d88f78f was raw, converting to qcow2 {{(pid=87184) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 19:22:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8d398422-038e-4fb2-a7f5-a0e12d88f78f_j9yujoq8devstack@QuobyteHD /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ab422825-c66e-4cef-91bf-6740d7ca3170 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:53 devstack sudo[102413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8d398422-038e-4fb2-a7f5-a0e12d88f78f_j9yujoq8devstack@QuobyteHD /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ab422825-c66e-4cef-91bf-6740d7ca3170
Nov 05 19:22:53 devstack sudo[102413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:53 devstack sudo[102413]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8d398422-038e-4fb2-a7f5-a0e12d88f78f_j9yujoq8devstack@QuobyteHD /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ab422825-c66e-4cef-91bf-6740d7ca3170" returned: 0 in 0.445s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:53 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8d398422-038e-4fb2-a7f5-a0e12d88f78f_j9yujoq8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ab422825-c66e-4cef-91bf-6740d7ca3170 {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 19:22:53 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Converted 0.00 MB image at 0.00 MB/s
Nov 05 19:22:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ab422825-c66e-4cef-91bf-6740d7ca3170 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:53 devstack sudo[102418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ab422825-c66e-4cef-91bf-6740d7ca3170 1G
Nov 05 19:22:53 devstack sudo[102418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:53 devstack sudo[102418]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ab422825-c66e-4cef-91bf-6740d7ca3170 1G" returned: 0 in 0.323s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:53 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Downloaded image 8d398422-038e-4fb2-a7f5-a0e12d88f78f ((None, [{'url': 'file:///opt/stack/data/glance/images/8d398422-038e-4fb2-a7f5-a0e12d88f78f', 'metadata': {}}])) to volume ab422825-c66e-4cef-91bf-6740d7ca3170 successfully. {{(pid=87184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 19:22:53 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Temporary image 8d398422-038e-4fb2-a7f5-a0e12d88f78f for user 86dd9470943f4237923dffd7b8b2aee3 is deleted. {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 19:22:53 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Marking volume ab422825-c66e-4cef-91bf-6740d7ca3170 as bootable. {{(pid=87184) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 19:22:53 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Copying metadata from image 8d398422-038e-4fb2-a7f5-a0e12d88f78f to ab422825-c66e-4cef-91bf-6740d7ca3170. {{(pid=87184) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 19:22:53 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Creating volume glance metadata for volume ab422825-c66e-4cef-91bf-6740d7ca3170 backed by image 8d398422-038e-4fb2-a7f5-a0e12d88f78f with: {'image_id': '8d398422-038e-4fb2-a7f5-a0e12d88f78f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ad84e96be65d7997274c4bc4fec03d72', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87184) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 19:22:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aa0683a-a25b-4c86-832a-db3fc65660c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab422825-c66e-4cef-91bf-6740d7ca3170', 'volume_size': 1, 'image_id': '8d398422-038e-4fb2-a7f5-a0e12d88f78f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d398422-038e-4fb2-a7f5-a0e12d88f78f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ad84e96be65d7997274c4bc4fec03d72', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '863cf7c0e0a442fdace51625d5408c4f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'da6a1a39bd53e3c3650dfcd3737139e095397a61ddbda83850125488df242cdc440ba9f7d44fce763f14888f869d3161ebbd15d14aebb1de9644c8ac1d926005', 'id': '8d398422-038e-4fb2-a7f5-a0e12d88f78f', 'created_at': datetime.datetime(2026, 11, 5, 18, 22, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 18, 22, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d398422-038e-4fb2-a7f5-a0e12d88f78f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x736631d3f860>}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73154d78-23e8-465a-82e9-dc1df06b030c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:22:53 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Volume volume-ab422825-c66e-4cef-91bf-6740d7ca3170 (ab422825-c66e-4cef-91bf-6740d7ca3170): created successfully
Nov 05 19:22:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73154d78-23e8-465a-82e9-dc1df06b030c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:22:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Flow 'volume_create_manager' (450d222f-b504-4153-8a0b-6f32ea9176eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:22:53 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-be66a4c1-1845-479d-8099-ff98cad3009a tempest-VolumeImageDependencyTests-917891061 None] Created volume successfully.
Nov 05 19:22:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c66a4af3-be6b-4dac-80b3-aacc5d2fad56 tempest-VolumeImageDependencyTests-917891061 None] Acquiring lock "cinder-ab422825-c66e-4cef-91bf-6740d7ca3170-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:22:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c66a4af3-be6b-4dac-80b3-aacc5d2fad56 tempest-VolumeImageDependencyTests-917891061 None] Lock "cinder-ab422825-c66e-4cef-91bf-6740d7ca3170-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:22:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c66a4af3-be6b-4dac-80b3-aacc5d2fad56 tempest-VolumeImageDependencyTests-917891061 None] Acquiring lock "cinder-quobyte-ab422825-c66e-4cef-91bf-6740d7ca3170" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:22:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c66a4af3-be6b-4dac-80b3-aacc5d2fad56 tempest-VolumeImageDependencyTests-917891061 None] Lock "cinder-quobyte-ab422825-c66e-4cef-91bf-6740d7ca3170" acquired by "delete_volume" :: waited 0.015s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:22:55 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fac851b-669b-46d4-9a3d-0c2fcce5d00b]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:22:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c66a4af3-be6b-4dac-80b3-aacc5d2fad56 tempest-VolumeImageDependencyTests-917891061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ab422825-c66e-4cef-91bf-6740d7ca3170 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:55 devstack sudo[102423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ab422825-c66e-4cef-91bf-6740d7ca3170
Nov 05 19:22:55 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:55 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c66a4af3-be6b-4dac-80b3-aacc5d2fad56 tempest-VolumeImageDependencyTests-917891061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ab422825-c66e-4cef-91bf-6740d7ca3170" returned: 0 in 0.383s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c66a4af3-be6b-4dac-80b3-aacc5d2fad56 tempest-VolumeImageDependencyTests-917891061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ab422825-c66e-4cef-91bf-6740d7ca3170 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:55 devstack sudo[102429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ab422825-c66e-4cef-91bf-6740d7ca3170
Nov 05 19:22:55 devstack sudo[102429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:55 devstack sudo[102429]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c66a4af3-be6b-4dac-80b3-aacc5d2fad56 tempest-VolumeImageDependencyTests-917891061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-ab422825-c66e-4cef-91bf-6740d7ca3170" returned: 0 in 0.262s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c66a4af3-be6b-4dac-80b3-aacc5d2fad56 tempest-VolumeImageDependencyTests-917891061 None] Lock "cinder-quobyte-ab422825-c66e-4cef-91bf-6740d7ca3170" released by "delete_volume" :: held 0.694s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:22:55 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-c66a4af3-be6b-4dac-80b3-aacc5d2fad56 tempest-VolumeImageDependencyTests-917891061 None] Created reservations ['4a5544eb-3e88-4f60-812e-ecf58ed1f2bb', '5a646d16-f80d-45e5-9499-15882cb4fa01', '45a377db-fce7-4a58-9d8a-80f41f48d8b3', 'e6638ea8-50b3-4815-9198-a2f4b7591ccd'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:22:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c66a4af3-be6b-4dac-80b3-aacc5d2fad56 tempest-VolumeImageDependencyTests-917891061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:22:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c66a4af3-be6b-4dac-80b3-aacc5d2fad56 tempest-VolumeImageDependencyTests-917891061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:22:56 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c66a4af3-be6b-4dac-80b3-aacc5d2fad56 tempest-VolumeImageDependencyTests-917891061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:22:56 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c66a4af3-be6b-4dac-80b3-aacc5d2fad56 tempest-VolumeImageDependencyTests-917891061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:22:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c66a4af3-be6b-4dac-80b3-aacc5d2fad56 tempest-VolumeImageDependencyTests-917891061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:22:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c66a4af3-be6b-4dac-80b3-aacc5d2fad56 tempest-VolumeImageDependencyTests-917891061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:22:56 devstack sudo[102450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:22:56 devstack sudo[102450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:22:56 devstack sudo[102450]: pam_unix(sudo:session): session closed for user root
Nov 05 19:22:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c66a4af3-be6b-4dac-80b3-aacc5d2fad56 tempest-VolumeImageDependencyTests-917891061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.259s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:22:56 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-c66a4af3-be6b-4dac-80b3-aacc5d2fad56 tempest-VolumeImageDependencyTests-917891061 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:22:56 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-c66a4af3-be6b-4dac-80b3-aacc5d2fad56 tempest-VolumeImageDependencyTests-917891061 None] Deleted volume successfully.
Nov 05 19:22:56 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c66a4af3-be6b-4dac-80b3-aacc5d2fad56 tempest-VolumeImageDependencyTests-917891061 None] Lock "cinder-ab422825-c66e-4cef-91bf-6740d7ca3170-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:23:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:23:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:23:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:23:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:23:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:23:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:23:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:23:05 devstack sudo[102455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:23:05 devstack sudo[102455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:23:05 devstack sudo[102455]: pam_unix(sudo:session): session closed for user root
Nov 05 19:23:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.265s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:23:05 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:23:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:23:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread count: 28 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 19:23:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread info: [<_MainThread(MainThread, started 126882883072128)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126882770872512)>, <Thread(Thread-3 (stat_writer), started daemon 126882769837376)>, <Thread(Rabbit-heartbeat, started daemon 126882768896256)>, <Thread(Thread-5 (_runner), started daemon 126882768980928)>, <Thread(Thread-7 (_runner), started daemon 126882767016448)>, <Thread(fd_logger, started daemon 126882764561216)>, <Thread(privsep_reader, started daemon 126882764568576)>, <Thread(tpool_thread_0, started daemon 126882759292608)>, <Thread(tpool_thread_1, started daemon 126882750899904)>, <Thread(tpool_thread_2, started daemon 126882742507200)>, <Thread(tpool_thread_3, started daemon 126882734114496)>, <Thread(tpool_thread_4, started daemon 126882725721792)>, <Thread(tpool_thread_5, started daemon 126882717329088)>, <Thread(tpool_thread_6, started daemon 126882708920000)>, <Thread(tpool_thread_7, started daemon 126882700510912)>, <Thread(tpool_thread_8, started daemon 126882692101824)>, <Thread(tpool_thread_9, started daemon 126882683692736)>, <Thread(tpool_thread_10, started daemon 126882675283648)>, <Thread(tpool_thread_11, started daemon 126882666874560)>, <Thread(tpool_thread_12, started daemon 126882658465472)>, <Thread(tpool_thread_13, started daemon 126882650056384)>, <Thread(tpool_thread_14, started daemon 126882641647296)>, <Thread(tpool_thread_15, started daemon 126882633238208)>, <Thread(tpool_thread_16, started daemon 126882624829120)>, <Thread(tpool_thread_17, started daemon 126882616420032)>, <Thread(tpool_thread_18, started daemon 126882608010944)>, <Thread(tpool_thread_19, started daemon 126882599601856)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 19:23:06 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=73,cinder:INSERT=30,cinder:UPDATE=107,cinder:DELETE=8 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:23:06 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:UPDATE=107,cinder:SELECT=70,cinder:INSERT=28,cinder:DELETE=9 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:23:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-a94e6b39-525d-4b2c-ae86-c6ba37a06351 req-fd14c169-2863-49aa-a0a3-71417417cfbd tempest-TestStampPattern-248517944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:23:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-a94e6b39-525d-4b2c-ae86-c6ba37a06351 req-fd14c169-2863-49aa-a0a3-71417417cfbd tempest-TestStampPattern-248517944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:23:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-a94e6b39-525d-4b2c-ae86-c6ba37a06351 req-fd14c169-2863-49aa-a0a3-71417417cfbd tempest-TestStampPattern-248517944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:23:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-a94e6b39-525d-4b2c-ae86-c6ba37a06351 req-fd14c169-2863-49aa-a0a3-71417417cfbd tempest-TestStampPattern-248517944 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec', 'name': 'volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c7485fd4-3e2e-4e1f-9f40-412ab899084d', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 19:23:08 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-a94e6b39-525d-4b2c-ae86-c6ba37a06351 req-fd14c169-2863-49aa-a0a3-71417417cfbd tempest-TestStampPattern-248517944 None] attachment_update completed successfully.
Nov 05 19:23:12 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-f8da53f6-66b3-4271-80bd-90bd385e6f57 req-d90a3ef6-08b2-4754-91ea-fc228f63d275 tempest-TestStampPattern-248517944 None] Terminate volume connection completed successfully.
Nov 05 19:23:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-f8da53f6-66b3-4271-80bd-90bd385e6f57 req-d90a3ef6-08b2-4754-91ea-fc228f63d275 tempest-TestStampPattern-248517944 None] Deleting attachment c7485fd4-3e2e-4e1f-9f40-412ab899084d. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 19:23:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1e80d4ad-8ab1-4af4-9418-79e1fd6d6041 tempest-TestStampPattern-248517944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:23:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1e80d4ad-8ab1-4af4-9418-79e1fd6d6041 tempest-TestStampPattern-248517944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:23:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-1e80d4ad-8ab1-4af4-9418-79e1fd6d6041 tempest-TestStampPattern-248517944 None] Creating offline snapshot 63c85972-8991-438e-8b07-8155ce05425e of volume aadd5db7-ec82-49ae-8dc6-cd95e02e23e7 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:23:13 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b79175-f237-496f-85a5-9dbf25f8c914]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:23:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1e80d4ad-8ab1-4af4-9418-79e1fd6d6041 tempest-TestStampPattern-248517944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:23:13 devstack sudo[102939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7
Nov 05 19:23:13 devstack sudo[102939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:23:13 devstack sudo[102939]: pam_unix(sudo:session): session closed for user root
Nov 05 19:23:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1e80d4ad-8ab1-4af4-9418-79e1fd6d6041 tempest-TestStampPattern-248517944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7" returned: 0 in 0.359s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:23:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1e80d4ad-8ab1-4af4-9418-79e1fd6d6041 tempest-TestStampPattern-248517944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7.63c85972-8991-438e-8b07-8155ce05425e 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:23:13 devstack sudo[102944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7.63c85972-8991-438e-8b07-8155ce05425e 1G
Nov 05 19:23:13 devstack sudo[102944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:23:14 devstack sudo[102944]: pam_unix(sudo:session): session closed for user root
Nov 05 19:23:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1e80d4ad-8ab1-4af4-9418-79e1fd6d6041 tempest-TestStampPattern-248517944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7.63c85972-8991-438e-8b07-8155ce05425e 1G" returned: 0 in 0.382s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:23:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1e80d4ad-8ab1-4af4-9418-79e1fd6d6041 tempest-TestStampPattern-248517944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7.63c85972-8991-438e-8b07-8155ce05425e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:23:14 devstack sudo[102949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7.63c85972-8991-438e-8b07-8155ce05425e
Nov 05 19:23:14 devstack sudo[102949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:23:14 devstack sudo[102949]: pam_unix(sudo:session): session closed for user root
Nov 05 19:23:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1e80d4ad-8ab1-4af4-9418-79e1fd6d6041 tempest-TestStampPattern-248517944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7.63c85972-8991-438e-8b07-8155ce05425e" returned: 0 in 0.279s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:23:14 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-1e80d4ad-8ab1-4af4-9418-79e1fd6d6041 tempest-TestStampPattern-248517944 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7.63c85972-8991-438e-8b07-8155ce05425e is being set with open permissions: ugo+rw
Nov 05 19:23:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1e80d4ad-8ab1-4af4-9418-79e1fd6d6041 tempest-TestStampPattern-248517944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7.63c85972-8991-438e-8b07-8155ce05425e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:23:14 devstack sudo[102955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7.63c85972-8991-438e-8b07-8155ce05425e
Nov 05 19:23:14 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:23:14 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root
Nov 05 19:23:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1e80d4ad-8ab1-4af4-9418-79e1fd6d6041 tempest-TestStampPattern-248517944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7.63c85972-8991-438e-8b07-8155ce05425e" returned: 0 in 0.237s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:23:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1e80d4ad-8ab1-4af4-9418-79e1fd6d6041 tempest-TestStampPattern-248517944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:23:14 devstack sudo[102958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7.info
Nov 05 19:23:14 devstack sudo[102958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:23:14 devstack sudo[102958]: pam_unix(sudo:session): session closed for user root
Nov 05 19:23:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1e80d4ad-8ab1-4af4-9418-79e1fd6d6041 tempest-TestStampPattern-248517944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7.info" returned: 0 in 0.246s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:23:14 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-1e80d4ad-8ab1-4af4-9418-79e1fd6d6041 tempest-TestStampPattern-248517944 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7.info is being set with open permissions: ugo+rw
Nov 05 19:23:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1e80d4ad-8ab1-4af4-9418-79e1fd6d6041 tempest-TestStampPattern-248517944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:23:14 devstack sudo[102961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7.info
Nov 05 19:23:14 devstack sudo[102961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:23:15 devstack sudo[102961]: pam_unix(sudo:session): session closed for user root
Nov 05 19:23:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1e80d4ad-8ab1-4af4-9418-79e1fd6d6041 tempest-TestStampPattern-248517944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7.info" returned: 0 in 0.246s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:23:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1e80d4ad-8ab1-4af4-9418-79e1fd6d6041 tempest-TestStampPattern-248517944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.835s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:23:15 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-1e80d4ad-8ab1-4af4-9418-79e1fd6d6041 tempest-TestStampPattern-248517944 None] Create snapshot completed successfully
Nov 05 19:23:22 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:23:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Flow 'volume_create_manager' (14547058-3c47-4ab5-a5dc-db50b3ab5c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:23:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fdd84b2-de37-4a43-8508-4f8c2002aeac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:23:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fdd84b2-de37-4a43-8508-4f8c2002aeac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1841881667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64ad35d8-1e4a-4afd-83bc-6e495111b530,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e1ff786a63242a5b30d06170c6e5e14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=63c85972-8991-438e-8b07-8155ce05425e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:23:22Z,use_quota=True,user_id='a3476caf9a4742d9ba7f3303d8fce9e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:23:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57384c48-3235-4365-845c-24dae65e2e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:23:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57384c48-3235-4365-845c-24dae65e2e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:23:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7fa22bd-6fa7-409e-9c6b-7b4086ccf2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:23:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7fa22bd-6fa7-409e-9c6b-7b4086ccf2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '64ad35d8-1e4a-4afd-83bc-6e495111b530', 'volume_name': 'volume-64ad35d8-1e4a-4afd-83bc-6e495111b530', 'volume_size': 1, 'snapshot_id': '63c85972-8991-438e-8b07-8155ce05425e'}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:23:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4123067-b247-462c-b748-5ea1dab33147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:23:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4123067-b247-462c-b748-5ea1dab33147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:23:22 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb9c446b-f62d-4bb1-9940-523e1ce93f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:23:22 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Volume 64ad35d8-1e4a-4afd-83bc-6e495111b530: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-64ad35d8-1e4a-4afd-83bc-6e495111b530', 'volume_size': 1, 'snapshot_id': '63c85972-8991-438e-8b07-8155ce05425e'}
Nov 05 19:23:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:23:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:23:22 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Acquiring lock "cinder-quobyte-63c85972-8991-438e-8b07-8155ce05425e-64ad35d8-1e4a-4afd-83bc-6e495111b530" by "_create_volume_from_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:23:22 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Lock "cinder-quobyte-63c85972-8991-438e-8b07-8155ce05425e-64ad35d8-1e4a-4afd-83bc-6e495111b530" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:23:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Creating volume 64ad35d8-1e4a-4afd-83bc-6e495111b530 from snapshot 63c85972-8991-438e-8b07-8155ce05425e {{(pid=87184) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 19:23:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:23:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:23:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:23:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:23:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:23:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:23:22 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Acquiring lock "cinder-quobyte-64ad35d8-1e4a-4afd-83bc-6e495111b530" by "_copy_volume_from_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:23:22 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Lock "cinder-quobyte-64ad35d8-1e4a-4afd-83bc-6e495111b530" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:23:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] snapshot: 63c85972-8991-438e-8b07-8155ce05425e, volume: 64ad35d8-1e4a-4afd-83bc-6e495111b530,  {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 19:23:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:23:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:23:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:23:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:23:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:23:22 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6695ae-f832-4265-b054-b6283c8aeec3]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:23:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7.63c85972-8991-438e-8b07-8155ce05425e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:23:22 devstack sudo[102988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7.63c85972-8991-438e-8b07-8155ce05425e
Nov 05 19:23:22 devstack sudo[102988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:23:22 devstack sudo[102988]: pam_unix(sudo:session): session closed for user root
Nov 05 19:23:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7.63c85972-8991-438e-8b07-8155ce05425e" returned: 0 in 0.381s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:23:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:23:22 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f86941-7d68-4e9c-904e-586db7afad8d]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:23:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:23:22 devstack sudo[102993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7
Nov 05 19:23:22 devstack sudo[102993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:23:23 devstack sudo[102993]: pam_unix(sudo:session): session closed for user root
Nov 05 19:23:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7" returned: 0 in 0.382s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:23:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7 {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 19:23:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Creating direct copy from snapshot {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 19:23:23 devstack cinder-volume[87184]: DEBUG cinder.utils [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Path /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-64ad35d8-1e4a-4afd-83bc-6e495111b530 not found in is_blk_device check {{(pid=87184) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 19:23:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-64ad35d8-1e4a-4afd-83bc-6e495111b530 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:23:23 devstack sudo[103002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-64ad35d8-1e4a-4afd-83bc-6e495111b530
Nov 05 19:23:23 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:23:31 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root
Nov 05 19:23:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-64ad35d8-1e4a-4afd-83bc-6e495111b530" returned: 0 in 8.713s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:23:31 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Image conversion details: src /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7, size 1024.00 MB, duration 8.71 sec, destination /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-64ad35d8-1e4a-4afd-83bc-6e495111b530 {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 19:23:31 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Converted 1024.00 MB image at 117.50 MB/s
Nov 05 19:23:31 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-64ad35d8-1e4a-4afd-83bc-6e495111b530 is being set with open permissions: ugo+rw
Nov 05 19:23:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-64ad35d8-1e4a-4afd-83bc-6e495111b530 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:23:31 devstack sudo[103085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-64ad35d8-1e4a-4afd-83bc-6e495111b530
Nov 05 19:23:31 devstack sudo[103085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:23:32 devstack sudo[103085]: pam_unix(sudo:session): session closed for user root
Nov 05 19:23:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-64ad35d8-1e4a-4afd-83bc-6e495111b530" returned: 0 in 0.261s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:23:32 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Lock "cinder-quobyte-64ad35d8-1e4a-4afd-83bc-6e495111b530" released by "_copy_volume_from_snapshot" :: held 9.851s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:23:32 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Lock "cinder-quobyte-63c85972-8991-438e-8b07-8155ce05425e-64ad35d8-1e4a-4afd-83bc-6e495111b530" released by "_create_volume_from_snapshot" :: held 9.942s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:23:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.960s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:23:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb9c446b-f62d-4bb1-9940-523e1ce93f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64ad35d8-1e4a-4afd-83bc-6e495111b530', 'volume_size': 1, 'snapshot_id': '63c85972-8991-438e-8b07-8155ce05425e'}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:23:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d09eadc9-1268-485f-b845-e1af01f925f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:23:32 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Volume volume-64ad35d8-1e4a-4afd-83bc-6e495111b530 (64ad35d8-1e4a-4afd-83bc-6e495111b530): created successfully
Nov 05 19:23:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d09eadc9-1268-485f-b845-e1af01f925f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:23:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Flow 'volume_create_manager' (14547058-3c47-4ab5-a5dc-db50b3ab5c97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:23:32 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-945cd053-ad01-4914-ac59-017f61e496a9 tempest-TestStampPattern-248517944 None] Created volume successfully.
Nov 05 19:23:42 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=14,cinder:UPDATE=5,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:23:45 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=16,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:24:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:24:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:24:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:24:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:24:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:24:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:24:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:05 devstack sudo[103170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:24:05 devstack sudo[103170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:05 devstack sudo[103170]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.248s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:05 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:24:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:24:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread count: 28 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 19:24:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread info: [<_MainThread(MainThread, started 126882883072128)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126882770872512)>, <Thread(Thread-3 (stat_writer), started daemon 126882769837376)>, <Thread(Rabbit-heartbeat, started daemon 126882768896256)>, <Thread(Thread-5 (_runner), started daemon 126882768980928)>, <Thread(Thread-7 (_runner), started daemon 126882767016448)>, <Thread(fd_logger, started daemon 126882764561216)>, <Thread(privsep_reader, started daemon 126882764568576)>, <Thread(tpool_thread_0, started daemon 126882759292608)>, <Thread(tpool_thread_1, started daemon 126882750899904)>, <Thread(tpool_thread_2, started daemon 126882742507200)>, <Thread(tpool_thread_3, started daemon 126882734114496)>, <Thread(tpool_thread_4, started daemon 126882725721792)>, <Thread(tpool_thread_5, started daemon 126882717329088)>, <Thread(tpool_thread_6, started daemon 126882708920000)>, <Thread(tpool_thread_7, started daemon 126882700510912)>, <Thread(tpool_thread_8, started daemon 126882692101824)>, <Thread(tpool_thread_9, started daemon 126882683692736)>, <Thread(tpool_thread_10, started daemon 126882675283648)>, <Thread(tpool_thread_11, started daemon 126882666874560)>, <Thread(tpool_thread_12, started daemon 126882658465472)>, <Thread(tpool_thread_13, started daemon 126882650056384)>, <Thread(tpool_thread_14, started daemon 126882641647296)>, <Thread(tpool_thread_15, started daemon 126882633238208)>, <Thread(tpool_thread_16, started daemon 126882624829120)>, <Thread(tpool_thread_17, started daemon 126882616420032)>, <Thread(tpool_thread_18, started daemon 126882608010944)>, <Thread(tpool_thread_19, started daemon 126882599601856)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 19:24:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-d79c38b5-232c-49ab-b459-8b2507716480 req-14685adb-90bd-49f3-acb4-2dd11b13a05e tempest-TestStampPattern-248517944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:24:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-d79c38b5-232c-49ab-b459-8b2507716480 req-14685adb-90bd-49f3-acb4-2dd11b13a05e tempest-TestStampPattern-248517944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:24:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [req-d79c38b5-232c-49ab-b459-8b2507716480 req-14685adb-90bd-49f3-acb4-2dd11b13a05e tempest-TestStampPattern-248517944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:24:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-d79c38b5-232c-49ab-b459-8b2507716480 req-14685adb-90bd-49f3-acb4-2dd11b13a05e tempest-TestStampPattern-248517944 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec', 'name': 'volume-64ad35d8-1e4a-4afd-83bc-6e495111b530', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c4e8a3ff-e2ed-48ad-a9aa-7d4ca2e3083a', 'enforce_multipath': True} {{(pid=87184) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 19:24:12 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-d79c38b5-232c-49ab-b459-8b2507716480 req-14685adb-90bd-49f3-acb4-2dd11b13a05e tempest-TestStampPattern-248517944 None] attachment_update completed successfully.
Nov 05 19:24:14 devstack cinder-volume[87184]: INFO cinder.volume.manager [req-26141953-2146-43c1-8f63-fbd51f376523 req-1d8a642d-60d1-4f8f-a40b-cbb7dca2a2f7 tempest-TestStampPattern-248517944 None] Terminate volume connection completed successfully.
Nov 05 19:24:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [req-26141953-2146-43c1-8f63-fbd51f376523 req-1d8a642d-60d1-4f8f-a40b-cbb7dca2a2f7 tempest-TestStampPattern-248517944 None] Deleting attachment c4e8a3ff-e2ed-48ad-a9aa-7d4ca2e3083a. {{(pid=87184) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 19:24:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fc26ca54-c104-44ed-916e-39fccebc0667 tempest-TestStampPattern-248517944 None] Acquiring lock "cinder-64ad35d8-1e4a-4afd-83bc-6e495111b530-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:24:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fc26ca54-c104-44ed-916e-39fccebc0667 tempest-TestStampPattern-248517944 None] Lock "cinder-64ad35d8-1e4a-4afd-83bc-6e495111b530-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:24:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fc26ca54-c104-44ed-916e-39fccebc0667 tempest-TestStampPattern-248517944 None] Acquiring lock "cinder-quobyte-64ad35d8-1e4a-4afd-83bc-6e495111b530" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:24:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fc26ca54-c104-44ed-916e-39fccebc0667 tempest-TestStampPattern-248517944 None] Lock "cinder-quobyte-64ad35d8-1e4a-4afd-83bc-6e495111b530" acquired by "delete_volume" :: waited 0.014s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:24:18 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc50463-24a2-4c72-8ee0-670124369f8c]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:24:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fc26ca54-c104-44ed-916e-39fccebc0667 tempest-TestStampPattern-248517944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-64ad35d8-1e4a-4afd-83bc-6e495111b530 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:18 devstack sudo[103676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-64ad35d8-1e4a-4afd-83bc-6e495111b530
Nov 05 19:24:18 devstack sudo[103676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:18 devstack sudo[103676]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fc26ca54-c104-44ed-916e-39fccebc0667 tempest-TestStampPattern-248517944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-64ad35d8-1e4a-4afd-83bc-6e495111b530" returned: 0 in 0.354s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fc26ca54-c104-44ed-916e-39fccebc0667 tempest-TestStampPattern-248517944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-64ad35d8-1e4a-4afd-83bc-6e495111b530 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:18 devstack sudo[103681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-64ad35d8-1e4a-4afd-83bc-6e495111b530
Nov 05 19:24:18 devstack sudo[103681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:19 devstack sudo[103681]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fc26ca54-c104-44ed-916e-39fccebc0667 tempest-TestStampPattern-248517944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-64ad35d8-1e4a-4afd-83bc-6e495111b530" returned: 0 in 0.238s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fc26ca54-c104-44ed-916e-39fccebc0667 tempest-TestStampPattern-248517944 None] Lock "cinder-quobyte-64ad35d8-1e4a-4afd-83bc-6e495111b530" released by "delete_volume" :: held 0.634s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:24:19 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-fc26ca54-c104-44ed-916e-39fccebc0667 tempest-TestStampPattern-248517944 None] Created reservations ['039a88d5-76f0-4345-8e3a-8d13af56ddaa', '37eb75ae-a6a4-43d1-b45d-90752c432da7', '4b32131d-486e-42fc-ad17-4d928e18e58e', '846ce061-e218-41ff-bd15-488734639cbd'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:24:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fc26ca54-c104-44ed-916e-39fccebc0667 tempest-TestStampPattern-248517944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:24:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fc26ca54-c104-44ed-916e-39fccebc0667 tempest-TestStampPattern-248517944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:24:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fc26ca54-c104-44ed-916e-39fccebc0667 tempest-TestStampPattern-248517944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:24:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fc26ca54-c104-44ed-916e-39fccebc0667 tempest-TestStampPattern-248517944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:24:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fc26ca54-c104-44ed-916e-39fccebc0667 tempest-TestStampPattern-248517944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:24:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fc26ca54-c104-44ed-916e-39fccebc0667 tempest-TestStampPattern-248517944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:19 devstack sudo[103684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:24:19 devstack sudo[103684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:19 devstack sudo[103684]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fc26ca54-c104-44ed-916e-39fccebc0667 tempest-TestStampPattern-248517944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.236s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:19 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-fc26ca54-c104-44ed-916e-39fccebc0667 tempest-TestStampPattern-248517944 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:24:19 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-fc26ca54-c104-44ed-916e-39fccebc0667 tempest-TestStampPattern-248517944 None] Deleted volume successfully.
Nov 05 19:24:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fc26ca54-c104-44ed-916e-39fccebc0667 tempest-TestStampPattern-248517944 None] Lock "cinder-64ad35d8-1e4a-4afd-83bc-6e495111b530-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:24:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-15d31a8e-bf60-4122-9f42-f14c94132aa2 tempest-TestStampPattern-248517944 None] Acquiring lock "cinder-63c85972-8991-438e-8b07-8155ce05425e-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:24:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-15d31a8e-bf60-4122-9f42-f14c94132aa2 tempest-TestStampPattern-248517944 None] Lock "cinder-63c85972-8991-438e-8b07-8155ce05425e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:24:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-15d31a8e-bf60-4122-9f42-f14c94132aa2 tempest-TestStampPattern-248517944 None] Acquiring lock "cinder-quobyte-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:24:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-15d31a8e-bf60-4122-9f42-f14c94132aa2 tempest-TestStampPattern-248517944 None] Lock "cinder-quobyte-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:24:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-15d31a8e-bf60-4122-9f42-f14c94132aa2 tempest-TestStampPattern-248517944 None] Acquiring lock "cinder-quobyte-63c85972-8991-438e-8b07-8155ce05425e" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:24:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-15d31a8e-bf60-4122-9f42-f14c94132aa2 tempest-TestStampPattern-248517944 None] Lock "cinder-quobyte-63c85972-8991-438e-8b07-8155ce05425e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:24:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-15d31a8e-bf60-4122-9f42-f14c94132aa2 tempest-TestStampPattern-248517944 None] Deleting offline snapshot 63c85972-8991-438e-8b07-8155ce05425e of volume aadd5db7-ec82-49ae-8dc6-cd95e02e23e7 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:24:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-15d31a8e-bf60-4122-9f42-f14c94132aa2 tempest-TestStampPattern-248517944 None] snapshot_file for this snap is: volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7.63c85972-8991-438e-8b07-8155ce05425e {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:24:19 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1f0071-bb7d-4f23-8e23-adc7b5854e33]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:24:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-15d31a8e-bf60-4122-9f42-f14c94132aa2 tempest-TestStampPattern-248517944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7.63c85972-8991-438e-8b07-8155ce05425e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:19 devstack sudo[103687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7.63c85972-8991-438e-8b07-8155ce05425e
Nov 05 19:24:19 devstack sudo[103687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:20 devstack sudo[103687]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-15d31a8e-bf60-4122-9f42-f14c94132aa2 tempest-TestStampPattern-248517944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7.63c85972-8991-438e-8b07-8155ce05425e" returned: 0 in 0.350s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-15d31a8e-bf60-4122-9f42-f14c94132aa2 tempest-TestStampPattern-248517944 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:24:20 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4df24f-bb4d-4dbd-8c7b-74e999cac6ca]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:24:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-15d31a8e-bf60-4122-9f42-f14c94132aa2 tempest-TestStampPattern-248517944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:20 devstack sudo[103692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7
Nov 05 19:24:20 devstack sudo[103692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:20 devstack sudo[103692]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-15d31a8e-bf60-4122-9f42-f14c94132aa2 tempest-TestStampPattern-248517944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7" returned: 0 in 0.504s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-15d31a8e-bf60-4122-9f42-f14c94132aa2 tempest-TestStampPattern-248517944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7.63c85972-8991-438e-8b07-8155ce05425e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:20 devstack sudo[103697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7.63c85972-8991-438e-8b07-8155ce05425e
Nov 05 19:24:20 devstack sudo[103697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:21 devstack sudo[103697]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-15d31a8e-bf60-4122-9f42-f14c94132aa2 tempest-TestStampPattern-248517944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7.63c85972-8991-438e-8b07-8155ce05425e" returned: 0 in 0.309s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-15d31a8e-bf60-4122-9f42-f14c94132aa2 tempest-TestStampPattern-248517944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7.63c85972-8991-438e-8b07-8155ce05425e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:21 devstack sudo[103702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7.63c85972-8991-438e-8b07-8155ce05425e
Nov 05 19:24:21 devstack sudo[103702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:21 devstack sudo[103702]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-15d31a8e-bf60-4122-9f42-f14c94132aa2 tempest-TestStampPattern-248517944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7.63c85972-8991-438e-8b07-8155ce05425e" returned: 0 in 0.244s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-15d31a8e-bf60-4122-9f42-f14c94132aa2 tempest-TestStampPattern-248517944 None] Lock "cinder-quobyte-63c85972-8991-438e-8b07-8155ce05425e" released by "_delete_snapshot" :: held 1.498s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:24:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-15d31a8e-bf60-4122-9f42-f14c94132aa2 tempest-TestStampPattern-248517944 None] Lock "cinder-quobyte-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7" released by "delete_snapshot" :: held 1.522s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:24:21 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-15d31a8e-bf60-4122-9f42-f14c94132aa2 tempest-TestStampPattern-248517944 None] Created reservations ['4a05add8-0e4d-4fcf-ab84-01fc5fc64469', '61e9b539-2348-4e84-a52d-6ded66a5a4d1', '075f7c01-aeeb-448d-a1b6-a9e034898c18', 'e678e2f7-9598-41a9-87d2-f9d652a36394'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:24:21 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-15d31a8e-bf60-4122-9f42-f14c94132aa2 tempest-TestStampPattern-248517944 None] Delete snapshot completed successfully.
Nov 05 19:24:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-15d31a8e-bf60-4122-9f42-f14c94132aa2 tempest-TestStampPattern-248517944 None] Lock "cinder-63c85972-8991-438e-8b07-8155ce05425e-delete_snapshot" released by "delete_snapshot" :: held 1.649s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:24:25 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c0b5ef9e-55c2-4a23-9aa0-feeec89dbb8b tempest-TestStampPattern-248517944 None] Acquiring lock "cinder-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:24:25 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c0b5ef9e-55c2-4a23-9aa0-feeec89dbb8b tempest-TestStampPattern-248517944 None] Lock "cinder-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:24:25 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c0b5ef9e-55c2-4a23-9aa0-feeec89dbb8b tempest-TestStampPattern-248517944 None] Acquiring lock "cinder-quobyte-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:24:25 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c0b5ef9e-55c2-4a23-9aa0-feeec89dbb8b tempest-TestStampPattern-248517944 None] Lock "cinder-quobyte-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7" acquired by "delete_volume" :: waited 0.014s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:24:25 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3aef67-48b4-45d7-816f-332e7fbd5e3e]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:24:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c0b5ef9e-55c2-4a23-9aa0-feeec89dbb8b tempest-TestStampPattern-248517944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:25 devstack sudo[103732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7
Nov 05 19:24:25 devstack sudo[103732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:25 devstack sudo[103732]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c0b5ef9e-55c2-4a23-9aa0-feeec89dbb8b tempest-TestStampPattern-248517944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7" returned: 0 in 0.366s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c0b5ef9e-55c2-4a23-9aa0-feeec89dbb8b tempest-TestStampPattern-248517944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:25 devstack sudo[103737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7
Nov 05 19:24:25 devstack sudo[103737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:25 devstack sudo[103737]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c0b5ef9e-55c2-4a23-9aa0-feeec89dbb8b tempest-TestStampPattern-248517944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7" returned: 0 in 0.253s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:25 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c0b5ef9e-55c2-4a23-9aa0-feeec89dbb8b tempest-TestStampPattern-248517944 None] Lock "cinder-quobyte-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7" released by "delete_volume" :: held 0.678s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:24:26 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-c0b5ef9e-55c2-4a23-9aa0-feeec89dbb8b tempest-TestStampPattern-248517944 None] Created reservations ['9ac65c5b-dc59-4e11-b8c4-7ac34bfe81a2', '0f01537f-df17-4853-9c92-633b2ab6dfa6', '6e6afaf0-e3fa-4594-9c40-dc6241300658', 'fa199d3f-9d3c-49d6-864f-66670370f670'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:24:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c0b5ef9e-55c2-4a23-9aa0-feeec89dbb8b tempest-TestStampPattern-248517944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:24:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c0b5ef9e-55c2-4a23-9aa0-feeec89dbb8b tempest-TestStampPattern-248517944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:24:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c0b5ef9e-55c2-4a23-9aa0-feeec89dbb8b tempest-TestStampPattern-248517944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:24:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c0b5ef9e-55c2-4a23-9aa0-feeec89dbb8b tempest-TestStampPattern-248517944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:24:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c0b5ef9e-55c2-4a23-9aa0-feeec89dbb8b tempest-TestStampPattern-248517944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:24:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c0b5ef9e-55c2-4a23-9aa0-feeec89dbb8b tempest-TestStampPattern-248517944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:26 devstack sudo[103740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:24:26 devstack sudo[103740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:26 devstack sudo[103740]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c0b5ef9e-55c2-4a23-9aa0-feeec89dbb8b tempest-TestStampPattern-248517944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.244s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:26 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-c0b5ef9e-55c2-4a23-9aa0-feeec89dbb8b tempest-TestStampPattern-248517944 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:24:26 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-c0b5ef9e-55c2-4a23-9aa0-feeec89dbb8b tempest-TestStampPattern-248517944 None] Deleted volume successfully.
Nov 05 19:24:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c0b5ef9e-55c2-4a23-9aa0-feeec89dbb8b tempest-TestStampPattern-248517944 None] Lock "cinder-aadd5db7-ec82-49ae-8dc6-cd95e02e23e7-delete_volume" released by "delete_volume" :: held 1.114s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:24:36 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=21,cinder:UPDATE=25,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:24:36 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=25,cinder:UPDATE=21,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:24:38 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-0add6d15-4e90-4b2b-b679-10d94241d450 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:24:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0add6d15-4e90-4b2b-b679-10d94241d450 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Flow 'volume_create_manager' (904536b4-7e03-48ff-9702-2eaa212e9077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:24:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0add6d15-4e90-4b2b-b679-10d94241d450 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2b7fd69-b33b-4e16-b8f6-8d189fd09372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:24:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0add6d15-4e90-4b2b-b679-10d94241d450 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2b7fd69-b33b-4e16-b8f6-8d189fd09372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-183687359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbe45200-8050-42be-9b33-b226047bcfde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e49fa75cffc4d97bddbdbb86af64f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:24:38Z,use_quota=True,user_id='4be10d0857254490a6d50b935fb738b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:24:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0add6d15-4e90-4b2b-b679-10d94241d450 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1ec7bed-8eae-4bb8-919f-9f04ad423f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:24:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0add6d15-4e90-4b2b-b679-10d94241d450 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1ec7bed-8eae-4bb8-919f-9f04ad423f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:24:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0add6d15-4e90-4b2b-b679-10d94241d450 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62b528f-2e62-4025-b07d-bb5715b4cca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:24:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0add6d15-4e90-4b2b-b679-10d94241d450 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62b528f-2e62-4025-b07d-bb5715b4cca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbe45200-8050-42be-9b33-b226047bcfde', 'volume_name': 'volume-fbe45200-8050-42be-9b33-b226047bcfde', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:24:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0add6d15-4e90-4b2b-b679-10d94241d450 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c65a3f5-7a5f-436d-9347-054342e3b795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:24:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0add6d15-4e90-4b2b-b679-10d94241d450 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c65a3f5-7a5f-436d-9347-054342e3b795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:24:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0add6d15-4e90-4b2b-b679-10d94241d450 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a6faf91-37a4-4432-9ab0-5aa9f2048bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:24:38 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-0add6d15-4e90-4b2b-b679-10d94241d450 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Volume fbe45200-8050-42be-9b33-b226047bcfde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbe45200-8050-42be-9b33-b226047bcfde', 'volume_size': 1}
Nov 05 19:24:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0add6d15-4e90-4b2b-b679-10d94241d450 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:24:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0add6d15-4e90-4b2b-b679-10d94241d450 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:24:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0add6d15-4e90-4b2b-b679-10d94241d450 tempest-CreateVolumesFromSnapshotTest-2127375374 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-183687359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbe45200-8050-42be-9b33-b226047bcfde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e49fa75cffc4d97bddbdbb86af64f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:24:38Z,use_quota=True,user_id='4be10d0857254490a6d50b935fb738b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:24:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-0add6d15-4e90-4b2b-b679-10d94241d450 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Creating volume fbe45200-8050-42be-9b33-b226047bcfde {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:24:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0add6d15-4e90-4b2b-b679-10d94241d450 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:24:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0add6d15-4e90-4b2b-b679-10d94241d450 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:24:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0add6d15-4e90-4b2b-b679-10d94241d450 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:24:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0add6d15-4e90-4b2b-b679-10d94241d450 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:24:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0add6d15-4e90-4b2b-b679-10d94241d450 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:24:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0add6d15-4e90-4b2b-b679-10d94241d450 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:24:38 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-0add6d15-4e90-4b2b-b679-10d94241d450 tempest-CreateVolumesFromSnapshotTest-2127375374 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:24:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0add6d15-4e90-4b2b-b679-10d94241d450 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:38 devstack sudo[103756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde 1073741824
Nov 05 19:24:38 devstack sudo[103756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:38 devstack sudo[103756]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0add6d15-4e90-4b2b-b679-10d94241d450 tempest-CreateVolumesFromSnapshotTest-2127375374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde 1073741824" returned: 0 in 0.399s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0add6d15-4e90-4b2b-b679-10d94241d450 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:38 devstack sudo[103762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde
Nov 05 19:24:38 devstack sudo[103762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:38 devstack sudo[103762]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0add6d15-4e90-4b2b-b679-10d94241d450 tempest-CreateVolumesFromSnapshotTest-2127375374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde" returned: 0 in 0.241s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0add6d15-4e90-4b2b-b679-10d94241d450 tempest-CreateVolumesFromSnapshotTest-2127375374 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:24:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0add6d15-4e90-4b2b-b679-10d94241d450 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:24:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0add6d15-4e90-4b2b-b679-10d94241d450 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a6faf91-37a4-4432-9ab0-5aa9f2048bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbe45200-8050-42be-9b33-b226047bcfde', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:24:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0add6d15-4e90-4b2b-b679-10d94241d450 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df97e680-9bea-4b62-af06-faf96ddd4457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:24:38 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-0add6d15-4e90-4b2b-b679-10d94241d450 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Volume volume-fbe45200-8050-42be-9b33-b226047bcfde (fbe45200-8050-42be-9b33-b226047bcfde): created successfully
Nov 05 19:24:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0add6d15-4e90-4b2b-b679-10d94241d450 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df97e680-9bea-4b62-af06-faf96ddd4457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:24:38 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-0add6d15-4e90-4b2b-b679-10d94241d450 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Flow 'volume_create_manager' (904536b4-7e03-48ff-9702-2eaa212e9077) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:24:38 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-0add6d15-4e90-4b2b-b679-10d94241d450 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Created volume successfully.
Nov 05 19:24:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4b3d46f7-5ae5-4b1e-95bb-4836e9deaf01 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:24:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4b3d46f7-5ae5-4b1e-95bb-4836e9deaf01 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:24:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-4b3d46f7-5ae5-4b1e-95bb-4836e9deaf01 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Creating offline snapshot e73e3c8e-489e-4e66-90d4-85394ded5784 of volume fbe45200-8050-42be-9b33-b226047bcfde {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:24:39 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a749c232-602c-4709-9663-b548d41b4a87]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:24:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4b3d46f7-5ae5-4b1e-95bb-4836e9deaf01 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:39 devstack sudo[103771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde
Nov 05 19:24:39 devstack sudo[103771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:39 devstack sudo[103771]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4b3d46f7-5ae5-4b1e-95bb-4836e9deaf01 tempest-CreateVolumesFromSnapshotTest-2127375374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde" returned: 0 in 0.361s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4b3d46f7-5ae5-4b1e-95bb-4836e9deaf01 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde.e73e3c8e-489e-4e66-90d4-85394ded5784 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:39 devstack sudo[103776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde.e73e3c8e-489e-4e66-90d4-85394ded5784 1G
Nov 05 19:24:39 devstack sudo[103776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:40 devstack sudo[103776]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4b3d46f7-5ae5-4b1e-95bb-4836e9deaf01 tempest-CreateVolumesFromSnapshotTest-2127375374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde.e73e3c8e-489e-4e66-90d4-85394ded5784 1G" returned: 0 in 0.373s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4b3d46f7-5ae5-4b1e-95bb-4836e9deaf01 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbe45200-8050-42be-9b33-b226047bcfde -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde.e73e3c8e-489e-4e66-90d4-85394ded5784 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:40 devstack sudo[103781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbe45200-8050-42be-9b33-b226047bcfde -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde.e73e3c8e-489e-4e66-90d4-85394ded5784
Nov 05 19:24:40 devstack sudo[103781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:40 devstack sudo[103781]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4b3d46f7-5ae5-4b1e-95bb-4836e9deaf01 tempest-CreateVolumesFromSnapshotTest-2127375374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbe45200-8050-42be-9b33-b226047bcfde -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde.e73e3c8e-489e-4e66-90d4-85394ded5784" returned: 0 in 0.283s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:40 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-4b3d46f7-5ae5-4b1e-95bb-4836e9deaf01 tempest-CreateVolumesFromSnapshotTest-2127375374 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde.e73e3c8e-489e-4e66-90d4-85394ded5784 is being set with open permissions: ugo+rw
Nov 05 19:24:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4b3d46f7-5ae5-4b1e-95bb-4836e9deaf01 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde.e73e3c8e-489e-4e66-90d4-85394ded5784 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:40 devstack sudo[103786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde.e73e3c8e-489e-4e66-90d4-85394ded5784
Nov 05 19:24:40 devstack sudo[103786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:40 devstack sudo[103786]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4b3d46f7-5ae5-4b1e-95bb-4836e9deaf01 tempest-CreateVolumesFromSnapshotTest-2127375374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde.e73e3c8e-489e-4e66-90d4-85394ded5784" returned: 0 in 0.241s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4b3d46f7-5ae5-4b1e-95bb-4836e9deaf01 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:40 devstack sudo[103789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde.info
Nov 05 19:24:40 devstack sudo[103789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:40 devstack sudo[103789]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4b3d46f7-5ae5-4b1e-95bb-4836e9deaf01 tempest-CreateVolumesFromSnapshotTest-2127375374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde.info" returned: 0 in 0.238s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:40 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-4b3d46f7-5ae5-4b1e-95bb-4836e9deaf01 tempest-CreateVolumesFromSnapshotTest-2127375374 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde.info is being set with open permissions: ugo+rw
Nov 05 19:24:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4b3d46f7-5ae5-4b1e-95bb-4836e9deaf01 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:40 devstack sudo[103792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde.info
Nov 05 19:24:40 devstack sudo[103792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:41 devstack sudo[103792]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4b3d46f7-5ae5-4b1e-95bb-4836e9deaf01 tempest-CreateVolumesFromSnapshotTest-2127375374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde.info" returned: 0 in 0.241s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4b3d46f7-5ae5-4b1e-95bb-4836e9deaf01 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.832s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:24:41 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-4b3d46f7-5ae5-4b1e-95bb-4836e9deaf01 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Create snapshot completed successfully
Nov 05 19:24:41 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d1c7649-6470-47ac-aa16-fe8225c8017d tempest-CreateVolumesFromSnapshotTest-2127375374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:24:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8d1c7649-6470-47ac-aa16-fe8225c8017d tempest-CreateVolumesFromSnapshotTest-2127375374 None] Flow 'volume_create_manager' (923a4b40-a307-4c6a-92f0-316351971392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:24:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8d1c7649-6470-47ac-aa16-fe8225c8017d tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab1d6ec7-a67d-49ce-98f1-063987ba354a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:24:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8d1c7649-6470-47ac-aa16-fe8225c8017d tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab1d6ec7-a67d-49ce-98f1-063987ba354a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1553958784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a78fbb72-b508-45bf-b8aa-21b904744869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e49fa75cffc4d97bddbdbb86af64f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:24:42Z,use_quota=True,user_id='4be10d0857254490a6d50b935fb738b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:24:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8d1c7649-6470-47ac-aa16-fe8225c8017d tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a109758e-8f3f-464f-80f4-5bbe9efd5b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:24:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8d1c7649-6470-47ac-aa16-fe8225c8017d tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a109758e-8f3f-464f-80f4-5bbe9efd5b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:24:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8d1c7649-6470-47ac-aa16-fe8225c8017d tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (994f0925-58f2-477a-b5ea-d6a20d443355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:24:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8d1c7649-6470-47ac-aa16-fe8225c8017d tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (994f0925-58f2-477a-b5ea-d6a20d443355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a78fbb72-b508-45bf-b8aa-21b904744869', 'volume_name': 'volume-a78fbb72-b508-45bf-b8aa-21b904744869', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:24:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8d1c7649-6470-47ac-aa16-fe8225c8017d tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcb827cf-73cb-4f42-92ba-f6ead42e1593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:24:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8d1c7649-6470-47ac-aa16-fe8225c8017d tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcb827cf-73cb-4f42-92ba-f6ead42e1593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:24:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8d1c7649-6470-47ac-aa16-fe8225c8017d tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02061d56-65ae-4048-b506-4fcf239bc8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:24:41 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-8d1c7649-6470-47ac-aa16-fe8225c8017d tempest-CreateVolumesFromSnapshotTest-2127375374 None] Volume a78fbb72-b508-45bf-b8aa-21b904744869: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a78fbb72-b508-45bf-b8aa-21b904744869', 'volume_size': 1}
Nov 05 19:24:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8d1c7649-6470-47ac-aa16-fe8225c8017d tempest-CreateVolumesFromSnapshotTest-2127375374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:24:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8d1c7649-6470-47ac-aa16-fe8225c8017d tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:24:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8d1c7649-6470-47ac-aa16-fe8225c8017d tempest-CreateVolumesFromSnapshotTest-2127375374 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1553958784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a78fbb72-b508-45bf-b8aa-21b904744869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e49fa75cffc4d97bddbdbb86af64f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:24:42Z,use_quota=True,user_id='4be10d0857254490a6d50b935fb738b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:24:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-8d1c7649-6470-47ac-aa16-fe8225c8017d tempest-CreateVolumesFromSnapshotTest-2127375374 None] Creating volume a78fbb72-b508-45bf-b8aa-21b904744869 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:24:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8d1c7649-6470-47ac-aa16-fe8225c8017d tempest-CreateVolumesFromSnapshotTest-2127375374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:24:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8d1c7649-6470-47ac-aa16-fe8225c8017d tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:24:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8d1c7649-6470-47ac-aa16-fe8225c8017d tempest-CreateVolumesFromSnapshotTest-2127375374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:24:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8d1c7649-6470-47ac-aa16-fe8225c8017d tempest-CreateVolumesFromSnapshotTest-2127375374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:24:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8d1c7649-6470-47ac-aa16-fe8225c8017d tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:24:41 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8d1c7649-6470-47ac-aa16-fe8225c8017d tempest-CreateVolumesFromSnapshotTest-2127375374 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:24:41 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-8d1c7649-6470-47ac-aa16-fe8225c8017d tempest-CreateVolumesFromSnapshotTest-2127375374 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:24:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8d1c7649-6470-47ac-aa16-fe8225c8017d tempest-CreateVolumesFromSnapshotTest-2127375374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a78fbb72-b508-45bf-b8aa-21b904744869 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:41 devstack sudo[103795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a78fbb72-b508-45bf-b8aa-21b904744869 1073741824
Nov 05 19:24:41 devstack sudo[103795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-986e4ad9-1dce-4e3b-85cc-f4d8990b8eb1 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-986e4ad9-1dce-4e3b-85cc-f4d8990b8eb1 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Flow 'volume_create_manager' (a1416e8b-d482-452e-8f75-a9b4435b1406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-986e4ad9-1dce-4e3b-85cc-f4d8990b8eb1 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (128fe753-8b57-476d-bfc8-94998766025d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-986e4ad9-1dce-4e3b-85cc-f4d8990b8eb1 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (128fe753-8b57-476d-bfc8-94998766025d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2061850121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a633a3c-4553-456e-bfe6-c58eb57cfe52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e49fa75cffc4d97bddbdbb86af64f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:24:42Z,use_quota=True,user_id='4be10d0857254490a6d50b935fb738b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-986e4ad9-1dce-4e3b-85cc-f4d8990b8eb1 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (256bddfa-a36a-4299-873e-f854dca4eef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-986e4ad9-1dce-4e3b-85cc-f4d8990b8eb1 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (256bddfa-a36a-4299-873e-f854dca4eef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-986e4ad9-1dce-4e3b-85cc-f4d8990b8eb1 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9acd7957-c20c-4066-aa26-266f28e5baea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-986e4ad9-1dce-4e3b-85cc-f4d8990b8eb1 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9acd7957-c20c-4066-aa26-266f28e5baea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a633a3c-4553-456e-bfe6-c58eb57cfe52', 'volume_name': 'volume-5a633a3c-4553-456e-bfe6-c58eb57cfe52', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-986e4ad9-1dce-4e3b-85cc-f4d8990b8eb1 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4b0d168-471d-4326-834d-d9e22cd34b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-986e4ad9-1dce-4e3b-85cc-f4d8990b8eb1 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4b0d168-471d-4326-834d-d9e22cd34b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-986e4ad9-1dce-4e3b-85cc-f4d8990b8eb1 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6ae22d3-b363-420d-bf06-dbed6716f17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:24:42 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-986e4ad9-1dce-4e3b-85cc-f4d8990b8eb1 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Volume 5a633a3c-4553-456e-bfe6-c58eb57cfe52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a633a3c-4553-456e-bfe6-c58eb57cfe52', 'volume_size': 1}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-986e4ad9-1dce-4e3b-85cc-f4d8990b8eb1 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:24:42 devstack sudo[103795]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8d1c7649-6470-47ac-aa16-fe8225c8017d tempest-CreateVolumesFromSnapshotTest-2127375374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a78fbb72-b508-45bf-b8aa-21b904744869 1073741824" returned: 0 in 0.498s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8d1c7649-6470-47ac-aa16-fe8225c8017d tempest-CreateVolumesFromSnapshotTest-2127375374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a78fbb72-b508-45bf-b8aa-21b904744869 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:42 devstack sudo[103801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a78fbb72-b508-45bf-b8aa-21b904744869
Nov 05 19:24:42 devstack sudo[103801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8c160e3-264b-4a12-844f-3df49f0f144c tempest-CreateVolumesFromSnapshotTest-2127375374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b8c160e3-264b-4a12-844f-3df49f0f144c tempest-CreateVolumesFromSnapshotTest-2127375374 None] Flow 'volume_create_manager' (6637a2bd-0fbb-4df8-bde1-1bf13dbd6622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b8c160e3-264b-4a12-844f-3df49f0f144c tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ab01df-5aa0-48e9-853d-75e01f68ae13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b8c160e3-264b-4a12-844f-3df49f0f144c tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ab01df-5aa0-48e9-853d-75e01f68ae13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-629298758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07cf098c-aef3-4fff-96d9-a14d146bce4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e49fa75cffc4d97bddbdbb86af64f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:24:42Z,use_quota=True,user_id='4be10d0857254490a6d50b935fb738b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b8c160e3-264b-4a12-844f-3df49f0f144c tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b01b676-e044-43b7-9dff-b83447598142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b8c160e3-264b-4a12-844f-3df49f0f144c tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b01b676-e044-43b7-9dff-b83447598142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b8c160e3-264b-4a12-844f-3df49f0f144c tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d2d2248-878b-4e14-9e5a-c0db7bbeed3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b8c160e3-264b-4a12-844f-3df49f0f144c tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d2d2248-878b-4e14-9e5a-c0db7bbeed3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07cf098c-aef3-4fff-96d9-a14d146bce4d', 'volume_name': 'volume-07cf098c-aef3-4fff-96d9-a14d146bce4d', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b8c160e3-264b-4a12-844f-3df49f0f144c tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cc8a921-cb48-4416-8ab9-391e79299b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b8c160e3-264b-4a12-844f-3df49f0f144c tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cc8a921-cb48-4416-8ab9-391e79299b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b8c160e3-264b-4a12-844f-3df49f0f144c tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78681f52-c353-417e-b755-f26f3f2fcc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:24:42 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-b8c160e3-264b-4a12-844f-3df49f0f144c tempest-CreateVolumesFromSnapshotTest-2127375374 None] Volume 07cf098c-aef3-4fff-96d9-a14d146bce4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07cf098c-aef3-4fff-96d9-a14d146bce4d', 'volume_size': 1}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b8c160e3-264b-4a12-844f-3df49f0f144c tempest-CreateVolumesFromSnapshotTest-2127375374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:24:42 devstack sudo[103801]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8d1c7649-6470-47ac-aa16-fe8225c8017d tempest-CreateVolumesFromSnapshotTest-2127375374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a78fbb72-b508-45bf-b8aa-21b904744869" returned: 0 in 0.283s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8d1c7649-6470-47ac-aa16-fe8225c8017d tempest-CreateVolumesFromSnapshotTest-2127375374 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8d1c7649-6470-47ac-aa16-fe8225c8017d tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-986e4ad9-1dce-4e3b-85cc-f4d8990b8eb1 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.446s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-986e4ad9-1dce-4e3b-85cc-f4d8990b8eb1 tempest-CreateVolumesFromSnapshotTest-2127375374 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2061850121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a633a3c-4553-456e-bfe6-c58eb57cfe52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e49fa75cffc4d97bddbdbb86af64f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:24:42Z,use_quota=True,user_id='4be10d0857254490a6d50b935fb738b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-986e4ad9-1dce-4e3b-85cc-f4d8990b8eb1 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Creating volume 5a633a3c-4553-456e-bfe6-c58eb57cfe52 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-986e4ad9-1dce-4e3b-85cc-f4d8990b8eb1 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-986e4ad9-1dce-4e3b-85cc-f4d8990b8eb1 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-986e4ad9-1dce-4e3b-85cc-f4d8990b8eb1 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-986e4ad9-1dce-4e3b-85cc-f4d8990b8eb1 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-986e4ad9-1dce-4e3b-85cc-f4d8990b8eb1 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-986e4ad9-1dce-4e3b-85cc-f4d8990b8eb1 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:24:42 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-986e4ad9-1dce-4e3b-85cc-f4d8990b8eb1 tempest-CreateVolumesFromSnapshotTest-2127375374 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-986e4ad9-1dce-4e3b-85cc-f4d8990b8eb1 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5a633a3c-4553-456e-bfe6-c58eb57cfe52 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:42 devstack sudo[103804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5a633a3c-4553-456e-bfe6-c58eb57cfe52 1073741824
Nov 05 19:24:42 devstack sudo[103804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8d1c7649-6470-47ac-aa16-fe8225c8017d tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02061d56-65ae-4048-b506-4fcf239bc8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a78fbb72-b508-45bf-b8aa-21b904744869', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8d1c7649-6470-47ac-aa16-fe8225c8017d tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a613fbe8-3c62-46a8-9e1e-e58da2b191d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:24:42 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-8d1c7649-6470-47ac-aa16-fe8225c8017d tempest-CreateVolumesFromSnapshotTest-2127375374 None] Volume volume-a78fbb72-b508-45bf-b8aa-21b904744869 (a78fbb72-b508-45bf-b8aa-21b904744869): created successfully
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8d1c7649-6470-47ac-aa16-fe8225c8017d tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a613fbe8-3c62-46a8-9e1e-e58da2b191d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-8d1c7649-6470-47ac-aa16-fe8225c8017d tempest-CreateVolumesFromSnapshotTest-2127375374 None] Flow 'volume_create_manager' (923a4b40-a307-4c6a-92f0-316351971392) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:24:42 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-8d1c7649-6470-47ac-aa16-fe8225c8017d tempest-CreateVolumesFromSnapshotTest-2127375374 None] Created volume successfully.
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1ba06a5-cc8a-44ce-8b5f-ad13a9121850 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e1ba06a5-cc8a-44ce-8b5f-ad13a9121850 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Flow 'volume_create_manager' (343dd381-d12b-4b57-8356-761ddd6ffa49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e1ba06a5-cc8a-44ce-8b5f-ad13a9121850 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17c06508-6a0e-40cc-8334-19e90f4da87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e1ba06a5-cc8a-44ce-8b5f-ad13a9121850 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17c06508-6a0e-40cc-8334-19e90f4da87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1776605176',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3053ef6f-31d7-4535-b3a9-8598d76a2380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e49fa75cffc4d97bddbdbb86af64f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:24:43Z,use_quota=True,user_id='4be10d0857254490a6d50b935fb738b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e1ba06a5-cc8a-44ce-8b5f-ad13a9121850 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a502424-da85-4971-9446-5805216b223c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e1ba06a5-cc8a-44ce-8b5f-ad13a9121850 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a502424-da85-4971-9446-5805216b223c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e1ba06a5-cc8a-44ce-8b5f-ad13a9121850 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9051353c-d394-4f32-8343-2e72f025e6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e1ba06a5-cc8a-44ce-8b5f-ad13a9121850 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9051353c-d394-4f32-8343-2e72f025e6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3053ef6f-31d7-4535-b3a9-8598d76a2380', 'volume_name': 'volume-3053ef6f-31d7-4535-b3a9-8598d76a2380', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e1ba06a5-cc8a-44ce-8b5f-ad13a9121850 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (276b6abc-7e5b-4290-90ac-67df7866dd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:24:42 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e1ba06a5-cc8a-44ce-8b5f-ad13a9121850 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (276b6abc-7e5b-4290-90ac-67df7866dd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:24:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e1ba06a5-cc8a-44ce-8b5f-ad13a9121850 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e118c4-c3cb-48c6-82a5-41920847c641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:24:43 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-e1ba06a5-cc8a-44ce-8b5f-ad13a9121850 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Volume 3053ef6f-31d7-4535-b3a9-8598d76a2380: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3053ef6f-31d7-4535-b3a9-8598d76a2380', 'volume_size': 1}
Nov 05 19:24:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e1ba06a5-cc8a-44ce-8b5f-ad13a9121850 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:24:43 devstack sudo[103804]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-986e4ad9-1dce-4e3b-85cc-f4d8990b8eb1 tempest-CreateVolumesFromSnapshotTest-2127375374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5a633a3c-4553-456e-bfe6-c58eb57cfe52 1073741824" returned: 0 in 0.550s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-986e4ad9-1dce-4e3b-85cc-f4d8990b8eb1 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5a633a3c-4553-456e-bfe6-c58eb57cfe52 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:43 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-73748702-d25c-4147-82c3-93f663c7dc9f tempest-CreateVolumesFromSnapshotTest-2127375374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:24:43 devstack sudo[103810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5a633a3c-4553-456e-bfe6-c58eb57cfe52
Nov 05 19:24:43 devstack sudo[103810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-73748702-d25c-4147-82c3-93f663c7dc9f tempest-CreateVolumesFromSnapshotTest-2127375374 None] Flow 'volume_create_manager' (1305737b-1c13-4745-b948-c19c3fb985a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:24:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-73748702-d25c-4147-82c3-93f663c7dc9f tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a5f136a-1f80-4f1f-bc52-849fa946a67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:24:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-73748702-d25c-4147-82c3-93f663c7dc9f tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a5f136a-1f80-4f1f-bc52-849fa946a67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-795271171',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be4613bd-940c-4d54-96e6-af9d0c6a6870,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e49fa75cffc4d97bddbdbb86af64f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:24:43Z,use_quota=True,user_id='4be10d0857254490a6d50b935fb738b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:24:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-73748702-d25c-4147-82c3-93f663c7dc9f tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23c6328e-02a1-44f3-a7b6-b2495ecde9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:24:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-73748702-d25c-4147-82c3-93f663c7dc9f tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23c6328e-02a1-44f3-a7b6-b2495ecde9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:24:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-73748702-d25c-4147-82c3-93f663c7dc9f tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3303b66-7259-4b84-be3e-30b87f953747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:24:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-73748702-d25c-4147-82c3-93f663c7dc9f tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3303b66-7259-4b84-be3e-30b87f953747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be4613bd-940c-4d54-96e6-af9d0c6a6870', 'volume_name': 'volume-be4613bd-940c-4d54-96e6-af9d0c6a6870', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:24:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-73748702-d25c-4147-82c3-93f663c7dc9f tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f9b988-a4dc-4280-ab30-baefa8696b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:24:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-73748702-d25c-4147-82c3-93f663c7dc9f tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f9b988-a4dc-4280-ab30-baefa8696b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:24:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-73748702-d25c-4147-82c3-93f663c7dc9f tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cc927a8-6379-4272-afc9-05d2b18a875e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:24:43 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-73748702-d25c-4147-82c3-93f663c7dc9f tempest-CreateVolumesFromSnapshotTest-2127375374 None] Volume be4613bd-940c-4d54-96e6-af9d0c6a6870: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be4613bd-940c-4d54-96e6-af9d0c6a6870', 'volume_size': 1}
Nov 05 19:24:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-73748702-d25c-4147-82c3-93f663c7dc9f tempest-CreateVolumesFromSnapshotTest-2127375374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:24:43 devstack sudo[103810]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-986e4ad9-1dce-4e3b-85cc-f4d8990b8eb1 tempest-CreateVolumesFromSnapshotTest-2127375374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5a633a3c-4553-456e-bfe6-c58eb57cfe52" returned: 0 in 0.259s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-986e4ad9-1dce-4e3b-85cc-f4d8990b8eb1 tempest-CreateVolumesFromSnapshotTest-2127375374 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:24:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-986e4ad9-1dce-4e3b-85cc-f4d8990b8eb1 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:24:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b8c160e3-264b-4a12-844f-3df49f0f144c tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.970s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:24:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b8c160e3-264b-4a12-844f-3df49f0f144c tempest-CreateVolumesFromSnapshotTest-2127375374 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-629298758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07cf098c-aef3-4fff-96d9-a14d146bce4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e49fa75cffc4d97bddbdbb86af64f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:24:42Z,use_quota=True,user_id='4be10d0857254490a6d50b935fb738b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:24:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-b8c160e3-264b-4a12-844f-3df49f0f144c tempest-CreateVolumesFromSnapshotTest-2127375374 None] Creating volume 07cf098c-aef3-4fff-96d9-a14d146bce4d {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:24:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b8c160e3-264b-4a12-844f-3df49f0f144c tempest-CreateVolumesFromSnapshotTest-2127375374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:24:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b8c160e3-264b-4a12-844f-3df49f0f144c tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:24:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b8c160e3-264b-4a12-844f-3df49f0f144c tempest-CreateVolumesFromSnapshotTest-2127375374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:24:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b8c160e3-264b-4a12-844f-3df49f0f144c tempest-CreateVolumesFromSnapshotTest-2127375374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:24:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b8c160e3-264b-4a12-844f-3df49f0f144c tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:24:43 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b8c160e3-264b-4a12-844f-3df49f0f144c tempest-CreateVolumesFromSnapshotTest-2127375374 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:24:43 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-b8c160e3-264b-4a12-844f-3df49f0f144c tempest-CreateVolumesFromSnapshotTest-2127375374 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:24:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b8c160e3-264b-4a12-844f-3df49f0f144c tempest-CreateVolumesFromSnapshotTest-2127375374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-07cf098c-aef3-4fff-96d9-a14d146bce4d 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:43 devstack sudo[103813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-07cf098c-aef3-4fff-96d9-a14d146bce4d 1073741824
Nov 05 19:24:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-986e4ad9-1dce-4e3b-85cc-f4d8990b8eb1 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6ae22d3-b363-420d-bf06-dbed6716f17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a633a3c-4553-456e-bfe6-c58eb57cfe52', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:24:43 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-986e4ad9-1dce-4e3b-85cc-f4d8990b8eb1 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d09b547-f549-4b02-badb-58d9f49b739c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:24:43 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-986e4ad9-1dce-4e3b-85cc-f4d8990b8eb1 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Volume volume-5a633a3c-4553-456e-bfe6-c58eb57cfe52 (5a633a3c-4553-456e-bfe6-c58eb57cfe52): created successfully
Nov 05 19:24:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-986e4ad9-1dce-4e3b-85cc-f4d8990b8eb1 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d09b547-f549-4b02-badb-58d9f49b739c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:24:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-986e4ad9-1dce-4e3b-85cc-f4d8990b8eb1 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Flow 'volume_create_manager' (a1416e8b-d482-452e-8f75-a9b4435b1406) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:24:43 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-986e4ad9-1dce-4e3b-85cc-f4d8990b8eb1 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Created volume successfully.
Nov 05 19:24:43 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b8c160e3-264b-4a12-844f-3df49f0f144c tempest-CreateVolumesFromSnapshotTest-2127375374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-07cf098c-aef3-4fff-96d9-a14d146bce4d 1073741824" returned: 0 in 0.396s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b8c160e3-264b-4a12-844f-3df49f0f144c tempest-CreateVolumesFromSnapshotTest-2127375374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-07cf098c-aef3-4fff-96d9-a14d146bce4d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:44 devstack sudo[103819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-07cf098c-aef3-4fff-96d9-a14d146bce4d
Nov 05 19:24:44 devstack sudo[103819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:44 devstack sudo[103819]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b8c160e3-264b-4a12-844f-3df49f0f144c tempest-CreateVolumesFromSnapshotTest-2127375374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-07cf098c-aef3-4fff-96d9-a14d146bce4d" returned: 0 in 0.244s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b8c160e3-264b-4a12-844f-3df49f0f144c tempest-CreateVolumesFromSnapshotTest-2127375374 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:24:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b8c160e3-264b-4a12-844f-3df49f0f144c tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:24:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e1ba06a5-cc8a-44ce-8b5f-ad13a9121850 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.270s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:24:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e1ba06a5-cc8a-44ce-8b5f-ad13a9121850 tempest-CreateVolumesFromSnapshotTest-2127375374 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1776605176',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3053ef6f-31d7-4535-b3a9-8598d76a2380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e49fa75cffc4d97bddbdbb86af64f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:24:43Z,use_quota=True,user_id='4be10d0857254490a6d50b935fb738b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:24:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-e1ba06a5-cc8a-44ce-8b5f-ad13a9121850 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Creating volume 3053ef6f-31d7-4535-b3a9-8598d76a2380 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:24:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e1ba06a5-cc8a-44ce-8b5f-ad13a9121850 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:24:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e1ba06a5-cc8a-44ce-8b5f-ad13a9121850 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:24:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e1ba06a5-cc8a-44ce-8b5f-ad13a9121850 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:24:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e1ba06a5-cc8a-44ce-8b5f-ad13a9121850 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:24:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e1ba06a5-cc8a-44ce-8b5f-ad13a9121850 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:24:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e1ba06a5-cc8a-44ce-8b5f-ad13a9121850 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:24:44 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-e1ba06a5-cc8a-44ce-8b5f-ad13a9121850 tempest-CreateVolumesFromSnapshotTest-2127375374 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:24:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e1ba06a5-cc8a-44ce-8b5f-ad13a9121850 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3053ef6f-31d7-4535-b3a9-8598d76a2380 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b8c160e3-264b-4a12-844f-3df49f0f144c tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78681f52-c353-417e-b755-f26f3f2fcc2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07cf098c-aef3-4fff-96d9-a14d146bce4d', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:24:44 devstack sudo[103822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3053ef6f-31d7-4535-b3a9-8598d76a2380 1073741824
Nov 05 19:24:44 devstack sudo[103822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b8c160e3-264b-4a12-844f-3df49f0f144c tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (024aa334-012e-4481-9785-551b19fed119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:24:44 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-b8c160e3-264b-4a12-844f-3df49f0f144c tempest-CreateVolumesFromSnapshotTest-2127375374 None] Volume volume-07cf098c-aef3-4fff-96d9-a14d146bce4d (07cf098c-aef3-4fff-96d9-a14d146bce4d): created successfully
Nov 05 19:24:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b8c160e3-264b-4a12-844f-3df49f0f144c tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (024aa334-012e-4481-9785-551b19fed119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:24:44 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b8c160e3-264b-4a12-844f-3df49f0f144c tempest-CreateVolumesFromSnapshotTest-2127375374 None] Flow 'volume_create_manager' (6637a2bd-0fbb-4df8-bde1-1bf13dbd6622) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:24:44 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b8c160e3-264b-4a12-844f-3df49f0f144c tempest-CreateVolumesFromSnapshotTest-2127375374 None] Created volume successfully.
Nov 05 19:24:44 devstack sudo[103822]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e1ba06a5-cc8a-44ce-8b5f-ad13a9121850 tempest-CreateVolumesFromSnapshotTest-2127375374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3053ef6f-31d7-4535-b3a9-8598d76a2380 1073741824" returned: 0 in 0.436s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e1ba06a5-cc8a-44ce-8b5f-ad13a9121850 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3053ef6f-31d7-4535-b3a9-8598d76a2380 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:44 devstack sudo[103827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3053ef6f-31d7-4535-b3a9-8598d76a2380
Nov 05 19:24:44 devstack sudo[103827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:44 devstack sudo[103827]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e1ba06a5-cc8a-44ce-8b5f-ad13a9121850 tempest-CreateVolumesFromSnapshotTest-2127375374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3053ef6f-31d7-4535-b3a9-8598d76a2380" returned: 0 in 0.237s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e1ba06a5-cc8a-44ce-8b5f-ad13a9121850 tempest-CreateVolumesFromSnapshotTest-2127375374 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:24:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e1ba06a5-cc8a-44ce-8b5f-ad13a9121850 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:24:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-73748702-d25c-4147-82c3-93f663c7dc9f tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.547s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:24:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-73748702-d25c-4147-82c3-93f663c7dc9f tempest-CreateVolumesFromSnapshotTest-2127375374 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-795271171',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be4613bd-940c-4d54-96e6-af9d0c6a6870,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e49fa75cffc4d97bddbdbb86af64f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:24:43Z,use_quota=True,user_id='4be10d0857254490a6d50b935fb738b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:24:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-73748702-d25c-4147-82c3-93f663c7dc9f tempest-CreateVolumesFromSnapshotTest-2127375374 None] Creating volume be4613bd-940c-4d54-96e6-af9d0c6a6870 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:24:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-73748702-d25c-4147-82c3-93f663c7dc9f tempest-CreateVolumesFromSnapshotTest-2127375374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:24:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-73748702-d25c-4147-82c3-93f663c7dc9f tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:24:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-73748702-d25c-4147-82c3-93f663c7dc9f tempest-CreateVolumesFromSnapshotTest-2127375374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:24:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-73748702-d25c-4147-82c3-93f663c7dc9f tempest-CreateVolumesFromSnapshotTest-2127375374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:24:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-73748702-d25c-4147-82c3-93f663c7dc9f tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:24:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-73748702-d25c-4147-82c3-93f663c7dc9f tempest-CreateVolumesFromSnapshotTest-2127375374 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:24:44 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-73748702-d25c-4147-82c3-93f663c7dc9f tempest-CreateVolumesFromSnapshotTest-2127375374 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:24:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-73748702-d25c-4147-82c3-93f663c7dc9f tempest-CreateVolumesFromSnapshotTest-2127375374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-be4613bd-940c-4d54-96e6-af9d0c6a6870 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e1ba06a5-cc8a-44ce-8b5f-ad13a9121850 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e118c4-c3cb-48c6-82a5-41920847c641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3053ef6f-31d7-4535-b3a9-8598d76a2380', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:24:45 devstack sudo[103830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-be4613bd-940c-4d54-96e6-af9d0c6a6870 1073741824
Nov 05 19:24:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e1ba06a5-cc8a-44ce-8b5f-ad13a9121850 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44905fa2-eba6-45e2-8aef-0d9fffd5812d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:24:45 devstack sudo[103830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:45 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-e1ba06a5-cc8a-44ce-8b5f-ad13a9121850 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Volume volume-3053ef6f-31d7-4535-b3a9-8598d76a2380 (3053ef6f-31d7-4535-b3a9-8598d76a2380): created successfully
Nov 05 19:24:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e1ba06a5-cc8a-44ce-8b5f-ad13a9121850 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44905fa2-eba6-45e2-8aef-0d9fffd5812d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:24:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e1ba06a5-cc8a-44ce-8b5f-ad13a9121850 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Flow 'volume_create_manager' (343dd381-d12b-4b57-8356-761ddd6ffa49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:24:45 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-e1ba06a5-cc8a-44ce-8b5f-ad13a9121850 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Created volume successfully.
Nov 05 19:24:45 devstack sudo[103830]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-73748702-d25c-4147-82c3-93f663c7dc9f tempest-CreateVolumesFromSnapshotTest-2127375374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-be4613bd-940c-4d54-96e6-af9d0c6a6870 1073741824" returned: 0 in 0.408s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-73748702-d25c-4147-82c3-93f663c7dc9f tempest-CreateVolumesFromSnapshotTest-2127375374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-be4613bd-940c-4d54-96e6-af9d0c6a6870 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:45 devstack sudo[103835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-be4613bd-940c-4d54-96e6-af9d0c6a6870
Nov 05 19:24:45 devstack sudo[103835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:45 devstack sudo[103835]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-73748702-d25c-4147-82c3-93f663c7dc9f tempest-CreateVolumesFromSnapshotTest-2127375374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-be4613bd-940c-4d54-96e6-af9d0c6a6870" returned: 0 in 0.253s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-73748702-d25c-4147-82c3-93f663c7dc9f tempest-CreateVolumesFromSnapshotTest-2127375374 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:24:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-73748702-d25c-4147-82c3-93f663c7dc9f tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:24:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-73748702-d25c-4147-82c3-93f663c7dc9f tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cc927a8-6379-4272-afc9-05d2b18a875e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be4613bd-940c-4d54-96e6-af9d0c6a6870', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:24:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-73748702-d25c-4147-82c3-93f663c7dc9f tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1932ad73-d3a5-4788-b381-ca91f2047ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:24:45 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-73748702-d25c-4147-82c3-93f663c7dc9f tempest-CreateVolumesFromSnapshotTest-2127375374 None] Volume volume-be4613bd-940c-4d54-96e6-af9d0c6a6870 (be4613bd-940c-4d54-96e6-af9d0c6a6870): created successfully
Nov 05 19:24:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-73748702-d25c-4147-82c3-93f663c7dc9f tempest-CreateVolumesFromSnapshotTest-2127375374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1932ad73-d3a5-4788-b381-ca91f2047ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:24:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-73748702-d25c-4147-82c3-93f663c7dc9f tempest-CreateVolumesFromSnapshotTest-2127375374 None] Flow 'volume_create_manager' (1305737b-1c13-4745-b948-c19c3fb985a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:24:45 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-73748702-d25c-4147-82c3-93f663c7dc9f tempest-CreateVolumesFromSnapshotTest-2127375374 None] Created volume successfully.
Nov 05 19:24:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a2c80c12-0951-4393-a079-ae45367b9e0b tempest-CreateVolumesFromSnapshotTest-2127375374 None] Acquiring lock "cinder-be4613bd-940c-4d54-96e6-af9d0c6a6870-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:24:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a2c80c12-0951-4393-a079-ae45367b9e0b tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "cinder-be4613bd-940c-4d54-96e6-af9d0c6a6870-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:24:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a2c80c12-0951-4393-a079-ae45367b9e0b tempest-CreateVolumesFromSnapshotTest-2127375374 None] Acquiring lock "cinder-quobyte-be4613bd-940c-4d54-96e6-af9d0c6a6870" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:24:46 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a2c80c12-0951-4393-a079-ae45367b9e0b tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "cinder-quobyte-be4613bd-940c-4d54-96e6-af9d0c6a6870" acquired by "delete_volume" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:24:46 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7616e679-9249-4432-a4f1-249e499e0889]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:24:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a2c80c12-0951-4393-a079-ae45367b9e0b tempest-CreateVolumesFromSnapshotTest-2127375374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-be4613bd-940c-4d54-96e6-af9d0c6a6870 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:46 devstack sudo[103840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-be4613bd-940c-4d54-96e6-af9d0c6a6870
Nov 05 19:24:46 devstack sudo[103840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:46 devstack sudo[103840]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a2c80c12-0951-4393-a079-ae45367b9e0b tempest-CreateVolumesFromSnapshotTest-2127375374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-be4613bd-940c-4d54-96e6-af9d0c6a6870" returned: 0 in 0.358s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a2c80c12-0951-4393-a079-ae45367b9e0b tempest-CreateVolumesFromSnapshotTest-2127375374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-be4613bd-940c-4d54-96e6-af9d0c6a6870 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:46 devstack sudo[103846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-be4613bd-940c-4d54-96e6-af9d0c6a6870
Nov 05 19:24:46 devstack sudo[103846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:46 devstack sudo[103846]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a2c80c12-0951-4393-a079-ae45367b9e0b tempest-CreateVolumesFromSnapshotTest-2127375374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-be4613bd-940c-4d54-96e6-af9d0c6a6870" returned: 0 in 0.246s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:46 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a2c80c12-0951-4393-a079-ae45367b9e0b tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "cinder-quobyte-be4613bd-940c-4d54-96e6-af9d0c6a6870" released by "delete_volume" :: held 0.642s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:24:46 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-a2c80c12-0951-4393-a079-ae45367b9e0b tempest-CreateVolumesFromSnapshotTest-2127375374 None] Created reservations ['e7228b5f-b3fb-40a6-834f-27b2d2929bc0', '7a666954-41dd-45a9-89a9-31fdb5eedec7', '0394c488-dcb3-4350-bba7-0c30f7581812', '5b42e684-f128-49f7-9928-0d3e194a044f'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:24:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a2c80c12-0951-4393-a079-ae45367b9e0b tempest-CreateVolumesFromSnapshotTest-2127375374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:24:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a2c80c12-0951-4393-a079-ae45367b9e0b tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:24:46 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a2c80c12-0951-4393-a079-ae45367b9e0b tempest-CreateVolumesFromSnapshotTest-2127375374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:24:46 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a2c80c12-0951-4393-a079-ae45367b9e0b tempest-CreateVolumesFromSnapshotTest-2127375374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:24:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a2c80c12-0951-4393-a079-ae45367b9e0b tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:24:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a2c80c12-0951-4393-a079-ae45367b9e0b tempest-CreateVolumesFromSnapshotTest-2127375374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:46 devstack sudo[103849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:24:46 devstack sudo[103849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:46 devstack sudo[103849]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a2c80c12-0951-4393-a079-ae45367b9e0b tempest-CreateVolumesFromSnapshotTest-2127375374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.237s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:46 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-a2c80c12-0951-4393-a079-ae45367b9e0b tempest-CreateVolumesFromSnapshotTest-2127375374 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:24:46 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-a2c80c12-0951-4393-a079-ae45367b9e0b tempest-CreateVolumesFromSnapshotTest-2127375374 None] Deleted volume successfully.
Nov 05 19:24:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a2c80c12-0951-4393-a079-ae45367b9e0b tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "cinder-be4613bd-940c-4d54-96e6-af9d0c6a6870-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:24:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5ce349dd-1634-40cd-a313-67eb908c0528 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Acquiring lock "cinder-3053ef6f-31d7-4535-b3a9-8598d76a2380-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:24:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5ce349dd-1634-40cd-a313-67eb908c0528 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "cinder-3053ef6f-31d7-4535-b3a9-8598d76a2380-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:24:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5ce349dd-1634-40cd-a313-67eb908c0528 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Acquiring lock "cinder-quobyte-3053ef6f-31d7-4535-b3a9-8598d76a2380" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:24:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5ce349dd-1634-40cd-a313-67eb908c0528 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "cinder-quobyte-3053ef6f-31d7-4535-b3a9-8598d76a2380" acquired by "delete_volume" :: waited 0.014s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:24:47 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[651f7b86-48f2-4de9-a140-84ba58aca880]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:24:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5ce349dd-1634-40cd-a313-67eb908c0528 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3053ef6f-31d7-4535-b3a9-8598d76a2380 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:47 devstack sudo[103852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3053ef6f-31d7-4535-b3a9-8598d76a2380
Nov 05 19:24:47 devstack sudo[103852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:47 devstack sudo[103852]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5ce349dd-1634-40cd-a313-67eb908c0528 tempest-CreateVolumesFromSnapshotTest-2127375374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3053ef6f-31d7-4535-b3a9-8598d76a2380" returned: 0 in 0.353s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5ce349dd-1634-40cd-a313-67eb908c0528 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3053ef6f-31d7-4535-b3a9-8598d76a2380 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:47 devstack sudo[103858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3053ef6f-31d7-4535-b3a9-8598d76a2380
Nov 05 19:24:47 devstack sudo[103858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:47 devstack sudo[103858]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5ce349dd-1634-40cd-a313-67eb908c0528 tempest-CreateVolumesFromSnapshotTest-2127375374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3053ef6f-31d7-4535-b3a9-8598d76a2380" returned: 0 in 0.236s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5ce349dd-1634-40cd-a313-67eb908c0528 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "cinder-quobyte-3053ef6f-31d7-4535-b3a9-8598d76a2380" released by "delete_volume" :: held 0.627s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:24:47 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-5ce349dd-1634-40cd-a313-67eb908c0528 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Created reservations ['158ca7f1-b14d-4228-9aa3-7d769cbf1a0a', '3d521acf-380d-4d29-a1ab-34b2b33daab1', 'fce0399c-30e0-4704-9b40-b0790510ed5a', 'da709341-51c6-4354-a8bd-062e76c04d78'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:24:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5ce349dd-1634-40cd-a313-67eb908c0528 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:24:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5ce349dd-1634-40cd-a313-67eb908c0528 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:24:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5ce349dd-1634-40cd-a313-67eb908c0528 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:24:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5ce349dd-1634-40cd-a313-67eb908c0528 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:24:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5ce349dd-1634-40cd-a313-67eb908c0528 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:24:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5ce349dd-1634-40cd-a313-67eb908c0528 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:47 devstack sudo[103861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:24:47 devstack sudo[103861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:48 devstack sudo[103861]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5ce349dd-1634-40cd-a313-67eb908c0528 tempest-CreateVolumesFromSnapshotTest-2127375374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.246s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:48 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-5ce349dd-1634-40cd-a313-67eb908c0528 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:24:48 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-5ce349dd-1634-40cd-a313-67eb908c0528 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Deleted volume successfully.
Nov 05 19:24:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5ce349dd-1634-40cd-a313-67eb908c0528 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "cinder-3053ef6f-31d7-4535-b3a9-8598d76a2380-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:24:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-50a9c84d-a09c-4636-9253-c9e5063d3d21 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Acquiring lock "cinder-07cf098c-aef3-4fff-96d9-a14d146bce4d-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:24:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-50a9c84d-a09c-4636-9253-c9e5063d3d21 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "cinder-07cf098c-aef3-4fff-96d9-a14d146bce4d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:24:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-50a9c84d-a09c-4636-9253-c9e5063d3d21 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Acquiring lock "cinder-quobyte-07cf098c-aef3-4fff-96d9-a14d146bce4d" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:24:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-50a9c84d-a09c-4636-9253-c9e5063d3d21 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "cinder-quobyte-07cf098c-aef3-4fff-96d9-a14d146bce4d" acquired by "delete_volume" :: waited 0.015s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:24:48 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fa0b9f-414a-4cf1-8cbb-97fe68129464]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:24:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-50a9c84d-a09c-4636-9253-c9e5063d3d21 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-07cf098c-aef3-4fff-96d9-a14d146bce4d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:48 devstack sudo[103864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-07cf098c-aef3-4fff-96d9-a14d146bce4d
Nov 05 19:24:48 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:48 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-50a9c84d-a09c-4636-9253-c9e5063d3d21 tempest-CreateVolumesFromSnapshotTest-2127375374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-07cf098c-aef3-4fff-96d9-a14d146bce4d" returned: 0 in 0.351s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-50a9c84d-a09c-4636-9253-c9e5063d3d21 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-07cf098c-aef3-4fff-96d9-a14d146bce4d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:48 devstack sudo[103869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-07cf098c-aef3-4fff-96d9-a14d146bce4d
Nov 05 19:24:48 devstack sudo[103869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:48 devstack sudo[103869]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-50a9c84d-a09c-4636-9253-c9e5063d3d21 tempest-CreateVolumesFromSnapshotTest-2127375374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-07cf098c-aef3-4fff-96d9-a14d146bce4d" returned: 0 in 0.246s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-50a9c84d-a09c-4636-9253-c9e5063d3d21 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "cinder-quobyte-07cf098c-aef3-4fff-96d9-a14d146bce4d" released by "delete_volume" :: held 0.637s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:24:48 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-50a9c84d-a09c-4636-9253-c9e5063d3d21 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Created reservations ['8d9713a9-d46a-4a1e-a64f-ba2249ecc43f', '9139e088-d900-41da-a3d1-dba9e8602d44', 'f19d0ffa-3e27-4e61-9ad7-be9cb8beee11', '5b88d4f5-c415-4cbb-805d-98fe24145f36'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:24:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-50a9c84d-a09c-4636-9253-c9e5063d3d21 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:24:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-50a9c84d-a09c-4636-9253-c9e5063d3d21 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:24:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-50a9c84d-a09c-4636-9253-c9e5063d3d21 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:24:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-50a9c84d-a09c-4636-9253-c9e5063d3d21 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:24:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-50a9c84d-a09c-4636-9253-c9e5063d3d21 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:24:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-50a9c84d-a09c-4636-9253-c9e5063d3d21 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:49 devstack sudo[103872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:24:49 devstack sudo[103872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:49 devstack sudo[103872]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-50a9c84d-a09c-4636-9253-c9e5063d3d21 tempest-CreateVolumesFromSnapshotTest-2127375374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.236s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:49 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-50a9c84d-a09c-4636-9253-c9e5063d3d21 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:24:49 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-50a9c84d-a09c-4636-9253-c9e5063d3d21 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Deleted volume successfully.
Nov 05 19:24:49 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-50a9c84d-a09c-4636-9253-c9e5063d3d21 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "cinder-07cf098c-aef3-4fff-96d9-a14d146bce4d-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:24:49 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-65fe4beb-a620-4713-b612-359d2524059b tempest-CreateVolumesFromSnapshotTest-2127375374 None] Acquiring lock "cinder-5a633a3c-4553-456e-bfe6-c58eb57cfe52-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:24:49 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-65fe4beb-a620-4713-b612-359d2524059b tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "cinder-5a633a3c-4553-456e-bfe6-c58eb57cfe52-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:24:49 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-65fe4beb-a620-4713-b612-359d2524059b tempest-CreateVolumesFromSnapshotTest-2127375374 None] Acquiring lock "cinder-quobyte-5a633a3c-4553-456e-bfe6-c58eb57cfe52" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:24:49 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-65fe4beb-a620-4713-b612-359d2524059b tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "cinder-quobyte-5a633a3c-4553-456e-bfe6-c58eb57cfe52" acquired by "delete_volume" :: waited 0.015s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:24:49 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[38bd9ab1-c7bd-469c-b9ba-f6acc5fae1fc]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:24:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-65fe4beb-a620-4713-b612-359d2524059b tempest-CreateVolumesFromSnapshotTest-2127375374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5a633a3c-4553-456e-bfe6-c58eb57cfe52 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:49 devstack sudo[103875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5a633a3c-4553-456e-bfe6-c58eb57cfe52
Nov 05 19:24:49 devstack sudo[103875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:49 devstack sudo[103875]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-65fe4beb-a620-4713-b612-359d2524059b tempest-CreateVolumesFromSnapshotTest-2127375374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5a633a3c-4553-456e-bfe6-c58eb57cfe52" returned: 0 in 0.352s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-65fe4beb-a620-4713-b612-359d2524059b tempest-CreateVolumesFromSnapshotTest-2127375374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5a633a3c-4553-456e-bfe6-c58eb57cfe52 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:49 devstack sudo[103880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5a633a3c-4553-456e-bfe6-c58eb57cfe52
Nov 05 19:24:49 devstack sudo[103880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:50 devstack sudo[103880]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-65fe4beb-a620-4713-b612-359d2524059b tempest-CreateVolumesFromSnapshotTest-2127375374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-5a633a3c-4553-456e-bfe6-c58eb57cfe52" returned: 0 in 0.245s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:50 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-65fe4beb-a620-4713-b612-359d2524059b tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "cinder-quobyte-5a633a3c-4553-456e-bfe6-c58eb57cfe52" released by "delete_volume" :: held 0.645s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:24:50 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-65fe4beb-a620-4713-b612-359d2524059b tempest-CreateVolumesFromSnapshotTest-2127375374 None] Created reservations ['49663f6d-3845-46e0-8c9d-2d1ecbe587fd', 'c620f733-895d-4b43-b860-6931e0c32587', '033769bd-01f6-4067-ae53-89aa293b1325', '583260c2-80d1-4f42-bc68-ea6d9f1638cd'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:24:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-65fe4beb-a620-4713-b612-359d2524059b tempest-CreateVolumesFromSnapshotTest-2127375374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:24:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-65fe4beb-a620-4713-b612-359d2524059b tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:24:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-65fe4beb-a620-4713-b612-359d2524059b tempest-CreateVolumesFromSnapshotTest-2127375374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:24:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-65fe4beb-a620-4713-b612-359d2524059b tempest-CreateVolumesFromSnapshotTest-2127375374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:24:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-65fe4beb-a620-4713-b612-359d2524059b tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:24:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-65fe4beb-a620-4713-b612-359d2524059b tempest-CreateVolumesFromSnapshotTest-2127375374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:50 devstack sudo[103883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:24:50 devstack sudo[103883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:50 devstack sudo[103883]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-65fe4beb-a620-4713-b612-359d2524059b tempest-CreateVolumesFromSnapshotTest-2127375374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.246s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:50 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-65fe4beb-a620-4713-b612-359d2524059b tempest-CreateVolumesFromSnapshotTest-2127375374 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:24:50 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-65fe4beb-a620-4713-b612-359d2524059b tempest-CreateVolumesFromSnapshotTest-2127375374 None] Deleted volume successfully.
Nov 05 19:24:50 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-65fe4beb-a620-4713-b612-359d2524059b tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "cinder-5a633a3c-4553-456e-bfe6-c58eb57cfe52-delete_volume" released by "delete_volume" :: held 1.131s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:24:50 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-56fce9c4-c482-46f9-9291-3356a168c3f0 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Acquiring lock "cinder-a78fbb72-b508-45bf-b8aa-21b904744869-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:24:50 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-56fce9c4-c482-46f9-9291-3356a168c3f0 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "cinder-a78fbb72-b508-45bf-b8aa-21b904744869-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:24:50 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-56fce9c4-c482-46f9-9291-3356a168c3f0 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Acquiring lock "cinder-quobyte-a78fbb72-b508-45bf-b8aa-21b904744869" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:24:50 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-56fce9c4-c482-46f9-9291-3356a168c3f0 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "cinder-quobyte-a78fbb72-b508-45bf-b8aa-21b904744869" acquired by "delete_volume" :: waited 0.016s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:24:50 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e59046-0086-4308-b052-d76127564459]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:24:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-56fce9c4-c482-46f9-9291-3356a168c3f0 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a78fbb72-b508-45bf-b8aa-21b904744869 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:50 devstack sudo[103886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a78fbb72-b508-45bf-b8aa-21b904744869
Nov 05 19:24:50 devstack sudo[103886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:51 devstack sudo[103886]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-56fce9c4-c482-46f9-9291-3356a168c3f0 tempest-CreateVolumesFromSnapshotTest-2127375374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a78fbb72-b508-45bf-b8aa-21b904744869" returned: 0 in 0.360s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-56fce9c4-c482-46f9-9291-3356a168c3f0 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a78fbb72-b508-45bf-b8aa-21b904744869 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:51 devstack sudo[103891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a78fbb72-b508-45bf-b8aa-21b904744869
Nov 05 19:24:51 devstack sudo[103891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:51 devstack sudo[103891]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-56fce9c4-c482-46f9-9291-3356a168c3f0 tempest-CreateVolumesFromSnapshotTest-2127375374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a78fbb72-b508-45bf-b8aa-21b904744869" returned: 0 in 0.254s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-56fce9c4-c482-46f9-9291-3356a168c3f0 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "cinder-quobyte-a78fbb72-b508-45bf-b8aa-21b904744869" released by "delete_volume" :: held 0.654s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:24:51 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-56fce9c4-c482-46f9-9291-3356a168c3f0 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Created reservations ['194f65b2-4b89-4ce5-a34a-47927ca2d5b8', '60a42989-9030-4dea-8d6f-9542a0e276dd', '8f51e11a-b855-4427-8784-2a03bcb7c0a7', 'fe45cd5d-947c-4eac-8180-4359c616fd8a'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:24:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-56fce9c4-c482-46f9-9291-3356a168c3f0 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:24:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-56fce9c4-c482-46f9-9291-3356a168c3f0 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:24:51 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-56fce9c4-c482-46f9-9291-3356a168c3f0 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:24:51 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-56fce9c4-c482-46f9-9291-3356a168c3f0 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:24:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-56fce9c4-c482-46f9-9291-3356a168c3f0 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:24:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-56fce9c4-c482-46f9-9291-3356a168c3f0 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:51 devstack sudo[103894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:24:51 devstack sudo[103894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:51 devstack sudo[103894]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-56fce9c4-c482-46f9-9291-3356a168c3f0 tempest-CreateVolumesFromSnapshotTest-2127375374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.258s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:51 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-56fce9c4-c482-46f9-9291-3356a168c3f0 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:24:51 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-56fce9c4-c482-46f9-9291-3356a168c3f0 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Deleted volume successfully.
Nov 05 19:24:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-56fce9c4-c482-46f9-9291-3356a168c3f0 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "cinder-a78fbb72-b508-45bf-b8aa-21b904744869-delete_volume" released by "delete_volume" :: held 1.105s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:24:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1b6a2a31-9729-481d-ba14-702e4cf5a892 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Acquiring lock "cinder-e73e3c8e-489e-4e66-90d4-85394ded5784-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:24:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1b6a2a31-9729-481d-ba14-702e4cf5a892 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "cinder-e73e3c8e-489e-4e66-90d4-85394ded5784-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:24:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1b6a2a31-9729-481d-ba14-702e4cf5a892 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Acquiring lock "cinder-quobyte-fbe45200-8050-42be-9b33-b226047bcfde" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:24:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1b6a2a31-9729-481d-ba14-702e4cf5a892 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "cinder-quobyte-fbe45200-8050-42be-9b33-b226047bcfde" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:24:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1b6a2a31-9729-481d-ba14-702e4cf5a892 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Acquiring lock "cinder-quobyte-e73e3c8e-489e-4e66-90d4-85394ded5784" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:24:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1b6a2a31-9729-481d-ba14-702e4cf5a892 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "cinder-quobyte-e73e3c8e-489e-4e66-90d4-85394ded5784" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:24:51 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-1b6a2a31-9729-481d-ba14-702e4cf5a892 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Deleting offline snapshot e73e3c8e-489e-4e66-90d4-85394ded5784 of volume fbe45200-8050-42be-9b33-b226047bcfde {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:24:51 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-1b6a2a31-9729-481d-ba14-702e4cf5a892 tempest-CreateVolumesFromSnapshotTest-2127375374 None] snapshot_file for this snap is: volume-fbe45200-8050-42be-9b33-b226047bcfde.e73e3c8e-489e-4e66-90d4-85394ded5784 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:24:51 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6a0fe7-18de-465c-9c98-bf3e900d6252]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:24:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1b6a2a31-9729-481d-ba14-702e4cf5a892 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde.e73e3c8e-489e-4e66-90d4-85394ded5784 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:51 devstack sudo[103913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde.e73e3c8e-489e-4e66-90d4-85394ded5784
Nov 05 19:24:51 devstack sudo[103913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:52 devstack sudo[103913]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1b6a2a31-9729-481d-ba14-702e4cf5a892 tempest-CreateVolumesFromSnapshotTest-2127375374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde.e73e3c8e-489e-4e66-90d4-85394ded5784" returned: 0 in 0.367s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-1b6a2a31-9729-481d-ba14-702e4cf5a892 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbe45200-8050-42be-9b33-b226047bcfde(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:24:52 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aaf63b8-849d-4a72-b068-134e7f04e38c]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:24:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1b6a2a31-9729-481d-ba14-702e4cf5a892 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:52 devstack sudo[103938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde
Nov 05 19:24:52 devstack sudo[103938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:52 devstack sudo[103938]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1b6a2a31-9729-481d-ba14-702e4cf5a892 tempest-CreateVolumesFromSnapshotTest-2127375374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde" returned: 0 in 0.384s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1b6a2a31-9729-481d-ba14-702e4cf5a892 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde.e73e3c8e-489e-4e66-90d4-85394ded5784 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:52 devstack sudo[103943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde.e73e3c8e-489e-4e66-90d4-85394ded5784
Nov 05 19:24:52 devstack sudo[103943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:52 devstack sudo[103943]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1b6a2a31-9729-481d-ba14-702e4cf5a892 tempest-CreateVolumesFromSnapshotTest-2127375374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde.e73e3c8e-489e-4e66-90d4-85394ded5784" returned: 0 in 0.338s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1b6a2a31-9729-481d-ba14-702e4cf5a892 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde.e73e3c8e-489e-4e66-90d4-85394ded5784 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:52 devstack sudo[103948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde.e73e3c8e-489e-4e66-90d4-85394ded5784
Nov 05 19:24:52 devstack sudo[103948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:53 devstack sudo[103948]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1b6a2a31-9729-481d-ba14-702e4cf5a892 tempest-CreateVolumesFromSnapshotTest-2127375374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde.e73e3c8e-489e-4e66-90d4-85394ded5784" returned: 0 in 0.254s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1b6a2a31-9729-481d-ba14-702e4cf5a892 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "cinder-quobyte-e73e3c8e-489e-4e66-90d4-85394ded5784" released by "_delete_snapshot" :: held 1.450s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:24:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1b6a2a31-9729-481d-ba14-702e4cf5a892 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "cinder-quobyte-fbe45200-8050-42be-9b33-b226047bcfde" released by "delete_snapshot" :: held 1.471s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:24:53 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-1b6a2a31-9729-481d-ba14-702e4cf5a892 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Created reservations ['e0f73488-ddd5-44e7-8c00-e747a2afd47f', '7cbf5b4f-975c-45b6-aa1d-e3301dbcc28a', 'd641fc3c-b87d-4da0-8a61-aa90e546b450', 'e8149a16-7842-4eaa-9346-dcc5e91eefb6'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:24:53 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-1b6a2a31-9729-481d-ba14-702e4cf5a892 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Delete snapshot completed successfully.
Nov 05 19:24:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1b6a2a31-9729-481d-ba14-702e4cf5a892 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "cinder-e73e3c8e-489e-4e66-90d4-85394ded5784-delete_snapshot" released by "delete_snapshot" :: held 1.605s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:24:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-79c31fbf-5db5-4e49-975d-bb460e05cd22 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Acquiring lock "cinder-fbe45200-8050-42be-9b33-b226047bcfde-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:24:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-79c31fbf-5db5-4e49-975d-bb460e05cd22 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "cinder-fbe45200-8050-42be-9b33-b226047bcfde-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:24:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-79c31fbf-5db5-4e49-975d-bb460e05cd22 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Acquiring lock "cinder-quobyte-fbe45200-8050-42be-9b33-b226047bcfde" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:24:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-79c31fbf-5db5-4e49-975d-bb460e05cd22 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "cinder-quobyte-fbe45200-8050-42be-9b33-b226047bcfde" acquired by "delete_volume" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:24:54 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db9483c-7e30-4e1c-ae45-e769f1214fd4]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:24:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-79c31fbf-5db5-4e49-975d-bb460e05cd22 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:54 devstack sudo[103951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde
Nov 05 19:24:54 devstack sudo[103951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:54 devstack sudo[103951]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-79c31fbf-5db5-4e49-975d-bb460e05cd22 tempest-CreateVolumesFromSnapshotTest-2127375374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde" returned: 0 in 0.351s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-79c31fbf-5db5-4e49-975d-bb460e05cd22 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:54 devstack sudo[103956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde
Nov 05 19:24:54 devstack sudo[103956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:54 devstack sudo[103956]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-79c31fbf-5db5-4e49-975d-bb460e05cd22 tempest-CreateVolumesFromSnapshotTest-2127375374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fbe45200-8050-42be-9b33-b226047bcfde" returned: 0 in 0.248s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:54 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-79c31fbf-5db5-4e49-975d-bb460e05cd22 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "cinder-quobyte-fbe45200-8050-42be-9b33-b226047bcfde" released by "delete_volume" :: held 0.661s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:24:54 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-79c31fbf-5db5-4e49-975d-bb460e05cd22 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Created reservations ['a2419976-6588-48ef-80fd-2eed5a312bf0', '9ce8166a-9831-42ca-9aba-c21de2537d4b', 'c3b08778-7c16-4c48-baf2-bb42e92d94c8', '6c5fc727-8ae5-4dd7-90bc-882baf78d392'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:24:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-79c31fbf-5db5-4e49-975d-bb460e05cd22 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:24:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-79c31fbf-5db5-4e49-975d-bb460e05cd22 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:24:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-79c31fbf-5db5-4e49-975d-bb460e05cd22 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:24:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-79c31fbf-5db5-4e49-975d-bb460e05cd22 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:24:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-79c31fbf-5db5-4e49-975d-bb460e05cd22 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:24:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-79c31fbf-5db5-4e49-975d-bb460e05cd22 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:54 devstack sudo[103959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:24:54 devstack sudo[103959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:54 devstack sudo[103959]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-79c31fbf-5db5-4e49-975d-bb460e05cd22 tempest-CreateVolumesFromSnapshotTest-2127375374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.256s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:54 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-79c31fbf-5db5-4e49-975d-bb460e05cd22 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:24:54 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-79c31fbf-5db5-4e49-975d-bb460e05cd22 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Deleted volume successfully.
Nov 05 19:24:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-79c31fbf-5db5-4e49-975d-bb460e05cd22 tempest-CreateVolumesFromSnapshotTest-2127375374 None] Lock "cinder-fbe45200-8050-42be-9b33-b226047bcfde-delete_volume" released by "delete_volume" :: held 1.116s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:24:57 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-9264da01-3d7d-4558-91d2-dcf2881a6181 tempest-VolumeDependencyTests-2088975607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:24:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9264da01-3d7d-4558-91d2-dcf2881a6181 tempest-VolumeDependencyTests-2088975607 None] Flow 'volume_create_manager' (9160d8fa-1100-491a-8581-30457398c69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:24:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9264da01-3d7d-4558-91d2-dcf2881a6181 tempest-VolumeDependencyTests-2088975607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1765a130-2765-4968-9784-efd1df4ee3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:24:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9264da01-3d7d-4558-91d2-dcf2881a6181 tempest-VolumeDependencyTests-2088975607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1765a130-2765-4968-9784-efd1df4ee3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:24:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-515615027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93eead02-22f3-4169-b2b1-c2a48e53ff1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40228ed6e75d4a72a627cd3327248ca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:24:58Z,use_quota=True,user_id='49c2719359b145bbadd285d44ae2d1c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:24:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9264da01-3d7d-4558-91d2-dcf2881a6181 tempest-VolumeDependencyTests-2088975607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31e5b715-c603-4aa2-8fad-f082bfed0628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:24:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9264da01-3d7d-4558-91d2-dcf2881a6181 tempest-VolumeDependencyTests-2088975607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31e5b715-c603-4aa2-8fad-f082bfed0628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:24:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9264da01-3d7d-4558-91d2-dcf2881a6181 tempest-VolumeDependencyTests-2088975607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aff6652e-a5ac-4954-baa0-ba344034c643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:24:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9264da01-3d7d-4558-91d2-dcf2881a6181 tempest-VolumeDependencyTests-2088975607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aff6652e-a5ac-4954-baa0-ba344034c643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93eead02-22f3-4169-b2b1-c2a48e53ff1c', 'volume_name': 'volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:24:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9264da01-3d7d-4558-91d2-dcf2881a6181 tempest-VolumeDependencyTests-2088975607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (720c23ce-f837-4e22-847c-3975892db328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:24:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9264da01-3d7d-4558-91d2-dcf2881a6181 tempest-VolumeDependencyTests-2088975607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (720c23ce-f837-4e22-847c-3975892db328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:24:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9264da01-3d7d-4558-91d2-dcf2881a6181 tempest-VolumeDependencyTests-2088975607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0641878-c8a7-4142-aae3-6ba0f5fc1aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:24:57 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-9264da01-3d7d-4558-91d2-dcf2881a6181 tempest-VolumeDependencyTests-2088975607 None] Volume 93eead02-22f3-4169-b2b1-c2a48e53ff1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c', 'volume_size': 1}
Nov 05 19:24:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9264da01-3d7d-4558-91d2-dcf2881a6181 tempest-VolumeDependencyTests-2088975607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:24:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9264da01-3d7d-4558-91d2-dcf2881a6181 tempest-VolumeDependencyTests-2088975607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:24:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9264da01-3d7d-4558-91d2-dcf2881a6181 tempest-VolumeDependencyTests-2088975607 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:24:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-515615027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93eead02-22f3-4169-b2b1-c2a48e53ff1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40228ed6e75d4a72a627cd3327248ca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:24:58Z,use_quota=True,user_id='49c2719359b145bbadd285d44ae2d1c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:24:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-9264da01-3d7d-4558-91d2-dcf2881a6181 tempest-VolumeDependencyTests-2088975607 None] Creating volume 93eead02-22f3-4169-b2b1-c2a48e53ff1c {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:24:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9264da01-3d7d-4558-91d2-dcf2881a6181 tempest-VolumeDependencyTests-2088975607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:24:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9264da01-3d7d-4558-91d2-dcf2881a6181 tempest-VolumeDependencyTests-2088975607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:24:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9264da01-3d7d-4558-91d2-dcf2881a6181 tempest-VolumeDependencyTests-2088975607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:24:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9264da01-3d7d-4558-91d2-dcf2881a6181 tempest-VolumeDependencyTests-2088975607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:24:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9264da01-3d7d-4558-91d2-dcf2881a6181 tempest-VolumeDependencyTests-2088975607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:24:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9264da01-3d7d-4558-91d2-dcf2881a6181 tempest-VolumeDependencyTests-2088975607 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:24:57 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-9264da01-3d7d-4558-91d2-dcf2881a6181 tempest-VolumeDependencyTests-2088975607 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:24:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9264da01-3d7d-4558-91d2-dcf2881a6181 tempest-VolumeDependencyTests-2088975607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:57 devstack sudo[103964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c 1073741824
Nov 05 19:24:57 devstack sudo[103964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:58 devstack sudo[103964]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9264da01-3d7d-4558-91d2-dcf2881a6181 tempest-VolumeDependencyTests-2088975607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c 1073741824" returned: 0 in 0.400s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9264da01-3d7d-4558-91d2-dcf2881a6181 tempest-VolumeDependencyTests-2088975607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:58 devstack sudo[103969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c
Nov 05 19:24:58 devstack sudo[103969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:58 devstack sudo[103969]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9264da01-3d7d-4558-91d2-dcf2881a6181 tempest-VolumeDependencyTests-2088975607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c" returned: 0 in 0.238s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9264da01-3d7d-4558-91d2-dcf2881a6181 tempest-VolumeDependencyTests-2088975607 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:24:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9264da01-3d7d-4558-91d2-dcf2881a6181 tempest-VolumeDependencyTests-2088975607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:24:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9264da01-3d7d-4558-91d2-dcf2881a6181 tempest-VolumeDependencyTests-2088975607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0641878-c8a7-4142-aae3-6ba0f5fc1aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:24:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9264da01-3d7d-4558-91d2-dcf2881a6181 tempest-VolumeDependencyTests-2088975607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f994783f-386c-4a75-aefd-ce43f8a57f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:24:58 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-9264da01-3d7d-4558-91d2-dcf2881a6181 tempest-VolumeDependencyTests-2088975607 None] Volume volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c (93eead02-22f3-4169-b2b1-c2a48e53ff1c): created successfully
Nov 05 19:24:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9264da01-3d7d-4558-91d2-dcf2881a6181 tempest-VolumeDependencyTests-2088975607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f994783f-386c-4a75-aefd-ce43f8a57f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:24:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-9264da01-3d7d-4558-91d2-dcf2881a6181 tempest-VolumeDependencyTests-2088975607 None] Flow 'volume_create_manager' (9160d8fa-1100-491a-8581-30457398c69a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:24:58 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-9264da01-3d7d-4558-91d2-dcf2881a6181 tempest-VolumeDependencyTests-2088975607 None] Created volume successfully.
Nov 05 19:24:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0841a2d7-7788-4d45-b2f6-d2541646515e tempest-VolumeDependencyTests-2088975607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:24:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0841a2d7-7788-4d45-b2f6-d2541646515e tempest-VolumeDependencyTests-2088975607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:24:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-0841a2d7-7788-4d45-b2f6-d2541646515e tempest-VolumeDependencyTests-2088975607 None] Creating offline snapshot 9993559b-676a-4031-bb83-f2b27aba013f of volume 93eead02-22f3-4169-b2b1-c2a48e53ff1c {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:24:58 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7daec670-be0a-4b50-b2e0-6f9560030b1f]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:24:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0841a2d7-7788-4d45-b2f6-d2541646515e tempest-VolumeDependencyTests-2088975607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:58 devstack sudo[103972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c
Nov 05 19:24:58 devstack sudo[103972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:59 devstack sudo[103972]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0841a2d7-7788-4d45-b2f6-d2541646515e tempest-VolumeDependencyTests-2088975607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c" returned: 0 in 0.364s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0841a2d7-7788-4d45-b2f6-d2541646515e tempest-VolumeDependencyTests-2088975607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c.9993559b-676a-4031-bb83-f2b27aba013f 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:59 devstack sudo[103977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c.9993559b-676a-4031-bb83-f2b27aba013f 1G
Nov 05 19:24:59 devstack sudo[103977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:59 devstack sudo[103977]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0841a2d7-7788-4d45-b2f6-d2541646515e tempest-VolumeDependencyTests-2088975607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c.9993559b-676a-4031-bb83-f2b27aba013f 1G" returned: 0 in 0.370s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0841a2d7-7788-4d45-b2f6-d2541646515e tempest-VolumeDependencyTests-2088975607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c.9993559b-676a-4031-bb83-f2b27aba013f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:59 devstack sudo[103982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c.9993559b-676a-4031-bb83-f2b27aba013f
Nov 05 19:24:59 devstack sudo[103982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:24:59 devstack sudo[103982]: pam_unix(sudo:session): session closed for user root
Nov 05 19:24:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0841a2d7-7788-4d45-b2f6-d2541646515e tempest-VolumeDependencyTests-2088975607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c.9993559b-676a-4031-bb83-f2b27aba013f" returned: 0 in 0.281s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:24:59 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-0841a2d7-7788-4d45-b2f6-d2541646515e tempest-VolumeDependencyTests-2088975607 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c.9993559b-676a-4031-bb83-f2b27aba013f is being set with open permissions: ugo+rw
Nov 05 19:24:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0841a2d7-7788-4d45-b2f6-d2541646515e tempest-VolumeDependencyTests-2088975607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c.9993559b-676a-4031-bb83-f2b27aba013f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:24:59 devstack sudo[103987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c.9993559b-676a-4031-bb83-f2b27aba013f
Nov 05 19:24:59 devstack sudo[103987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:00 devstack sudo[103987]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0841a2d7-7788-4d45-b2f6-d2541646515e tempest-VolumeDependencyTests-2088975607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c.9993559b-676a-4031-bb83-f2b27aba013f" returned: 0 in 0.240s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0841a2d7-7788-4d45-b2f6-d2541646515e tempest-VolumeDependencyTests-2088975607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:00 devstack sudo[103990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c.info
Nov 05 19:25:00 devstack sudo[103990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:00 devstack sudo[103990]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0841a2d7-7788-4d45-b2f6-d2541646515e tempest-VolumeDependencyTests-2088975607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c.info" returned: 0 in 0.240s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:00 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-0841a2d7-7788-4d45-b2f6-d2541646515e tempest-VolumeDependencyTests-2088975607 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c.info is being set with open permissions: ugo+rw
Nov 05 19:25:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0841a2d7-7788-4d45-b2f6-d2541646515e tempest-VolumeDependencyTests-2088975607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:00 devstack sudo[103993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c.info
Nov 05 19:25:00 devstack sudo[103993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:00 devstack sudo[103993]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0841a2d7-7788-4d45-b2f6-d2541646515e tempest-VolumeDependencyTests-2088975607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c.info" returned: 0 in 0.241s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0841a2d7-7788-4d45-b2f6-d2541646515e tempest-VolumeDependencyTests-2088975607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.820s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:25:00 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-0841a2d7-7788-4d45-b2f6-d2541646515e tempest-VolumeDependencyTests-2088975607 None] Create snapshot completed successfully
Nov 05 19:25:01 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:25:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Flow 'volume_create_manager' (f0d5e9eb-db06-4c74-97b6-aff385cf57ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:25:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88a40407-134f-4674-8c50-d578421ca9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:25:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88a40407-134f-4674-8c50-d578421ca9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1485897661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f5d1243-9352-4475-9f83-a54045277428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40228ed6e75d4a72a627cd3327248ca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9993559b-676a-4031-bb83-f2b27aba013f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:25:01Z,use_quota=True,user_id='49c2719359b145bbadd285d44ae2d1c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:25:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92121d02-ac42-4142-b3e2-7509b6a97878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:25:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92121d02-ac42-4142-b3e2-7509b6a97878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:25:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeb40762-400e-44b6-9ba5-eaa93aca12fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:25:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeb40762-400e-44b6-9ba5-eaa93aca12fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2f5d1243-9352-4475-9f83-a54045277428', 'volume_name': 'volume-2f5d1243-9352-4475-9f83-a54045277428', 'volume_size': 1, 'snapshot_id': '9993559b-676a-4031-bb83-f2b27aba013f'}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:25:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e857538-0d46-4bae-a910-a8bc0e22ba9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:25:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e857538-0d46-4bae-a910-a8bc0e22ba9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:25:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6521b037-c6b6-40ad-801c-99c865aa26b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:25:01 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Volume 2f5d1243-9352-4475-9f83-a54045277428: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2f5d1243-9352-4475-9f83-a54045277428', 'volume_size': 1, 'snapshot_id': '9993559b-676a-4031-bb83-f2b27aba013f'}
Nov 05 19:25:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:25:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:25:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Acquiring lock "cinder-quobyte-9993559b-676a-4031-bb83-f2b27aba013f-2f5d1243-9352-4475-9f83-a54045277428" by "_create_volume_from_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:25:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Lock "cinder-quobyte-9993559b-676a-4031-bb83-f2b27aba013f-2f5d1243-9352-4475-9f83-a54045277428" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:25:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Creating volume 2f5d1243-9352-4475-9f83-a54045277428 from snapshot 9993559b-676a-4031-bb83-f2b27aba013f {{(pid=87184) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 19:25:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:25:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:25:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:25:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:25:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:25:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:25:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Acquiring lock "cinder-quobyte-2f5d1243-9352-4475-9f83-a54045277428" by "_copy_volume_from_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:25:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Lock "cinder-quobyte-2f5d1243-9352-4475-9f83-a54045277428" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:25:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] snapshot: 9993559b-676a-4031-bb83-f2b27aba013f, volume: 2f5d1243-9352-4475-9f83-a54045277428,  {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 19:25:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:25:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:25:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:25:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:25:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:25:01 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5bc69ff-68d0-43b4-a4fd-071dd9e993f9]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:25:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c.9993559b-676a-4031-bb83-f2b27aba013f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:01 devstack sudo[103999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c.9993559b-676a-4031-bb83-f2b27aba013f
Nov 05 19:25:01 devstack sudo[103999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:01 devstack sudo[103999]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c.9993559b-676a-4031-bb83-f2b27aba013f" returned: 0 in 0.343s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:25:01 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b90c82-210e-4fe6-803a-7367702a6d7d]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:25:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:02 devstack sudo[104004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c
Nov 05 19:25:02 devstack sudo[104004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:02 devstack sudo[104004]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c" returned: 0 in 0.354s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:02 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 19:25:02 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Creating direct copy from snapshot {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 19:25:02 devstack cinder-volume[87184]: DEBUG cinder.utils [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Path /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-2f5d1243-9352-4475-9f83-a54045277428 not found in is_blk_device check {{(pid=87184) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 19:25:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-2f5d1243-9352-4475-9f83-a54045277428 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:02 devstack sudo[104009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-2f5d1243-9352-4475-9f83-a54045277428
Nov 05 19:25:02 devstack sudo[104009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:25:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:25:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:25:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:25:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:25:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:25:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:05 devstack sudo[104021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:25:05 devstack sudo[104021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:05 devstack sudo[104021]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.360s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:05 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:25:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:25:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread count: 28 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 19:25:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread info: [<_MainThread(MainThread, started 126882883072128)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126882770872512)>, <Thread(Thread-3 (stat_writer), started daemon 126882769837376)>, <Thread(Rabbit-heartbeat, started daemon 126882768896256)>, <Thread(Thread-5 (_runner), started daemon 126882768980928)>, <Thread(Thread-7 (_runner), started daemon 126882767016448)>, <Thread(fd_logger, started daemon 126882764561216)>, <Thread(privsep_reader, started daemon 126882764568576)>, <Thread(tpool_thread_0, started daemon 126882759292608)>, <Thread(tpool_thread_1, started daemon 126882750899904)>, <Thread(tpool_thread_2, started daemon 126882742507200)>, <Thread(tpool_thread_3, started daemon 126882734114496)>, <Thread(tpool_thread_4, started daemon 126882725721792)>, <Thread(tpool_thread_5, started daemon 126882717329088)>, <Thread(tpool_thread_6, started daemon 126882708920000)>, <Thread(tpool_thread_7, started daemon 126882700510912)>, <Thread(tpool_thread_8, started daemon 126882692101824)>, <Thread(tpool_thread_9, started daemon 126882683692736)>, <Thread(tpool_thread_10, started daemon 126882675283648)>, <Thread(tpool_thread_11, started daemon 126882666874560)>, <Thread(tpool_thread_12, started daemon 126882658465472)>, <Thread(tpool_thread_13, started daemon 126882650056384)>, <Thread(tpool_thread_14, started daemon 126882641647296)>, <Thread(tpool_thread_15, started daemon 126882633238208)>, <Thread(tpool_thread_16, started daemon 126882624829120)>, <Thread(tpool_thread_17, started daemon 126882616420032)>, <Thread(tpool_thread_18, started daemon 126882608010944)>, <Thread(tpool_thread_19, started daemon 126882599601856)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 19:25:08 devstack sudo[104009]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-2f5d1243-9352-4475-9f83-a54045277428" returned: 0 in 5.958s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:08 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Image conversion details: src /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c, size 1024.00 MB, duration 5.96 sec, destination /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-2f5d1243-9352-4475-9f83-a54045277428 {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 19:25:08 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Converted 1024.00 MB image at 171.85 MB/s
Nov 05 19:25:08 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-2f5d1243-9352-4475-9f83-a54045277428 is being set with open permissions: ugo+rw
Nov 05 19:25:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-2f5d1243-9352-4475-9f83-a54045277428 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:08 devstack sudo[104025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-2f5d1243-9352-4475-9f83-a54045277428
Nov 05 19:25:08 devstack sudo[104025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:08 devstack sudo[104025]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-2f5d1243-9352-4475-9f83-a54045277428" returned: 0 in 0.247s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Lock "cinder-quobyte-2f5d1243-9352-4475-9f83-a54045277428" released by "_copy_volume_from_snapshot" :: held 6.982s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:25:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Lock "cinder-quobyte-9993559b-676a-4031-bb83-f2b27aba013f-2f5d1243-9352-4475-9f83-a54045277428" released by "_create_volume_from_snapshot" :: held 7.044s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:25:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.059s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:25:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6521b037-c6b6-40ad-801c-99c865aa26b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f5d1243-9352-4475-9f83-a54045277428', 'volume_size': 1, 'snapshot_id': '9993559b-676a-4031-bb83-f2b27aba013f'}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:25:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efa7588e-5f5e-4100-8666-177c66990762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:25:08 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Volume volume-2f5d1243-9352-4475-9f83-a54045277428 (2f5d1243-9352-4475-9f83-a54045277428): created successfully
Nov 05 19:25:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efa7588e-5f5e-4100-8666-177c66990762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:25:08 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Flow 'volume_create_manager' (f0d5e9eb-db06-4c74-97b6-aff385cf57ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:25:08 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-a3065efa-43b1-455c-a1f6-576866149cb6 tempest-VolumeDependencyTests-2088975607 None] Created volume successfully.
Nov 05 19:25:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9851e273-90ec-4e89-904e-8c4cd8ef3be0 tempest-VolumeDependencyTests-2088975607 None] Acquiring lock "cinder-9993559b-676a-4031-bb83-f2b27aba013f-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:25:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9851e273-90ec-4e89-904e-8c4cd8ef3be0 tempest-VolumeDependencyTests-2088975607 None] Lock "cinder-9993559b-676a-4031-bb83-f2b27aba013f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:25:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9851e273-90ec-4e89-904e-8c4cd8ef3be0 tempest-VolumeDependencyTests-2088975607 None] Acquiring lock "cinder-quobyte-93eead02-22f3-4169-b2b1-c2a48e53ff1c" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:25:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9851e273-90ec-4e89-904e-8c4cd8ef3be0 tempest-VolumeDependencyTests-2088975607 None] Lock "cinder-quobyte-93eead02-22f3-4169-b2b1-c2a48e53ff1c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:25:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9851e273-90ec-4e89-904e-8c4cd8ef3be0 tempest-VolumeDependencyTests-2088975607 None] Acquiring lock "cinder-quobyte-9993559b-676a-4031-bb83-f2b27aba013f" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:25:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9851e273-90ec-4e89-904e-8c4cd8ef3be0 tempest-VolumeDependencyTests-2088975607 None] Lock "cinder-quobyte-9993559b-676a-4031-bb83-f2b27aba013f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:25:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-9851e273-90ec-4e89-904e-8c4cd8ef3be0 tempest-VolumeDependencyTests-2088975607 None] Deleting offline snapshot 9993559b-676a-4031-bb83-f2b27aba013f of volume 93eead02-22f3-4169-b2b1-c2a48e53ff1c {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:25:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-9851e273-90ec-4e89-904e-8c4cd8ef3be0 tempest-VolumeDependencyTests-2088975607 None] snapshot_file for this snap is: volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c.9993559b-676a-4031-bb83-f2b27aba013f {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:25:09 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7d6961-6ecf-4708-857d-4209c7c82c80]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:25:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9851e273-90ec-4e89-904e-8c4cd8ef3be0 tempest-VolumeDependencyTests-2088975607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c.9993559b-676a-4031-bb83-f2b27aba013f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:09 devstack sudo[104028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c.9993559b-676a-4031-bb83-f2b27aba013f
Nov 05 19:25:09 devstack sudo[104028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:09 devstack sudo[104028]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9851e273-90ec-4e89-904e-8c4cd8ef3be0 tempest-VolumeDependencyTests-2088975607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c.9993559b-676a-4031-bb83-f2b27aba013f" returned: 0 in 0.349s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-9851e273-90ec-4e89-904e-8c4cd8ef3be0 tempest-VolumeDependencyTests-2088975607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:25:09 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a53e095-ad46-4403-aece-cf58f0511a91]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:25:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9851e273-90ec-4e89-904e-8c4cd8ef3be0 tempest-VolumeDependencyTests-2088975607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:09 devstack sudo[104033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c
Nov 05 19:25:09 devstack sudo[104033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:09 devstack sudo[104033]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9851e273-90ec-4e89-904e-8c4cd8ef3be0 tempest-VolumeDependencyTests-2088975607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c" returned: 0 in 0.516s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9851e273-90ec-4e89-904e-8c4cd8ef3be0 tempest-VolumeDependencyTests-2088975607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c.9993559b-676a-4031-bb83-f2b27aba013f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:10 devstack sudo[104038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c.9993559b-676a-4031-bb83-f2b27aba013f
Nov 05 19:25:10 devstack sudo[104038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:10 devstack sudo[104038]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9851e273-90ec-4e89-904e-8c4cd8ef3be0 tempest-VolumeDependencyTests-2088975607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c.9993559b-676a-4031-bb83-f2b27aba013f" returned: 0 in 0.312s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9851e273-90ec-4e89-904e-8c4cd8ef3be0 tempest-VolumeDependencyTests-2088975607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c.9993559b-676a-4031-bb83-f2b27aba013f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:10 devstack sudo[104043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c.9993559b-676a-4031-bb83-f2b27aba013f
Nov 05 19:25:10 devstack sudo[104043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:10 devstack sudo[104043]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9851e273-90ec-4e89-904e-8c4cd8ef3be0 tempest-VolumeDependencyTests-2088975607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c.9993559b-676a-4031-bb83-f2b27aba013f" returned: 0 in 0.239s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9851e273-90ec-4e89-904e-8c4cd8ef3be0 tempest-VolumeDependencyTests-2088975607 None] Lock "cinder-quobyte-9993559b-676a-4031-bb83-f2b27aba013f" released by "_delete_snapshot" :: held 1.542s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:25:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9851e273-90ec-4e89-904e-8c4cd8ef3be0 tempest-VolumeDependencyTests-2088975607 None] Lock "cinder-quobyte-93eead02-22f3-4169-b2b1-c2a48e53ff1c" released by "delete_snapshot" :: held 1.567s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:25:10 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-9851e273-90ec-4e89-904e-8c4cd8ef3be0 tempest-VolumeDependencyTests-2088975607 None] Created reservations ['2a9dfab5-66d3-483d-adf7-f32dab257808', 'c4aa20ab-5c34-4d41-8611-a60730c4a8c8', '7a026699-d9af-419b-ad67-50b54cedea23', '5b8e5d61-317e-4242-829e-57171200c096'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:25:10 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-9851e273-90ec-4e89-904e-8c4cd8ef3be0 tempest-VolumeDependencyTests-2088975607 None] Delete snapshot completed successfully.
Nov 05 19:25:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9851e273-90ec-4e89-904e-8c4cd8ef3be0 tempest-VolumeDependencyTests-2088975607 None] Lock "cinder-9993559b-676a-4031-bb83-f2b27aba013f-delete_snapshot" released by "delete_snapshot" :: held 1.699s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:25:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-abff9e6c-28a5-42b8-baf9-353f9f0cc716 tempest-VolumeDependencyTests-2088975607 None] Acquiring lock "cinder-93eead02-22f3-4169-b2b1-c2a48e53ff1c-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:25:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-abff9e6c-28a5-42b8-baf9-353f9f0cc716 tempest-VolumeDependencyTests-2088975607 None] Lock "cinder-93eead02-22f3-4169-b2b1-c2a48e53ff1c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:25:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-abff9e6c-28a5-42b8-baf9-353f9f0cc716 tempest-VolumeDependencyTests-2088975607 None] Acquiring lock "cinder-quobyte-93eead02-22f3-4169-b2b1-c2a48e53ff1c" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:25:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-abff9e6c-28a5-42b8-baf9-353f9f0cc716 tempest-VolumeDependencyTests-2088975607 None] Lock "cinder-quobyte-93eead02-22f3-4169-b2b1-c2a48e53ff1c" acquired by "delete_volume" :: waited 0.015s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:25:11 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1202fc41-5fd2-4d8c-99a0-e94a89e075a4]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:25:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-abff9e6c-28a5-42b8-baf9-353f9f0cc716 tempest-VolumeDependencyTests-2088975607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:11 devstack sudo[104048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c
Nov 05 19:25:11 devstack sudo[104048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:11 devstack sudo[104048]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-abff9e6c-28a5-42b8-baf9-353f9f0cc716 tempest-VolumeDependencyTests-2088975607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c" returned: 0 in 0.342s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-abff9e6c-28a5-42b8-baf9-353f9f0cc716 tempest-VolumeDependencyTests-2088975607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:11 devstack sudo[104053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c
Nov 05 19:25:11 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:11 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-abff9e6c-28a5-42b8-baf9-353f9f0cc716 tempest-VolumeDependencyTests-2088975607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-93eead02-22f3-4169-b2b1-c2a48e53ff1c" returned: 0 in 0.239s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-abff9e6c-28a5-42b8-baf9-353f9f0cc716 tempest-VolumeDependencyTests-2088975607 None] Lock "cinder-quobyte-93eead02-22f3-4169-b2b1-c2a48e53ff1c" released by "delete_volume" :: held 0.636s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:25:11 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-abff9e6c-28a5-42b8-baf9-353f9f0cc716 tempest-VolumeDependencyTests-2088975607 None] Created reservations ['5efd5bf7-3065-4c8e-816d-93d797639b06', '0016e045-ca2e-4ab1-a663-46fdf8212b61', '11bfce24-2b7a-4ce8-ab43-3a3b4baade58', 'df969413-df67-49e4-8b4f-78d13a2f61e4'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:25:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-abff9e6c-28a5-42b8-baf9-353f9f0cc716 tempest-VolumeDependencyTests-2088975607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:25:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-abff9e6c-28a5-42b8-baf9-353f9f0cc716 tempest-VolumeDependencyTests-2088975607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:25:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-abff9e6c-28a5-42b8-baf9-353f9f0cc716 tempest-VolumeDependencyTests-2088975607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:25:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-abff9e6c-28a5-42b8-baf9-353f9f0cc716 tempest-VolumeDependencyTests-2088975607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:25:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-abff9e6c-28a5-42b8-baf9-353f9f0cc716 tempest-VolumeDependencyTests-2088975607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:25:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-abff9e6c-28a5-42b8-baf9-353f9f0cc716 tempest-VolumeDependencyTests-2088975607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:11 devstack sudo[104056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:25:12 devstack sudo[104056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:12 devstack sudo[104056]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-abff9e6c-28a5-42b8-baf9-353f9f0cc716 tempest-VolumeDependencyTests-2088975607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.247s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:12 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-abff9e6c-28a5-42b8-baf9-353f9f0cc716 tempest-VolumeDependencyTests-2088975607 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:25:12 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-abff9e6c-28a5-42b8-baf9-353f9f0cc716 tempest-VolumeDependencyTests-2088975607 None] Deleted volume successfully.
Nov 05 19:25:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-abff9e6c-28a5-42b8-baf9-353f9f0cc716 tempest-VolumeDependencyTests-2088975607 None] Lock "cinder-93eead02-22f3-4169-b2b1-c2a48e53ff1c-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:25:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ddbbc05a-a1a6-4ea4-b047-ddcb71efa628 tempest-VolumeDependencyTests-2088975607 None] Acquiring lock "cinder-2f5d1243-9352-4475-9f83-a54045277428-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:25:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ddbbc05a-a1a6-4ea4-b047-ddcb71efa628 tempest-VolumeDependencyTests-2088975607 None] Lock "cinder-2f5d1243-9352-4475-9f83-a54045277428-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:25:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ddbbc05a-a1a6-4ea4-b047-ddcb71efa628 tempest-VolumeDependencyTests-2088975607 None] Acquiring lock "cinder-quobyte-2f5d1243-9352-4475-9f83-a54045277428" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:25:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ddbbc05a-a1a6-4ea4-b047-ddcb71efa628 tempest-VolumeDependencyTests-2088975607 None] Lock "cinder-quobyte-2f5d1243-9352-4475-9f83-a54045277428" acquired by "delete_volume" :: waited 0.016s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:25:12 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8f1b3b-86b2-4539-9d5b-97c5a2323788]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:25:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ddbbc05a-a1a6-4ea4-b047-ddcb71efa628 tempest-VolumeDependencyTests-2088975607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-2f5d1243-9352-4475-9f83-a54045277428 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:12 devstack sudo[104059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-2f5d1243-9352-4475-9f83-a54045277428
Nov 05 19:25:12 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:12 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ddbbc05a-a1a6-4ea4-b047-ddcb71efa628 tempest-VolumeDependencyTests-2088975607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-2f5d1243-9352-4475-9f83-a54045277428" returned: 0 in 0.351s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ddbbc05a-a1a6-4ea4-b047-ddcb71efa628 tempest-VolumeDependencyTests-2088975607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-2f5d1243-9352-4475-9f83-a54045277428 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:12 devstack sudo[104064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-2f5d1243-9352-4475-9f83-a54045277428
Nov 05 19:25:12 devstack sudo[104064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:13 devstack sudo[104064]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ddbbc05a-a1a6-4ea4-b047-ddcb71efa628 tempest-VolumeDependencyTests-2088975607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-2f5d1243-9352-4475-9f83-a54045277428" returned: 0 in 0.256s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ddbbc05a-a1a6-4ea4-b047-ddcb71efa628 tempest-VolumeDependencyTests-2088975607 None] Lock "cinder-quobyte-2f5d1243-9352-4475-9f83-a54045277428" released by "delete_volume" :: held 0.647s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:25:13 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-ddbbc05a-a1a6-4ea4-b047-ddcb71efa628 tempest-VolumeDependencyTests-2088975607 None] Created reservations ['b197e8b7-19f6-4e0d-bcd9-a3ca40e0a2c6', 'd579f809-3031-47fb-a77f-630330124d28', 'db77b1ae-8386-4cb1-9211-e8573dc3a2ae', '96a97d48-dfb8-4605-8d4a-38a88487919a'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:25:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ddbbc05a-a1a6-4ea4-b047-ddcb71efa628 tempest-VolumeDependencyTests-2088975607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:25:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ddbbc05a-a1a6-4ea4-b047-ddcb71efa628 tempest-VolumeDependencyTests-2088975607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:25:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ddbbc05a-a1a6-4ea4-b047-ddcb71efa628 tempest-VolumeDependencyTests-2088975607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:25:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ddbbc05a-a1a6-4ea4-b047-ddcb71efa628 tempest-VolumeDependencyTests-2088975607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:25:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ddbbc05a-a1a6-4ea4-b047-ddcb71efa628 tempest-VolumeDependencyTests-2088975607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:25:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ddbbc05a-a1a6-4ea4-b047-ddcb71efa628 tempest-VolumeDependencyTests-2088975607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:13 devstack sudo[104067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:25:13 devstack sudo[104067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:13 devstack sudo[104067]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ddbbc05a-a1a6-4ea4-b047-ddcb71efa628 tempest-VolumeDependencyTests-2088975607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.229s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:13 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-ddbbc05a-a1a6-4ea4-b047-ddcb71efa628 tempest-VolumeDependencyTests-2088975607 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:25:13 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-ddbbc05a-a1a6-4ea4-b047-ddcb71efa628 tempest-VolumeDependencyTests-2088975607 None] Deleted volume successfully.
Nov 05 19:25:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ddbbc05a-a1a6-4ea4-b047-ddcb71efa628 tempest-VolumeDependencyTests-2088975607 None] Lock "cinder-2f5d1243-9352-4475-9f83-a54045277428-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:25:16 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cb22ae2-f706-4267-8a95-3fdeae1f2080 tempest-ProjectReaderTests-149642154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:25:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1cb22ae2-f706-4267-8a95-3fdeae1f2080 tempest-ProjectReaderTests-149642154 None] Flow 'volume_create_manager' (e5b0d74c-7053-4f8a-8229-dec20123867a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:25:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1cb22ae2-f706-4267-8a95-3fdeae1f2080 tempest-ProjectReaderTests-149642154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a8ae6b2-892c-4ffe-a352-858d39479d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:25:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1cb22ae2-f706-4267-8a95-3fdeae1f2080 tempest-ProjectReaderTests-149642154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a8ae6b2-892c-4ffe-a352-858d39479d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-722472486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=949e04e3-ec09-4bed-bfab-3a92c728da1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de11db0982164252bbb7d7eb9799c66c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:25:17Z,use_quota=True,user_id='7e6563f78b0041fb91d949077c80b4e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:25:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1cb22ae2-f706-4267-8a95-3fdeae1f2080 tempest-ProjectReaderTests-149642154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e24918f-a2fd-49b9-bd25-7e54958e59d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:25:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1cb22ae2-f706-4267-8a95-3fdeae1f2080 tempest-ProjectReaderTests-149642154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e24918f-a2fd-49b9-bd25-7e54958e59d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:25:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1cb22ae2-f706-4267-8a95-3fdeae1f2080 tempest-ProjectReaderTests-149642154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (731f2688-ff3a-41f5-9407-c2c22080bfc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:25:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1cb22ae2-f706-4267-8a95-3fdeae1f2080 tempest-ProjectReaderTests-149642154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (731f2688-ff3a-41f5-9407-c2c22080bfc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '949e04e3-ec09-4bed-bfab-3a92c728da1e', 'volume_name': 'volume-949e04e3-ec09-4bed-bfab-3a92c728da1e', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:25:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1cb22ae2-f706-4267-8a95-3fdeae1f2080 tempest-ProjectReaderTests-149642154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (656041e7-9aa7-4a01-aa0d-2e4b5b448102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:25:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1cb22ae2-f706-4267-8a95-3fdeae1f2080 tempest-ProjectReaderTests-149642154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (656041e7-9aa7-4a01-aa0d-2e4b5b448102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:25:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1cb22ae2-f706-4267-8a95-3fdeae1f2080 tempest-ProjectReaderTests-149642154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b304798e-2c00-4bde-bf89-09948ff9e807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:25:16 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-1cb22ae2-f706-4267-8a95-3fdeae1f2080 tempest-ProjectReaderTests-149642154 None] Volume 949e04e3-ec09-4bed-bfab-3a92c728da1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-949e04e3-ec09-4bed-bfab-3a92c728da1e', 'volume_size': 1}
Nov 05 19:25:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1cb22ae2-f706-4267-8a95-3fdeae1f2080 tempest-ProjectReaderTests-149642154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:25:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1cb22ae2-f706-4267-8a95-3fdeae1f2080 tempest-ProjectReaderTests-149642154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:25:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1cb22ae2-f706-4267-8a95-3fdeae1f2080 tempest-ProjectReaderTests-149642154 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-722472486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=949e04e3-ec09-4bed-bfab-3a92c728da1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de11db0982164252bbb7d7eb9799c66c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:25:17Z,use_quota=True,user_id='7e6563f78b0041fb91d949077c80b4e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:25:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-1cb22ae2-f706-4267-8a95-3fdeae1f2080 tempest-ProjectReaderTests-149642154 None] Creating volume 949e04e3-ec09-4bed-bfab-3a92c728da1e {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:25:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1cb22ae2-f706-4267-8a95-3fdeae1f2080 tempest-ProjectReaderTests-149642154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:25:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1cb22ae2-f706-4267-8a95-3fdeae1f2080 tempest-ProjectReaderTests-149642154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:25:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1cb22ae2-f706-4267-8a95-3fdeae1f2080 tempest-ProjectReaderTests-149642154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:25:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1cb22ae2-f706-4267-8a95-3fdeae1f2080 tempest-ProjectReaderTests-149642154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:25:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1cb22ae2-f706-4267-8a95-3fdeae1f2080 tempest-ProjectReaderTests-149642154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:25:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1cb22ae2-f706-4267-8a95-3fdeae1f2080 tempest-ProjectReaderTests-149642154 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:25:16 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-1cb22ae2-f706-4267-8a95-3fdeae1f2080 tempest-ProjectReaderTests-149642154 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:25:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1cb22ae2-f706-4267-8a95-3fdeae1f2080 tempest-ProjectReaderTests-149642154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-949e04e3-ec09-4bed-bfab-3a92c728da1e 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:16 devstack sudo[104070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-949e04e3-ec09-4bed-bfab-3a92c728da1e 1073741824
Nov 05 19:25:16 devstack sudo[104070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:17 devstack sudo[104070]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1cb22ae2-f706-4267-8a95-3fdeae1f2080 tempest-ProjectReaderTests-149642154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-949e04e3-ec09-4bed-bfab-3a92c728da1e 1073741824" returned: 0 in 0.414s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1cb22ae2-f706-4267-8a95-3fdeae1f2080 tempest-ProjectReaderTests-149642154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-949e04e3-ec09-4bed-bfab-3a92c728da1e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:17 devstack sudo[104075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-949e04e3-ec09-4bed-bfab-3a92c728da1e
Nov 05 19:25:17 devstack sudo[104075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:17 devstack sudo[104075]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1cb22ae2-f706-4267-8a95-3fdeae1f2080 tempest-ProjectReaderTests-149642154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-949e04e3-ec09-4bed-bfab-3a92c728da1e" returned: 0 in 0.247s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1cb22ae2-f706-4267-8a95-3fdeae1f2080 tempest-ProjectReaderTests-149642154 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:25:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1cb22ae2-f706-4267-8a95-3fdeae1f2080 tempest-ProjectReaderTests-149642154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:25:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1cb22ae2-f706-4267-8a95-3fdeae1f2080 tempest-ProjectReaderTests-149642154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b304798e-2c00-4bde-bf89-09948ff9e807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-949e04e3-ec09-4bed-bfab-3a92c728da1e', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:25:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1cb22ae2-f706-4267-8a95-3fdeae1f2080 tempest-ProjectReaderTests-149642154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d582e06-325e-4d30-b836-7d0ad7631653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:25:17 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-1cb22ae2-f706-4267-8a95-3fdeae1f2080 tempest-ProjectReaderTests-149642154 None] Volume volume-949e04e3-ec09-4bed-bfab-3a92c728da1e (949e04e3-ec09-4bed-bfab-3a92c728da1e): created successfully
Nov 05 19:25:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1cb22ae2-f706-4267-8a95-3fdeae1f2080 tempest-ProjectReaderTests-149642154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d582e06-325e-4d30-b836-7d0ad7631653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:25:17 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1cb22ae2-f706-4267-8a95-3fdeae1f2080 tempest-ProjectReaderTests-149642154 None] Flow 'volume_create_manager' (e5b0d74c-7053-4f8a-8229-dec20123867a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:25:17 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-1cb22ae2-f706-4267-8a95-3fdeae1f2080 tempest-ProjectReaderTests-149642154 None] Created volume successfully.
Nov 05 19:25:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-baa9cee9-7e1e-49da-953f-4d3c533dd2c2 tempest-ProjectReaderTests-149642154 None] Acquiring lock "cinder-949e04e3-ec09-4bed-bfab-3a92c728da1e-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:25:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-baa9cee9-7e1e-49da-953f-4d3c533dd2c2 tempest-ProjectReaderTests-149642154 None] Lock "cinder-949e04e3-ec09-4bed-bfab-3a92c728da1e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:25:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-baa9cee9-7e1e-49da-953f-4d3c533dd2c2 tempest-ProjectReaderTests-149642154 None] Acquiring lock "cinder-quobyte-949e04e3-ec09-4bed-bfab-3a92c728da1e" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:25:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-baa9cee9-7e1e-49da-953f-4d3c533dd2c2 tempest-ProjectReaderTests-149642154 None] Lock "cinder-quobyte-949e04e3-ec09-4bed-bfab-3a92c728da1e" acquired by "delete_volume" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:25:18 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9e2c14-500f-4184-8644-7d49af626bd6]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:25:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-baa9cee9-7e1e-49da-953f-4d3c533dd2c2 tempest-ProjectReaderTests-149642154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-949e04e3-ec09-4bed-bfab-3a92c728da1e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:18 devstack sudo[104079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-949e04e3-ec09-4bed-bfab-3a92c728da1e
Nov 05 19:25:18 devstack sudo[104079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:18 devstack sudo[104079]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-baa9cee9-7e1e-49da-953f-4d3c533dd2c2 tempest-ProjectReaderTests-149642154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-949e04e3-ec09-4bed-bfab-3a92c728da1e" returned: 0 in 0.343s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-baa9cee9-7e1e-49da-953f-4d3c533dd2c2 tempest-ProjectReaderTests-149642154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-949e04e3-ec09-4bed-bfab-3a92c728da1e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:18 devstack sudo[104084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-949e04e3-ec09-4bed-bfab-3a92c728da1e
Nov 05 19:25:18 devstack sudo[104084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:18 devstack sudo[104084]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-baa9cee9-7e1e-49da-953f-4d3c533dd2c2 tempest-ProjectReaderTests-149642154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-949e04e3-ec09-4bed-bfab-3a92c728da1e" returned: 0 in 0.248s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-baa9cee9-7e1e-49da-953f-4d3c533dd2c2 tempest-ProjectReaderTests-149642154 None] Lock "cinder-quobyte-949e04e3-ec09-4bed-bfab-3a92c728da1e" released by "delete_volume" :: held 0.631s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:25:18 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-baa9cee9-7e1e-49da-953f-4d3c533dd2c2 tempest-ProjectReaderTests-149642154 None] Created reservations ['c24ecf04-d18c-4c58-8932-8d8fa6fd4bae', '896015ec-56cc-4a99-a8ea-ca47fde11343', 'cf79cdab-9672-4883-b634-b567ce8b88f7', '88b9721d-789a-4481-a8a7-60df73ecad0a'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:25:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-baa9cee9-7e1e-49da-953f-4d3c533dd2c2 tempest-ProjectReaderTests-149642154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:25:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-baa9cee9-7e1e-49da-953f-4d3c533dd2c2 tempest-ProjectReaderTests-149642154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:25:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-baa9cee9-7e1e-49da-953f-4d3c533dd2c2 tempest-ProjectReaderTests-149642154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:25:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-baa9cee9-7e1e-49da-953f-4d3c533dd2c2 tempest-ProjectReaderTests-149642154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:25:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-baa9cee9-7e1e-49da-953f-4d3c533dd2c2 tempest-ProjectReaderTests-149642154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:25:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-baa9cee9-7e1e-49da-953f-4d3c533dd2c2 tempest-ProjectReaderTests-149642154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:18 devstack sudo[104087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:25:18 devstack sudo[104087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:18 devstack sudo[104087]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-baa9cee9-7e1e-49da-953f-4d3c533dd2c2 tempest-ProjectReaderTests-149642154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.233s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:18 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-baa9cee9-7e1e-49da-953f-4d3c533dd2c2 tempest-ProjectReaderTests-149642154 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:25:18 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-baa9cee9-7e1e-49da-953f-4d3c533dd2c2 tempest-ProjectReaderTests-149642154 None] Deleted volume successfully.
Nov 05 19:25:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-baa9cee9-7e1e-49da-953f-4d3c533dd2c2 tempest-ProjectReaderTests-149642154 None] Lock "cinder-949e04e3-ec09-4bed-bfab-3a92c728da1e-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:25:19 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-d937ebca-034d-49a7-bd3f-251f33f49ce0 tempest-ProjectReaderTests-149642154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:25:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d937ebca-034d-49a7-bd3f-251f33f49ce0 tempest-ProjectReaderTests-149642154 None] Flow 'volume_create_manager' (ba64678f-5350-447d-9ce9-c69d750031e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:25:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d937ebca-034d-49a7-bd3f-251f33f49ce0 tempest-ProjectReaderTests-149642154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90e996f1-40cd-462a-b501-eb951968c2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:25:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d937ebca-034d-49a7-bd3f-251f33f49ce0 tempest-ProjectReaderTests-149642154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90e996f1-40cd-462a-b501-eb951968c2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-850246864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb12343a-836b-43c1-b52d-d6e4ebfcdc11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de11db0982164252bbb7d7eb9799c66c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:25:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:25:19Z,use_quota=True,user_id='7e6563f78b0041fb91d949077c80b4e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:25:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d937ebca-034d-49a7-bd3f-251f33f49ce0 tempest-ProjectReaderTests-149642154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b472b91f-f6ce-4a27-9d49-308be4a55278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:25:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d937ebca-034d-49a7-bd3f-251f33f49ce0 tempest-ProjectReaderTests-149642154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b472b91f-f6ce-4a27-9d49-308be4a55278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:25:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d937ebca-034d-49a7-bd3f-251f33f49ce0 tempest-ProjectReaderTests-149642154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08814c73-e4c1-4df9-b59f-5dcca10f684c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:25:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d937ebca-034d-49a7-bd3f-251f33f49ce0 tempest-ProjectReaderTests-149642154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08814c73-e4c1-4df9-b59f-5dcca10f684c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb12343a-836b-43c1-b52d-d6e4ebfcdc11', 'volume_name': 'volume-cb12343a-836b-43c1-b52d-d6e4ebfcdc11', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:25:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d937ebca-034d-49a7-bd3f-251f33f49ce0 tempest-ProjectReaderTests-149642154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d48e38-35ee-46f0-b56b-d0a5bb03f5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:25:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d937ebca-034d-49a7-bd3f-251f33f49ce0 tempest-ProjectReaderTests-149642154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d48e38-35ee-46f0-b56b-d0a5bb03f5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:25:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d937ebca-034d-49a7-bd3f-251f33f49ce0 tempest-ProjectReaderTests-149642154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf44b92-56b2-43aa-a975-004fec5f2386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:25:19 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-d937ebca-034d-49a7-bd3f-251f33f49ce0 tempest-ProjectReaderTests-149642154 None] Volume cb12343a-836b-43c1-b52d-d6e4ebfcdc11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb12343a-836b-43c1-b52d-d6e4ebfcdc11', 'volume_size': 1}
Nov 05 19:25:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d937ebca-034d-49a7-bd3f-251f33f49ce0 tempest-ProjectReaderTests-149642154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:25:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d937ebca-034d-49a7-bd3f-251f33f49ce0 tempest-ProjectReaderTests-149642154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:25:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d937ebca-034d-49a7-bd3f-251f33f49ce0 tempest-ProjectReaderTests-149642154 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-850246864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb12343a-836b-43c1-b52d-d6e4ebfcdc11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de11db0982164252bbb7d7eb9799c66c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:25:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:25:19Z,use_quota=True,user_id='7e6563f78b0041fb91d949077c80b4e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:25:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-d937ebca-034d-49a7-bd3f-251f33f49ce0 tempest-ProjectReaderTests-149642154 None] Creating volume cb12343a-836b-43c1-b52d-d6e4ebfcdc11 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:25:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d937ebca-034d-49a7-bd3f-251f33f49ce0 tempest-ProjectReaderTests-149642154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:25:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d937ebca-034d-49a7-bd3f-251f33f49ce0 tempest-ProjectReaderTests-149642154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:25:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d937ebca-034d-49a7-bd3f-251f33f49ce0 tempest-ProjectReaderTests-149642154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:25:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d937ebca-034d-49a7-bd3f-251f33f49ce0 tempest-ProjectReaderTests-149642154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:25:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d937ebca-034d-49a7-bd3f-251f33f49ce0 tempest-ProjectReaderTests-149642154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:25:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d937ebca-034d-49a7-bd3f-251f33f49ce0 tempest-ProjectReaderTests-149642154 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:25:19 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-d937ebca-034d-49a7-bd3f-251f33f49ce0 tempest-ProjectReaderTests-149642154 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:25:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d937ebca-034d-49a7-bd3f-251f33f49ce0 tempest-ProjectReaderTests-149642154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb12343a-836b-43c1-b52d-d6e4ebfcdc11 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:19 devstack sudo[104090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb12343a-836b-43c1-b52d-d6e4ebfcdc11 1073741824
Nov 05 19:25:19 devstack sudo[104090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:19 devstack sudo[104090]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d937ebca-034d-49a7-bd3f-251f33f49ce0 tempest-ProjectReaderTests-149642154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb12343a-836b-43c1-b52d-d6e4ebfcdc11 1073741824" returned: 0 in 0.400s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d937ebca-034d-49a7-bd3f-251f33f49ce0 tempest-ProjectReaderTests-149642154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb12343a-836b-43c1-b52d-d6e4ebfcdc11 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:20 devstack sudo[104096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb12343a-836b-43c1-b52d-d6e4ebfcdc11
Nov 05 19:25:20 devstack sudo[104096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:20 devstack sudo[104096]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d937ebca-034d-49a7-bd3f-251f33f49ce0 tempest-ProjectReaderTests-149642154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb12343a-836b-43c1-b52d-d6e4ebfcdc11" returned: 0 in 0.239s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d937ebca-034d-49a7-bd3f-251f33f49ce0 tempest-ProjectReaderTests-149642154 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:25:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d937ebca-034d-49a7-bd3f-251f33f49ce0 tempest-ProjectReaderTests-149642154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:25:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d937ebca-034d-49a7-bd3f-251f33f49ce0 tempest-ProjectReaderTests-149642154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf44b92-56b2-43aa-a975-004fec5f2386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb12343a-836b-43c1-b52d-d6e4ebfcdc11', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:25:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d937ebca-034d-49a7-bd3f-251f33f49ce0 tempest-ProjectReaderTests-149642154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c87e9b89-cdc6-4757-b1cb-c60caf93853c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:25:20 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-d937ebca-034d-49a7-bd3f-251f33f49ce0 tempest-ProjectReaderTests-149642154 None] Volume volume-cb12343a-836b-43c1-b52d-d6e4ebfcdc11 (cb12343a-836b-43c1-b52d-d6e4ebfcdc11): created successfully
Nov 05 19:25:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d937ebca-034d-49a7-bd3f-251f33f49ce0 tempest-ProjectReaderTests-149642154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c87e9b89-cdc6-4757-b1cb-c60caf93853c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:25:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d937ebca-034d-49a7-bd3f-251f33f49ce0 tempest-ProjectReaderTests-149642154 None] Flow 'volume_create_manager' (ba64678f-5350-447d-9ce9-c69d750031e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:25:20 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-d937ebca-034d-49a7-bd3f-251f33f49ce0 tempest-ProjectReaderTests-149642154 None] Created volume successfully.
Nov 05 19:25:20 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4851da4c-d9d7-4692-8d09-b09a3422b897 tempest-ProjectReaderTests-149642154 None] Acquiring lock "cinder-cb12343a-836b-43c1-b52d-d6e4ebfcdc11-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:25:20 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4851da4c-d9d7-4692-8d09-b09a3422b897 tempest-ProjectReaderTests-149642154 None] Lock "cinder-cb12343a-836b-43c1-b52d-d6e4ebfcdc11-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:25:20 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4851da4c-d9d7-4692-8d09-b09a3422b897 tempest-ProjectReaderTests-149642154 None] Acquiring lock "cinder-quobyte-cb12343a-836b-43c1-b52d-d6e4ebfcdc11" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:25:20 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4851da4c-d9d7-4692-8d09-b09a3422b897 tempest-ProjectReaderTests-149642154 None] Lock "cinder-quobyte-cb12343a-836b-43c1-b52d-d6e4ebfcdc11" acquired by "delete_volume" :: waited 0.013s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:25:20 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8496b4a-2100-4c62-95db-21fb918be7b5]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:25:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4851da4c-d9d7-4692-8d09-b09a3422b897 tempest-ProjectReaderTests-149642154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb12343a-836b-43c1-b52d-d6e4ebfcdc11 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:20 devstack sudo[104099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb12343a-836b-43c1-b52d-d6e4ebfcdc11
Nov 05 19:25:20 devstack sudo[104099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:20 devstack sudo[104099]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4851da4c-d9d7-4692-8d09-b09a3422b897 tempest-ProjectReaderTests-149642154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb12343a-836b-43c1-b52d-d6e4ebfcdc11" returned: 0 in 0.347s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4851da4c-d9d7-4692-8d09-b09a3422b897 tempest-ProjectReaderTests-149642154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb12343a-836b-43c1-b52d-d6e4ebfcdc11 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:21 devstack sudo[104104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb12343a-836b-43c1-b52d-d6e4ebfcdc11
Nov 05 19:25:21 devstack sudo[104104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:21 devstack sudo[104104]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4851da4c-d9d7-4692-8d09-b09a3422b897 tempest-ProjectReaderTests-149642154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-cb12343a-836b-43c1-b52d-d6e4ebfcdc11" returned: 0 in 0.253s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4851da4c-d9d7-4692-8d09-b09a3422b897 tempest-ProjectReaderTests-149642154 None] Lock "cinder-quobyte-cb12343a-836b-43c1-b52d-d6e4ebfcdc11" released by "delete_volume" :: held 0.638s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:25:21 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-4851da4c-d9d7-4692-8d09-b09a3422b897 tempest-ProjectReaderTests-149642154 None] Created reservations ['729dba27-3e42-4533-b7ae-756d705f8386', '5c62cbb8-db9b-472e-8a31-cf2f12a67992', '2ef2599a-336e-4a57-b7cc-8ff1a4b0200d', '86ec684a-42b6-446a-b5d0-99531a7f8a8c'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:25:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4851da4c-d9d7-4692-8d09-b09a3422b897 tempest-ProjectReaderTests-149642154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:25:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4851da4c-d9d7-4692-8d09-b09a3422b897 tempest-ProjectReaderTests-149642154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:25:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4851da4c-d9d7-4692-8d09-b09a3422b897 tempest-ProjectReaderTests-149642154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:25:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4851da4c-d9d7-4692-8d09-b09a3422b897 tempest-ProjectReaderTests-149642154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:25:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4851da4c-d9d7-4692-8d09-b09a3422b897 tempest-ProjectReaderTests-149642154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:25:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4851da4c-d9d7-4692-8d09-b09a3422b897 tempest-ProjectReaderTests-149642154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:21 devstack sudo[104107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:25:21 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:21 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4851da4c-d9d7-4692-8d09-b09a3422b897 tempest-ProjectReaderTests-149642154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.235s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:21 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-4851da4c-d9d7-4692-8d09-b09a3422b897 tempest-ProjectReaderTests-149642154 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:25:21 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-4851da4c-d9d7-4692-8d09-b09a3422b897 tempest-ProjectReaderTests-149642154 None] Deleted volume successfully.
Nov 05 19:25:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4851da4c-d9d7-4692-8d09-b09a3422b897 tempest-ProjectReaderTests-149642154 None] Lock "cinder-cb12343a-836b-43c1-b52d-d6e4ebfcdc11-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:25:31 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=90,cinder:UPDATE=135,cinder:INSERT=30,cinder:DELETE=9 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:25:31 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:UPDATE=113,cinder:SELECT=89,cinder:INSERT=30,cinder:DELETE=13 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:25:45 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=1 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:25:45 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:UPDATE=1 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:25:46 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fa4561d-2c8d-4229-9b00-9423ea5246d9 tempest-SnapshotDependencyTests-1711286615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:25:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2fa4561d-2c8d-4229-9b00-9423ea5246d9 tempest-SnapshotDependencyTests-1711286615 None] Flow 'volume_create_manager' (4f9bec6e-d30d-4f24-ac4b-e6499e6ddf6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:25:46 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2fa4561d-2c8d-4229-9b00-9423ea5246d9 tempest-SnapshotDependencyTests-1711286615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdb35de9-f900-4c2b-995f-cae6a98b5174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:25:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2fa4561d-2c8d-4229-9b00-9423ea5246d9 tempest-SnapshotDependencyTests-1711286615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdb35de9-f900-4c2b-995f-cae6a98b5174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1447430390',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97b45ccc-a609-40ef-a5b7-da09a5e755f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71cfe8e0808749c087885e9ad1fbc59b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:25:47Z,use_quota=True,user_id='292000e367124c298a64837fda47123d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:25:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2fa4561d-2c8d-4229-9b00-9423ea5246d9 tempest-SnapshotDependencyTests-1711286615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27d28ae3-30e7-48a6-b3af-e75862c619dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:25:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2fa4561d-2c8d-4229-9b00-9423ea5246d9 tempest-SnapshotDependencyTests-1711286615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27d28ae3-30e7-48a6-b3af-e75862c619dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:25:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2fa4561d-2c8d-4229-9b00-9423ea5246d9 tempest-SnapshotDependencyTests-1711286615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d5ab1ad-e0f1-45ef-ab09-85b878402d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:25:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2fa4561d-2c8d-4229-9b00-9423ea5246d9 tempest-SnapshotDependencyTests-1711286615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d5ab1ad-e0f1-45ef-ab09-85b878402d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97b45ccc-a609-40ef-a5b7-da09a5e755f0', 'volume_name': 'volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:25:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2fa4561d-2c8d-4229-9b00-9423ea5246d9 tempest-SnapshotDependencyTests-1711286615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5db35ce1-0d15-413e-95db-d5e81d6fe65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:25:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2fa4561d-2c8d-4229-9b00-9423ea5246d9 tempest-SnapshotDependencyTests-1711286615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5db35ce1-0d15-413e-95db-d5e81d6fe65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:25:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2fa4561d-2c8d-4229-9b00-9423ea5246d9 tempest-SnapshotDependencyTests-1711286615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3c2a257-3289-4965-9b01-3e0cd0c91c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:25:47 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-2fa4561d-2c8d-4229-9b00-9423ea5246d9 tempest-SnapshotDependencyTests-1711286615 None] Volume 97b45ccc-a609-40ef-a5b7-da09a5e755f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0', 'volume_size': 1}
Nov 05 19:25:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2fa4561d-2c8d-4229-9b00-9423ea5246d9 tempest-SnapshotDependencyTests-1711286615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:25:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2fa4561d-2c8d-4229-9b00-9423ea5246d9 tempest-SnapshotDependencyTests-1711286615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:25:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2fa4561d-2c8d-4229-9b00-9423ea5246d9 tempest-SnapshotDependencyTests-1711286615 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1447430390',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97b45ccc-a609-40ef-a5b7-da09a5e755f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71cfe8e0808749c087885e9ad1fbc59b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:25:47Z,use_quota=True,user_id='292000e367124c298a64837fda47123d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:25:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-2fa4561d-2c8d-4229-9b00-9423ea5246d9 tempest-SnapshotDependencyTests-1711286615 None] Creating volume 97b45ccc-a609-40ef-a5b7-da09a5e755f0 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:25:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2fa4561d-2c8d-4229-9b00-9423ea5246d9 tempest-SnapshotDependencyTests-1711286615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:25:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2fa4561d-2c8d-4229-9b00-9423ea5246d9 tempest-SnapshotDependencyTests-1711286615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:25:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2fa4561d-2c8d-4229-9b00-9423ea5246d9 tempest-SnapshotDependencyTests-1711286615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:25:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2fa4561d-2c8d-4229-9b00-9423ea5246d9 tempest-SnapshotDependencyTests-1711286615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:25:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2fa4561d-2c8d-4229-9b00-9423ea5246d9 tempest-SnapshotDependencyTests-1711286615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:25:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2fa4561d-2c8d-4229-9b00-9423ea5246d9 tempest-SnapshotDependencyTests-1711286615 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:25:47 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-2fa4561d-2c8d-4229-9b00-9423ea5246d9 tempest-SnapshotDependencyTests-1711286615 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:25:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2fa4561d-2c8d-4229-9b00-9423ea5246d9 tempest-SnapshotDependencyTests-1711286615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:47 devstack sudo[104544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0 1073741824
Nov 05 19:25:47 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:47 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2fa4561d-2c8d-4229-9b00-9423ea5246d9 tempest-SnapshotDependencyTests-1711286615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0 1073741824" returned: 0 in 0.413s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2fa4561d-2c8d-4229-9b00-9423ea5246d9 tempest-SnapshotDependencyTests-1711286615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:47 devstack sudo[104551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0
Nov 05 19:25:47 devstack sudo[104551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:47 devstack sudo[104551]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2fa4561d-2c8d-4229-9b00-9423ea5246d9 tempest-SnapshotDependencyTests-1711286615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0" returned: 0 in 0.251s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2fa4561d-2c8d-4229-9b00-9423ea5246d9 tempest-SnapshotDependencyTests-1711286615 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:25:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2fa4561d-2c8d-4229-9b00-9423ea5246d9 tempest-SnapshotDependencyTests-1711286615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:25:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2fa4561d-2c8d-4229-9b00-9423ea5246d9 tempest-SnapshotDependencyTests-1711286615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3c2a257-3289-4965-9b01-3e0cd0c91c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:25:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2fa4561d-2c8d-4229-9b00-9423ea5246d9 tempest-SnapshotDependencyTests-1711286615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03115671-e157-488c-b1fa-80187bfd9086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:25:47 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-2fa4561d-2c8d-4229-9b00-9423ea5246d9 tempest-SnapshotDependencyTests-1711286615 None] Volume volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0 (97b45ccc-a609-40ef-a5b7-da09a5e755f0): created successfully
Nov 05 19:25:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2fa4561d-2c8d-4229-9b00-9423ea5246d9 tempest-SnapshotDependencyTests-1711286615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03115671-e157-488c-b1fa-80187bfd9086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:25:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2fa4561d-2c8d-4229-9b00-9423ea5246d9 tempest-SnapshotDependencyTests-1711286615 None] Flow 'volume_create_manager' (4f9bec6e-d30d-4f24-ac4b-e6499e6ddf6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:25:47 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-2fa4561d-2c8d-4229-9b00-9423ea5246d9 tempest-SnapshotDependencyTests-1711286615 None] Created volume successfully.
Nov 05 19:25:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5c2b1fcf-f73c-49d1-9e9a-4edeb9037a6e tempest-SnapshotDependencyTests-1711286615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:25:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5c2b1fcf-f73c-49d1-9e9a-4edeb9037a6e tempest-SnapshotDependencyTests-1711286615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:25:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-5c2b1fcf-f73c-49d1-9e9a-4edeb9037a6e tempest-SnapshotDependencyTests-1711286615 None] Creating offline snapshot 43d83d19-2150-4db9-a976-263b678da220 of volume 97b45ccc-a609-40ef-a5b7-da09a5e755f0 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:25:48 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7c3851-d4c4-4b4d-b4cc-c69814fed033]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:25:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5c2b1fcf-f73c-49d1-9e9a-4edeb9037a6e tempest-SnapshotDependencyTests-1711286615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:48 devstack sudo[104555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0
Nov 05 19:25:48 devstack sudo[104555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:48 devstack sudo[104555]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5c2b1fcf-f73c-49d1-9e9a-4edeb9037a6e tempest-SnapshotDependencyTests-1711286615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0" returned: 0 in 0.360s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5c2b1fcf-f73c-49d1-9e9a-4edeb9037a6e tempest-SnapshotDependencyTests-1711286615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0.43d83d19-2150-4db9-a976-263b678da220 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:48 devstack sudo[104560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0.43d83d19-2150-4db9-a976-263b678da220 1G
Nov 05 19:25:48 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:49 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5c2b1fcf-f73c-49d1-9e9a-4edeb9037a6e tempest-SnapshotDependencyTests-1711286615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0.43d83d19-2150-4db9-a976-263b678da220 1G" returned: 0 in 0.384s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5c2b1fcf-f73c-49d1-9e9a-4edeb9037a6e tempest-SnapshotDependencyTests-1711286615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0.43d83d19-2150-4db9-a976-263b678da220 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:49 devstack sudo[104566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0.43d83d19-2150-4db9-a976-263b678da220
Nov 05 19:25:49 devstack sudo[104566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:49 devstack sudo[104566]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5c2b1fcf-f73c-49d1-9e9a-4edeb9037a6e tempest-SnapshotDependencyTests-1711286615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0.43d83d19-2150-4db9-a976-263b678da220" returned: 0 in 0.286s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:49 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-5c2b1fcf-f73c-49d1-9e9a-4edeb9037a6e tempest-SnapshotDependencyTests-1711286615 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0.43d83d19-2150-4db9-a976-263b678da220 is being set with open permissions: ugo+rw
Nov 05 19:25:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5c2b1fcf-f73c-49d1-9e9a-4edeb9037a6e tempest-SnapshotDependencyTests-1711286615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0.43d83d19-2150-4db9-a976-263b678da220 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:49 devstack sudo[104571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0.43d83d19-2150-4db9-a976-263b678da220
Nov 05 19:25:49 devstack sudo[104571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:49 devstack sudo[104571]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5c2b1fcf-f73c-49d1-9e9a-4edeb9037a6e tempest-SnapshotDependencyTests-1711286615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0.43d83d19-2150-4db9-a976-263b678da220" returned: 0 in 0.236s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5c2b1fcf-f73c-49d1-9e9a-4edeb9037a6e tempest-SnapshotDependencyTests-1711286615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:49 devstack sudo[104574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0.info
Nov 05 19:25:49 devstack sudo[104574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:49 devstack sudo[104574]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5c2b1fcf-f73c-49d1-9e9a-4edeb9037a6e tempest-SnapshotDependencyTests-1711286615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0.info" returned: 0 in 0.247s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:49 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-5c2b1fcf-f73c-49d1-9e9a-4edeb9037a6e tempest-SnapshotDependencyTests-1711286615 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0.info is being set with open permissions: ugo+rw
Nov 05 19:25:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5c2b1fcf-f73c-49d1-9e9a-4edeb9037a6e tempest-SnapshotDependencyTests-1711286615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:49 devstack sudo[104577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0.info
Nov 05 19:25:49 devstack sudo[104577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:50 devstack sudo[104577]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5c2b1fcf-f73c-49d1-9e9a-4edeb9037a6e tempest-SnapshotDependencyTests-1711286615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0.info" returned: 0 in 0.236s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5c2b1fcf-f73c-49d1-9e9a-4edeb9037a6e tempest-SnapshotDependencyTests-1711286615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.833s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:25:50 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-5c2b1fcf-f73c-49d1-9e9a-4edeb9037a6e tempest-SnapshotDependencyTests-1711286615 None] Create snapshot completed successfully
Nov 05 19:25:50 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:25:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Flow 'volume_create_manager' (a87b17ca-9bd1-4112-811e-ac142d0c336f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:25:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf40881-5faf-431c-8034-dfce86dc9cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:25:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf40881-5faf-431c-8034-dfce86dc9cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86820426-88f5-4214-a190-e6821378a26d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71cfe8e0808749c087885e9ad1fbc59b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=43d83d19-2150-4db9-a976-263b678da220,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:25:51Z,use_quota=True,user_id='292000e367124c298a64837fda47123d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:25:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc2d4411-b456-434f-9d9b-1fc95d8bc571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:25:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc2d4411-b456-434f-9d9b-1fc95d8bc571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:25:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c3ae2dc-7967-43b8-919c-62a1c12b85a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:25:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c3ae2dc-7967-43b8-919c-62a1c12b85a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '86820426-88f5-4214-a190-e6821378a26d', 'volume_name': 'volume-86820426-88f5-4214-a190-e6821378a26d', 'volume_size': 1, 'snapshot_id': '43d83d19-2150-4db9-a976-263b678da220'}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:25:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c1da5eb-d0af-4b4e-9627-2c5a64cf75b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:25:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c1da5eb-d0af-4b4e-9627-2c5a64cf75b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:25:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a36207-acbd-483c-84e3-3fc148053ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:25:50 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Volume 86820426-88f5-4214-a190-e6821378a26d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-86820426-88f5-4214-a190-e6821378a26d', 'volume_size': 1, 'snapshot_id': '43d83d19-2150-4db9-a976-263b678da220'}
Nov 05 19:25:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:25:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:25:50 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Acquiring lock "cinder-quobyte-43d83d19-2150-4db9-a976-263b678da220-86820426-88f5-4214-a190-e6821378a26d" by "_create_volume_from_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:25:50 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Lock "cinder-quobyte-43d83d19-2150-4db9-a976-263b678da220-86820426-88f5-4214-a190-e6821378a26d" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:25:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Creating volume 86820426-88f5-4214-a190-e6821378a26d from snapshot 43d83d19-2150-4db9-a976-263b678da220 {{(pid=87184) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 19:25:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:25:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:25:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:25:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:25:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:25:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:25:50 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Acquiring lock "cinder-quobyte-86820426-88f5-4214-a190-e6821378a26d" by "_copy_volume_from_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:25:50 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Lock "cinder-quobyte-86820426-88f5-4214-a190-e6821378a26d" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:25:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] snapshot: 43d83d19-2150-4db9-a976-263b678da220, volume: 86820426-88f5-4214-a190-e6821378a26d,  {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 19:25:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:25:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:25:51 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:25:51 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:25:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:25:51 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c396db4-d2a4-4dc7-bc46-5606558f530e]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:25:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0.43d83d19-2150-4db9-a976-263b678da220 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:51 devstack sudo[104580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0.43d83d19-2150-4db9-a976-263b678da220
Nov 05 19:25:51 devstack sudo[104580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:51 devstack sudo[104580]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0.43d83d19-2150-4db9-a976-263b678da220" returned: 0 in 0.360s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:51 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:25:51 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[265610c4-080d-4f8b-a310-b16f28a8f229]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:25:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:51 devstack sudo[104585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0
Nov 05 19:25:51 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:51 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0" returned: 0 in 0.351s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:51 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0 {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 19:25:51 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Creating direct copy from snapshot {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 19:25:51 devstack cinder-volume[87184]: DEBUG cinder.utils [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Path /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-86820426-88f5-4214-a190-e6821378a26d not found in is_blk_device check {{(pid=87184) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 19:25:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-86820426-88f5-4214-a190-e6821378a26d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:51 devstack sudo[104590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-86820426-88f5-4214-a190-e6821378a26d
Nov 05 19:25:51 devstack sudo[104590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:57 devstack sudo[104590]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-86820426-88f5-4214-a190-e6821378a26d" returned: 0 in 5.848s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:57 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Image conversion details: src /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0, size 1024.00 MB, duration 5.85 sec, destination /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-86820426-88f5-4214-a190-e6821378a26d {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 19:25:57 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Converted 1024.00 MB image at 175.07 MB/s
Nov 05 19:25:57 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-86820426-88f5-4214-a190-e6821378a26d is being set with open permissions: ugo+rw
Nov 05 19:25:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-86820426-88f5-4214-a190-e6821378a26d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:57 devstack sudo[104641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-86820426-88f5-4214-a190-e6821378a26d
Nov 05 19:25:57 devstack sudo[104641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:57 devstack sudo[104641]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-86820426-88f5-4214-a190-e6821378a26d" returned: 0 in 0.235s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:57 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Lock "cinder-quobyte-86820426-88f5-4214-a190-e6821378a26d" released by "_copy_volume_from_snapshot" :: held 6.869s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:25:57 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Lock "cinder-quobyte-43d83d19-2150-4db9-a976-263b678da220-86820426-88f5-4214-a190-e6821378a26d" released by "_create_volume_from_snapshot" :: held 6.923s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:25:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.938s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:25:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a36207-acbd-483c-84e3-3fc148053ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86820426-88f5-4214-a190-e6821378a26d', 'volume_size': 1, 'snapshot_id': '43d83d19-2150-4db9-a976-263b678da220'}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:25:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bdb3a9b-89ad-4cfd-a40a-15b4830bd5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:25:57 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Volume volume-86820426-88f5-4214-a190-e6821378a26d (86820426-88f5-4214-a190-e6821378a26d): created successfully
Nov 05 19:25:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bdb3a9b-89ad-4cfd-a40a-15b4830bd5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:25:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Flow 'volume_create_manager' (a87b17ca-9bd1-4112-811e-ac142d0c336f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:25:57 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-2a1461fb-14dd-4a37-ac02-6481576133f6 tempest-SnapshotDependencyTests-1711286615 None] Created volume successfully.
Nov 05 19:25:58 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-db48bda8-8018-411a-b9ae-e0e7dd1ee8ce tempest-SnapshotDependencyTests-1711286615 None] Acquiring lock "cinder-43d83d19-2150-4db9-a976-263b678da220-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:25:58 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-db48bda8-8018-411a-b9ae-e0e7dd1ee8ce tempest-SnapshotDependencyTests-1711286615 None] Lock "cinder-43d83d19-2150-4db9-a976-263b678da220-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:25:58 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-db48bda8-8018-411a-b9ae-e0e7dd1ee8ce tempest-SnapshotDependencyTests-1711286615 None] Acquiring lock "cinder-quobyte-97b45ccc-a609-40ef-a5b7-da09a5e755f0" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:25:58 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-db48bda8-8018-411a-b9ae-e0e7dd1ee8ce tempest-SnapshotDependencyTests-1711286615 None] Lock "cinder-quobyte-97b45ccc-a609-40ef-a5b7-da09a5e755f0" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:25:58 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-db48bda8-8018-411a-b9ae-e0e7dd1ee8ce tempest-SnapshotDependencyTests-1711286615 None] Acquiring lock "cinder-quobyte-43d83d19-2150-4db9-a976-263b678da220" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:25:58 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-db48bda8-8018-411a-b9ae-e0e7dd1ee8ce tempest-SnapshotDependencyTests-1711286615 None] Lock "cinder-quobyte-43d83d19-2150-4db9-a976-263b678da220" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:25:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-db48bda8-8018-411a-b9ae-e0e7dd1ee8ce tempest-SnapshotDependencyTests-1711286615 None] Deleting offline snapshot 43d83d19-2150-4db9-a976-263b678da220 of volume 97b45ccc-a609-40ef-a5b7-da09a5e755f0 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:25:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-db48bda8-8018-411a-b9ae-e0e7dd1ee8ce tempest-SnapshotDependencyTests-1711286615 None] snapshot_file for this snap is: volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0.43d83d19-2150-4db9-a976-263b678da220 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:25:58 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f25282b-3752-45f9-85b4-dfa19a9f1f07]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:25:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-db48bda8-8018-411a-b9ae-e0e7dd1ee8ce tempest-SnapshotDependencyTests-1711286615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0.43d83d19-2150-4db9-a976-263b678da220 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:58 devstack sudo[104644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0.43d83d19-2150-4db9-a976-263b678da220
Nov 05 19:25:58 devstack sudo[104644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:58 devstack sudo[104644]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-db48bda8-8018-411a-b9ae-e0e7dd1ee8ce tempest-SnapshotDependencyTests-1711286615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0.43d83d19-2150-4db9-a976-263b678da220" returned: 0 in 0.359s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-db48bda8-8018-411a-b9ae-e0e7dd1ee8ce tempest-SnapshotDependencyTests-1711286615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:25:58 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a7e5a9-5bdf-4756-809b-d970eb988e49]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:25:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-db48bda8-8018-411a-b9ae-e0e7dd1ee8ce tempest-SnapshotDependencyTests-1711286615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:58 devstack sudo[104649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0
Nov 05 19:25:58 devstack sudo[104649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:59 devstack sudo[104649]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-db48bda8-8018-411a-b9ae-e0e7dd1ee8ce tempest-SnapshotDependencyTests-1711286615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0" returned: 0 in 0.513s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-db48bda8-8018-411a-b9ae-e0e7dd1ee8ce tempest-SnapshotDependencyTests-1711286615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0.43d83d19-2150-4db9-a976-263b678da220 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:59 devstack sudo[104654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0.43d83d19-2150-4db9-a976-263b678da220
Nov 05 19:25:59 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:59 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-db48bda8-8018-411a-b9ae-e0e7dd1ee8ce tempest-SnapshotDependencyTests-1711286615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0.43d83d19-2150-4db9-a976-263b678da220" returned: 0 in 0.342s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-db48bda8-8018-411a-b9ae-e0e7dd1ee8ce tempest-SnapshotDependencyTests-1711286615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0.43d83d19-2150-4db9-a976-263b678da220 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:25:59 devstack sudo[104659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0.43d83d19-2150-4db9-a976-263b678da220
Nov 05 19:25:59 devstack sudo[104659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:25:59 devstack sudo[104659]: pam_unix(sudo:session): session closed for user root
Nov 05 19:25:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-db48bda8-8018-411a-b9ae-e0e7dd1ee8ce tempest-SnapshotDependencyTests-1711286615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0.43d83d19-2150-4db9-a976-263b678da220" returned: 0 in 0.255s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:25:59 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-db48bda8-8018-411a-b9ae-e0e7dd1ee8ce tempest-SnapshotDependencyTests-1711286615 None] Lock "cinder-quobyte-43d83d19-2150-4db9-a976-263b678da220" released by "_delete_snapshot" :: held 1.568s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:26:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-db48bda8-8018-411a-b9ae-e0e7dd1ee8ce tempest-SnapshotDependencyTests-1711286615 None] Lock "cinder-quobyte-97b45ccc-a609-40ef-a5b7-da09a5e755f0" released by "delete_snapshot" :: held 1.589s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:26:00 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-db48bda8-8018-411a-b9ae-e0e7dd1ee8ce tempest-SnapshotDependencyTests-1711286615 None] Created reservations ['f9587c2d-171a-441b-8be1-37b1bb2dc11a', 'dc5870e0-cdff-4e39-9578-b0f97dc4d680', 'f8af5bf3-c20b-4bc8-99c9-80cb240d4e4e', 'c0990929-3188-4e4b-b368-3fc0453a7422'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:26:00 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-db48bda8-8018-411a-b9ae-e0e7dd1ee8ce tempest-SnapshotDependencyTests-1711286615 None] Delete snapshot completed successfully.
Nov 05 19:26:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-db48bda8-8018-411a-b9ae-e0e7dd1ee8ce tempest-SnapshotDependencyTests-1711286615 None] Lock "cinder-43d83d19-2150-4db9-a976-263b678da220-delete_snapshot" released by "delete_snapshot" :: held 1.732s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:26:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0b55948d-f4e9-4a48-b1a4-1169efa50cdf tempest-SnapshotDependencyTests-1711286615 None] Acquiring lock "cinder-97b45ccc-a609-40ef-a5b7-da09a5e755f0-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:26:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0b55948d-f4e9-4a48-b1a4-1169efa50cdf tempest-SnapshotDependencyTests-1711286615 None] Lock "cinder-97b45ccc-a609-40ef-a5b7-da09a5e755f0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:26:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0b55948d-f4e9-4a48-b1a4-1169efa50cdf tempest-SnapshotDependencyTests-1711286615 None] Acquiring lock "cinder-quobyte-97b45ccc-a609-40ef-a5b7-da09a5e755f0" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:26:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0b55948d-f4e9-4a48-b1a4-1169efa50cdf tempest-SnapshotDependencyTests-1711286615 None] Lock "cinder-quobyte-97b45ccc-a609-40ef-a5b7-da09a5e755f0" acquired by "delete_volume" :: waited 0.014s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:26:00 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[83574720-460d-43e9-b1ee-cedc7c12e731]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:26:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0b55948d-f4e9-4a48-b1a4-1169efa50cdf tempest-SnapshotDependencyTests-1711286615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:00 devstack sudo[104662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0
Nov 05 19:26:00 devstack sudo[104662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:00 devstack sudo[104662]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0b55948d-f4e9-4a48-b1a4-1169efa50cdf tempest-SnapshotDependencyTests-1711286615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0" returned: 0 in 0.345s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0b55948d-f4e9-4a48-b1a4-1169efa50cdf tempest-SnapshotDependencyTests-1711286615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:01 devstack sudo[104667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0
Nov 05 19:26:01 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:01 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0b55948d-f4e9-4a48-b1a4-1169efa50cdf tempest-SnapshotDependencyTests-1711286615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-97b45ccc-a609-40ef-a5b7-da09a5e755f0" returned: 0 in 0.245s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0b55948d-f4e9-4a48-b1a4-1169efa50cdf tempest-SnapshotDependencyTests-1711286615 None] Lock "cinder-quobyte-97b45ccc-a609-40ef-a5b7-da09a5e755f0" released by "delete_volume" :: held 0.646s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:26:01 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-0b55948d-f4e9-4a48-b1a4-1169efa50cdf tempest-SnapshotDependencyTests-1711286615 None] Created reservations ['1e791f72-257a-4ba0-95f3-0b780b4fdc22', '790e313a-0525-483f-bb88-4e9d4cff4dff', '4a44263f-555e-4604-97dc-a56e9a1bc60d', 'c959c94f-9923-4dce-b9e6-65978de67129'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:26:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0b55948d-f4e9-4a48-b1a4-1169efa50cdf tempest-SnapshotDependencyTests-1711286615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0b55948d-f4e9-4a48-b1a4-1169efa50cdf tempest-SnapshotDependencyTests-1711286615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0b55948d-f4e9-4a48-b1a4-1169efa50cdf tempest-SnapshotDependencyTests-1711286615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:26:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0b55948d-f4e9-4a48-b1a4-1169efa50cdf tempest-SnapshotDependencyTests-1711286615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:26:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0b55948d-f4e9-4a48-b1a4-1169efa50cdf tempest-SnapshotDependencyTests-1711286615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0b55948d-f4e9-4a48-b1a4-1169efa50cdf tempest-SnapshotDependencyTests-1711286615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:01 devstack sudo[104670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:26:01 devstack sudo[104670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:01 devstack sudo[104670]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0b55948d-f4e9-4a48-b1a4-1169efa50cdf tempest-SnapshotDependencyTests-1711286615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.235s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:01 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-0b55948d-f4e9-4a48-b1a4-1169efa50cdf tempest-SnapshotDependencyTests-1711286615 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:26:01 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-0b55948d-f4e9-4a48-b1a4-1169efa50cdf tempest-SnapshotDependencyTests-1711286615 None] Deleted volume successfully.
Nov 05 19:26:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0b55948d-f4e9-4a48-b1a4-1169efa50cdf tempest-SnapshotDependencyTests-1711286615 None] Lock "cinder-97b45ccc-a609-40ef-a5b7-da09a5e755f0-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:26:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f93e52e5-a350-40e9-b9e6-74b3610db961 tempest-SnapshotDependencyTests-1711286615 None] Acquiring lock "cinder-86820426-88f5-4214-a190-e6821378a26d-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:26:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f93e52e5-a350-40e9-b9e6-74b3610db961 tempest-SnapshotDependencyTests-1711286615 None] Lock "cinder-86820426-88f5-4214-a190-e6821378a26d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:26:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f93e52e5-a350-40e9-b9e6-74b3610db961 tempest-SnapshotDependencyTests-1711286615 None] Acquiring lock "cinder-quobyte-86820426-88f5-4214-a190-e6821378a26d" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:26:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f93e52e5-a350-40e9-b9e6-74b3610db961 tempest-SnapshotDependencyTests-1711286615 None] Lock "cinder-quobyte-86820426-88f5-4214-a190-e6821378a26d" acquired by "delete_volume" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:26:01 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e4f1ec-8ad3-458b-a838-2bb9371691a2]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:26:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f93e52e5-a350-40e9-b9e6-74b3610db961 tempest-SnapshotDependencyTests-1711286615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-86820426-88f5-4214-a190-e6821378a26d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:01 devstack sudo[104673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-86820426-88f5-4214-a190-e6821378a26d
Nov 05 19:26:01 devstack sudo[104673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:02 devstack sudo[104673]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f93e52e5-a350-40e9-b9e6-74b3610db961 tempest-SnapshotDependencyTests-1711286615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-86820426-88f5-4214-a190-e6821378a26d" returned: 0 in 0.347s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f93e52e5-a350-40e9-b9e6-74b3610db961 tempest-SnapshotDependencyTests-1711286615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-86820426-88f5-4214-a190-e6821378a26d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:02 devstack sudo[104678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-86820426-88f5-4214-a190-e6821378a26d
Nov 05 19:26:02 devstack sudo[104678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:02 devstack sudo[104678]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f93e52e5-a350-40e9-b9e6-74b3610db961 tempest-SnapshotDependencyTests-1711286615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-86820426-88f5-4214-a190-e6821378a26d" returned: 0 in 0.236s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f93e52e5-a350-40e9-b9e6-74b3610db961 tempest-SnapshotDependencyTests-1711286615 None] Lock "cinder-quobyte-86820426-88f5-4214-a190-e6821378a26d" released by "delete_volume" :: held 0.624s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:26:02 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-f93e52e5-a350-40e9-b9e6-74b3610db961 tempest-SnapshotDependencyTests-1711286615 None] Created reservations ['48363f82-c85c-460b-b82a-f11f2f538f42', '2a62a8ab-209a-44d6-94dd-b3dfad706a9a', '08404995-c1be-4170-a791-c2f2441be4e6', '68ebd474-c2a5-4aa6-a068-fed1e0bd6bc0'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:26:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f93e52e5-a350-40e9-b9e6-74b3610db961 tempest-SnapshotDependencyTests-1711286615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f93e52e5-a350-40e9-b9e6-74b3610db961 tempest-SnapshotDependencyTests-1711286615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:02 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f93e52e5-a350-40e9-b9e6-74b3610db961 tempest-SnapshotDependencyTests-1711286615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:26:02 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f93e52e5-a350-40e9-b9e6-74b3610db961 tempest-SnapshotDependencyTests-1711286615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:26:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f93e52e5-a350-40e9-b9e6-74b3610db961 tempest-SnapshotDependencyTests-1711286615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f93e52e5-a350-40e9-b9e6-74b3610db961 tempest-SnapshotDependencyTests-1711286615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:02 devstack sudo[104681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:26:02 devstack sudo[104681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:02 devstack sudo[104681]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f93e52e5-a350-40e9-b9e6-74b3610db961 tempest-SnapshotDependencyTests-1711286615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.242s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:02 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-f93e52e5-a350-40e9-b9e6-74b3610db961 tempest-SnapshotDependencyTests-1711286615 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:26:02 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f93e52e5-a350-40e9-b9e6-74b3610db961 tempest-SnapshotDependencyTests-1711286615 None] Deleted volume successfully.
Nov 05 19:26:02 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-f93e52e5-a350-40e9-b9e6-74b3610db961 tempest-SnapshotDependencyTests-1711286615 None] Lock "cinder-86820426-88f5-4214-a190-e6821378a26d-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:26:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:26:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:26:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:26:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:05 devstack sudo[104685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:26:05 devstack sudo[104685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:05 devstack sudo[104685]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.243s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:05 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:26:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:26:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread count: 28 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 19:26:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread info: [<_MainThread(MainThread, started 126882883072128)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126882770872512)>, <Thread(Thread-3 (stat_writer), started daemon 126882769837376)>, <Thread(Rabbit-heartbeat, started daemon 126882768896256)>, <Thread(Thread-5 (_runner), started daemon 126882768980928)>, <Thread(Thread-7 (_runner), started daemon 126882767016448)>, <Thread(fd_logger, started daemon 126882764561216)>, <Thread(privsep_reader, started daemon 126882764568576)>, <Thread(tpool_thread_0, started daemon 126882759292608)>, <Thread(tpool_thread_1, started daemon 126882750899904)>, <Thread(tpool_thread_2, started daemon 126882742507200)>, <Thread(tpool_thread_3, started daemon 126882734114496)>, <Thread(tpool_thread_4, started daemon 126882725721792)>, <Thread(tpool_thread_5, started daemon 126882717329088)>, <Thread(tpool_thread_6, started daemon 126882708920000)>, <Thread(tpool_thread_7, started daemon 126882700510912)>, <Thread(tpool_thread_8, started daemon 126882692101824)>, <Thread(tpool_thread_9, started daemon 126882683692736)>, <Thread(tpool_thread_10, started daemon 126882675283648)>, <Thread(tpool_thread_11, started daemon 126882666874560)>, <Thread(tpool_thread_12, started daemon 126882658465472)>, <Thread(tpool_thread_13, started daemon 126882650056384)>, <Thread(tpool_thread_14, started daemon 126882641647296)>, <Thread(tpool_thread_15, started daemon 126882633238208)>, <Thread(tpool_thread_16, started daemon 126882624829120)>, <Thread(tpool_thread_17, started daemon 126882616420032)>, <Thread(tpool_thread_18, started daemon 126882608010944)>, <Thread(tpool_thread_19, started daemon 126882599601856)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 19:26:12 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:UPDATE=30,cinder:SELECT=22,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:26:12 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=27,cinder:UPDATE=28,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:26:23 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-706385e6-6e59-4f18-8181-8384f48e3c1e tempest-VolumeDependencyTests-1893183406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:26:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-706385e6-6e59-4f18-8181-8384f48e3c1e tempest-VolumeDependencyTests-1893183406 None] Flow 'volume_create_manager' (dd61b533-27a6-4430-86d8-d2772e796c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:26:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-706385e6-6e59-4f18-8181-8384f48e3c1e tempest-VolumeDependencyTests-1893183406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b50412a5-10ca-4795-8084-0d8a61cc3d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-706385e6-6e59-4f18-8181-8384f48e3c1e tempest-VolumeDependencyTests-1893183406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b50412a5-10ca-4795-8084-0d8a61cc3d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-106104727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=283b6041-9ccd-4729-9a6b-f0c0d86c3b86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e98bc67e06a493bbc5f56981d82c3af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:26:23Z,use_quota=True,user_id='1ebd949977e942f8b984ba19b2189fff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-706385e6-6e59-4f18-8181-8384f48e3c1e tempest-VolumeDependencyTests-1893183406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ea4c5f-9f1d-4041-abd0-740ba1e9df31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-706385e6-6e59-4f18-8181-8384f48e3c1e tempest-VolumeDependencyTests-1893183406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ea4c5f-9f1d-4041-abd0-740ba1e9df31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-706385e6-6e59-4f18-8181-8384f48e3c1e tempest-VolumeDependencyTests-1893183406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4b2e03e-097c-48ed-999e-a4354cae401a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-706385e6-6e59-4f18-8181-8384f48e3c1e tempest-VolumeDependencyTests-1893183406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4b2e03e-097c-48ed-999e-a4354cae401a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '283b6041-9ccd-4729-9a6b-f0c0d86c3b86', 'volume_name': 'volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-706385e6-6e59-4f18-8181-8384f48e3c1e tempest-VolumeDependencyTests-1893183406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee6b9ad0-e271-4700-9a6a-af75757f5905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-706385e6-6e59-4f18-8181-8384f48e3c1e tempest-VolumeDependencyTests-1893183406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee6b9ad0-e271-4700-9a6a-af75757f5905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-706385e6-6e59-4f18-8181-8384f48e3c1e tempest-VolumeDependencyTests-1893183406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f78fbf9-8c48-42e1-94d5-a99fac6a6640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:23 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-706385e6-6e59-4f18-8181-8384f48e3c1e tempest-VolumeDependencyTests-1893183406 None] Volume 283b6041-9ccd-4729-9a6b-f0c0d86c3b86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86', 'volume_size': 1}
Nov 05 19:26:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-706385e6-6e59-4f18-8181-8384f48e3c1e tempest-VolumeDependencyTests-1893183406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-706385e6-6e59-4f18-8181-8384f48e3c1e tempest-VolumeDependencyTests-1893183406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-706385e6-6e59-4f18-8181-8384f48e3c1e tempest-VolumeDependencyTests-1893183406 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-106104727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=283b6041-9ccd-4729-9a6b-f0c0d86c3b86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e98bc67e06a493bbc5f56981d82c3af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:26:23Z,use_quota=True,user_id='1ebd949977e942f8b984ba19b2189fff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:26:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-706385e6-6e59-4f18-8181-8384f48e3c1e tempest-VolumeDependencyTests-1893183406 None] Creating volume 283b6041-9ccd-4729-9a6b-f0c0d86c3b86 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:26:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-706385e6-6e59-4f18-8181-8384f48e3c1e tempest-VolumeDependencyTests-1893183406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-706385e6-6e59-4f18-8181-8384f48e3c1e tempest-VolumeDependencyTests-1893183406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-706385e6-6e59-4f18-8181-8384f48e3c1e tempest-VolumeDependencyTests-1893183406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:26:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-706385e6-6e59-4f18-8181-8384f48e3c1e tempest-VolumeDependencyTests-1893183406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:26:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-706385e6-6e59-4f18-8181-8384f48e3c1e tempest-VolumeDependencyTests-1893183406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-706385e6-6e59-4f18-8181-8384f48e3c1e tempest-VolumeDependencyTests-1893183406 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:26:23 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-706385e6-6e59-4f18-8181-8384f48e3c1e tempest-VolumeDependencyTests-1893183406 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:26:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-706385e6-6e59-4f18-8181-8384f48e3c1e tempest-VolumeDependencyTests-1893183406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:23 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-db0d13d5-ffdb-4a78-9dfa-61882e6352ba tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:26:23 devstack sudo[104729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86 1073741824
Nov 05 19:26:23 devstack sudo[104729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-db0d13d5-ffdb-4a78-9dfa-61882e6352ba tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Flow 'volume_create_manager' (26d3b857-9dfd-4daf-94df-5f7dd5b1ca6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:26:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-db0d13d5-ffdb-4a78-9dfa-61882e6352ba tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daaaeab9-5773-4ee9-b244-6166d96f6f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-db0d13d5-ffdb-4a78-9dfa-61882e6352ba tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daaaeab9-5773-4ee9-b244-6166d96f6f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1587042500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6c039f6-aa52-4b81-a908-0a3093000493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25948ebfc9aa40ea85f787a08c8c28d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:26:24Z,use_quota=True,user_id='99892162098147f5bd99622391c69052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-db0d13d5-ffdb-4a78-9dfa-61882e6352ba tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f43c4a5a-97fc-4b40-9046-f29a6505f122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-db0d13d5-ffdb-4a78-9dfa-61882e6352ba tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f43c4a5a-97fc-4b40-9046-f29a6505f122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-db0d13d5-ffdb-4a78-9dfa-61882e6352ba tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47a7d849-6569-48e3-86ea-b56ab4f43a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-db0d13d5-ffdb-4a78-9dfa-61882e6352ba tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47a7d849-6569-48e3-86ea-b56ab4f43a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6c039f6-aa52-4b81-a908-0a3093000493', 'volume_name': 'volume-d6c039f6-aa52-4b81-a908-0a3093000493', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-db0d13d5-ffdb-4a78-9dfa-61882e6352ba tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18c60a27-d248-4574-85c2-389a0a7686fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-db0d13d5-ffdb-4a78-9dfa-61882e6352ba tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18c60a27-d248-4574-85c2-389a0a7686fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-db0d13d5-ffdb-4a78-9dfa-61882e6352ba tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (712b4f5b-6860-4d46-a7d8-551c28d391c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:23 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-db0d13d5-ffdb-4a78-9dfa-61882e6352ba tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Volume d6c039f6-aa52-4b81-a908-0a3093000493: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6c039f6-aa52-4b81-a908-0a3093000493', 'volume_size': 1}
Nov 05 19:26:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-db0d13d5-ffdb-4a78-9dfa-61882e6352ba tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-15ac8d59-e435-401b-b706-628b6482dc85 tempest-CreateVolumesFromImageTest-913962025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:26:24 devstack sudo[104729]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-15ac8d59-e435-401b-b706-628b6482dc85 tempest-CreateVolumesFromImageTest-913962025 None] Flow 'volume_create_manager' (899464d6-30ac-4ba5-a78d-0d0aeb2c7d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-15ac8d59-e435-401b-b706-628b6482dc85 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e77443d4-be34-4390-964c-b4f84637aea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-706385e6-6e59-4f18-8181-8384f48e3c1e tempest-VolumeDependencyTests-1893183406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86 1073741824" returned: 0 in 0.609s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-15ac8d59-e435-401b-b706-628b6482dc85 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e77443d4-be34-4390-964c-b4f84637aea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1828605103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b165eb14-4b97-40ba-a3a3-ec4b47f633b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e455968273f2436fb1e285865622455d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:26:24Z,use_quota=True,user_id='3e52d5b7fe9640878208e2540869b727',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-15ac8d59-e435-401b-b706-628b6482dc85 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e702c95e-dc94-457b-9057-737970544936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-15ac8d59-e435-401b-b706-628b6482dc85 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e702c95e-dc94-457b-9057-737970544936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-15ac8d59-e435-401b-b706-628b6482dc85 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79d819ba-8b87-464a-8598-7d397c597093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-15ac8d59-e435-401b-b706-628b6482dc85 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79d819ba-8b87-464a-8598-7d397c597093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b165eb14-4b97-40ba-a3a3-ec4b47f633b8', 'volume_name': 'volume-b165eb14-4b97-40ba-a3a3-ec4b47f633b8', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-15ac8d59-e435-401b-b706-628b6482dc85 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d06e552d-8309-4ce2-b3ff-4a9891be2ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-15ac8d59-e435-401b-b706-628b6482dc85 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d06e552d-8309-4ce2-b3ff-4a9891be2ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-15ac8d59-e435-401b-b706-628b6482dc85 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c01eecdd-5870-4208-803b-3c7e69217db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:24 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-15ac8d59-e435-401b-b706-628b6482dc85 tempest-CreateVolumesFromImageTest-913962025 None] Volume b165eb14-4b97-40ba-a3a3-ec4b47f633b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b165eb14-4b97-40ba-a3a3-ec4b47f633b8', 'volume_size': 1}
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-15ac8d59-e435-401b-b706-628b6482dc85 tempest-CreateVolumesFromImageTest-913962025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-706385e6-6e59-4f18-8181-8384f48e3c1e tempest-VolumeDependencyTests-1893183406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:24 devstack sudo[104735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86
Nov 05 19:26:24 devstack sudo[104735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:24 devstack sudo[104735]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-706385e6-6e59-4f18-8181-8384f48e3c1e tempest-VolumeDependencyTests-1893183406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86" returned: 0 in 0.295s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-706385e6-6e59-4f18-8181-8384f48e3c1e tempest-VolumeDependencyTests-1893183406 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-706385e6-6e59-4f18-8181-8384f48e3c1e tempest-VolumeDependencyTests-1893183406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-db0d13d5-ffdb-4a78-9dfa-61882e6352ba tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.860s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-db0d13d5-ffdb-4a78-9dfa-61882e6352ba tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1587042500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6c039f6-aa52-4b81-a908-0a3093000493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25948ebfc9aa40ea85f787a08c8c28d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:26:24Z,use_quota=True,user_id='99892162098147f5bd99622391c69052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-db0d13d5-ffdb-4a78-9dfa-61882e6352ba tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Creating volume d6c039f6-aa52-4b81-a908-0a3093000493 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-db0d13d5-ffdb-4a78-9dfa-61882e6352ba tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-db0d13d5-ffdb-4a78-9dfa-61882e6352ba tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-db0d13d5-ffdb-4a78-9dfa-61882e6352ba tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-db0d13d5-ffdb-4a78-9dfa-61882e6352ba tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-db0d13d5-ffdb-4a78-9dfa-61882e6352ba tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-db0d13d5-ffdb-4a78-9dfa-61882e6352ba tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:26:24 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-db0d13d5-ffdb-4a78-9dfa-61882e6352ba tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-db0d13d5-ffdb-4a78-9dfa-61882e6352ba tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d6c039f6-aa52-4b81-a908-0a3093000493 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-706385e6-6e59-4f18-8181-8384f48e3c1e tempest-VolumeDependencyTests-1893183406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f78fbf9-8c48-42e1-94d5-a99fac6a6640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:24 devstack sudo[104738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d6c039f6-aa52-4b81-a908-0a3093000493 1073741824
Nov 05 19:26:24 devstack sudo[104738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-706385e6-6e59-4f18-8181-8384f48e3c1e tempest-VolumeDependencyTests-1893183406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d795b6a9-6530-410f-8f76-9bf5f8c4aea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-03de86ff-4c53-422a-9c18-b83e465eaca5 tempest-CreateVolumesFromImageTest-913962025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-03de86ff-4c53-422a-9c18-b83e465eaca5 tempest-CreateVolumesFromImageTest-913962025 None] Flow 'volume_create_manager' (a67a2f87-28ed-4108-9c4f-9e993161e639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-03de86ff-4c53-422a-9c18-b83e465eaca5 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac795147-a4b1-4a29-8724-92d316ddebf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:24 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-706385e6-6e59-4f18-8181-8384f48e3c1e tempest-VolumeDependencyTests-1893183406 None] Volume volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86 (283b6041-9ccd-4729-9a6b-f0c0d86c3b86): created successfully
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-706385e6-6e59-4f18-8181-8384f48e3c1e tempest-VolumeDependencyTests-1893183406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d795b6a9-6530-410f-8f76-9bf5f8c4aea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-706385e6-6e59-4f18-8181-8384f48e3c1e tempest-VolumeDependencyTests-1893183406 None] Flow 'volume_create_manager' (dd61b533-27a6-4430-86d8-d2772e796c31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-03de86ff-4c53-422a-9c18-b83e465eaca5 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac795147-a4b1-4a29-8724-92d316ddebf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-118339041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b16a835b-a3ad-4bb6-adf1-488f82fd4973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e455968273f2436fb1e285865622455d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:26:25Z,use_quota=True,user_id='3e52d5b7fe9640878208e2540869b727',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-03de86ff-4c53-422a-9c18-b83e465eaca5 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde097bc-4574-4f7b-bcea-0d40fe1b7c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-03de86ff-4c53-422a-9c18-b83e465eaca5 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde097bc-4574-4f7b-bcea-0d40fe1b7c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-03de86ff-4c53-422a-9c18-b83e465eaca5 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a24a3ba-d5ab-4251-b0db-f20ebed38534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-03de86ff-4c53-422a-9c18-b83e465eaca5 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a24a3ba-d5ab-4251-b0db-f20ebed38534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b16a835b-a3ad-4bb6-adf1-488f82fd4973', 'volume_name': 'volume-b16a835b-a3ad-4bb6-adf1-488f82fd4973', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-03de86ff-4c53-422a-9c18-b83e465eaca5 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e4625a0-6403-42b3-ad26-b4566933128a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-03de86ff-4c53-422a-9c18-b83e465eaca5 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e4625a0-6403-42b3-ad26-b4566933128a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-03de86ff-4c53-422a-9c18-b83e465eaca5 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (530c475a-ff3b-4af3-bfa0-cfe936c528b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:24 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-03de86ff-4c53-422a-9c18-b83e465eaca5 tempest-CreateVolumesFromImageTest-913962025 None] Volume b16a835b-a3ad-4bb6-adf1-488f82fd4973: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b16a835b-a3ad-4bb6-adf1-488f82fd4973', 'volume_size': 1}
Nov 05 19:26:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-03de86ff-4c53-422a-9c18-b83e465eaca5 tempest-CreateVolumesFromImageTest-913962025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:24 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-706385e6-6e59-4f18-8181-8384f48e3c1e tempest-VolumeDependencyTests-1893183406 None] Created volume successfully.
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-2809342b-9ebd-473b-ab26-a8e4f2d74a77 tempest-CreateVolumesFromImageTest-913962025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2809342b-9ebd-473b-ab26-a8e4f2d74a77 tempest-CreateVolumesFromImageTest-913962025 None] Flow 'volume_create_manager' (b640f3c9-e490-4fbc-9b00-934511813bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2809342b-9ebd-473b-ab26-a8e4f2d74a77 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b423590a-bd8b-4a83-b206-b03183f0abf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2809342b-9ebd-473b-ab26-a8e4f2d74a77 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b423590a-bd8b-4a83-b206-b03183f0abf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1979737686',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7c5890a-cbd2-419c-825b-65c8661d9a5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e455968273f2436fb1e285865622455d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:26:25Z,use_quota=True,user_id='3e52d5b7fe9640878208e2540869b727',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2809342b-9ebd-473b-ab26-a8e4f2d74a77 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b77c5355-8ae6-4574-b26a-d2624cd7c59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2809342b-9ebd-473b-ab26-a8e4f2d74a77 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b77c5355-8ae6-4574-b26a-d2624cd7c59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2809342b-9ebd-473b-ab26-a8e4f2d74a77 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0c93489-58d2-41a1-a235-01f92a3f5632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2809342b-9ebd-473b-ab26-a8e4f2d74a77 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0c93489-58d2-41a1-a235-01f92a3f5632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7c5890a-cbd2-419c-825b-65c8661d9a5d', 'volume_name': 'volume-a7c5890a-cbd2-419c-825b-65c8661d9a5d', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2809342b-9ebd-473b-ab26-a8e4f2d74a77 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c09b6628-9ba4-400a-8eec-a70f7b4c8180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2809342b-9ebd-473b-ab26-a8e4f2d74a77 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c09b6628-9ba4-400a-8eec-a70f7b4c8180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2809342b-9ebd-473b-ab26-a8e4f2d74a77 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48ae5f5c-1f04-4951-8ad9-90be44766539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:25 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-2809342b-9ebd-473b-ab26-a8e4f2d74a77 tempest-CreateVolumesFromImageTest-913962025 None] Volume a7c5890a-cbd2-419c-825b-65c8661d9a5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7c5890a-cbd2-419c-825b-65c8661d9a5d', 'volume_size': 1}
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2809342b-9ebd-473b-ab26-a8e4f2d74a77 tempest-CreateVolumesFromImageTest-913962025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:25 devstack sudo[104738]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-db0d13d5-ffdb-4a78-9dfa-61882e6352ba tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d6c039f6-aa52-4b81-a908-0a3093000493 1073741824" returned: 0 in 0.573s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-db0d13d5-ffdb-4a78-9dfa-61882e6352ba tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d6c039f6-aa52-4b81-a908-0a3093000493 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:25 devstack sudo[104744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d6c039f6-aa52-4b81-a908-0a3093000493
Nov 05 19:26:25 devstack sudo[104744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-23286ac7-8529-42f9-8edb-32002d085ad0 tempest-CreateVolumesFromImageTest-913962025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-23286ac7-8529-42f9-8edb-32002d085ad0 tempest-CreateVolumesFromImageTest-913962025 None] Flow 'volume_create_manager' (9a4811d2-b842-4f34-923a-d1d332a233ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-23286ac7-8529-42f9-8edb-32002d085ad0 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6105cd6-8ee3-4513-8653-d4110d15dd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-23286ac7-8529-42f9-8edb-32002d085ad0 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6105cd6-8ee3-4513-8653-d4110d15dd71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1330970692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42c5f8e3-e03d-4842-8062-c61865e11aa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e455968273f2436fb1e285865622455d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:26:26Z,use_quota=True,user_id='3e52d5b7fe9640878208e2540869b727',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-23286ac7-8529-42f9-8edb-32002d085ad0 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1999510-8208-47f4-bc97-fbe2e2deea6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-23286ac7-8529-42f9-8edb-32002d085ad0 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1999510-8208-47f4-bc97-fbe2e2deea6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-23286ac7-8529-42f9-8edb-32002d085ad0 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a802a8ab-88a6-46b0-86ab-8189c3824eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:25 devstack sudo[104744]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-23286ac7-8529-42f9-8edb-32002d085ad0 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a802a8ab-88a6-46b0-86ab-8189c3824eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42c5f8e3-e03d-4842-8062-c61865e11aa5', 'volume_name': 'volume-42c5f8e3-e03d-4842-8062-c61865e11aa5', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-23286ac7-8529-42f9-8edb-32002d085ad0 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7f91e3b-f40e-41d4-9f09-09d0e7afbe5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-23286ac7-8529-42f9-8edb-32002d085ad0 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7f91e3b-f40e-41d4-9f09-09d0e7afbe5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-23286ac7-8529-42f9-8edb-32002d085ad0 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a852c10-26ca-402f-b441-8b1a81203a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:25 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-23286ac7-8529-42f9-8edb-32002d085ad0 tempest-CreateVolumesFromImageTest-913962025 None] Volume 42c5f8e3-e03d-4842-8062-c61865e11aa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42c5f8e3-e03d-4842-8062-c61865e11aa5', 'volume_size': 1}
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-23286ac7-8529-42f9-8edb-32002d085ad0 tempest-CreateVolumesFromImageTest-913962025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-db0d13d5-ffdb-4a78-9dfa-61882e6352ba tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d6c039f6-aa52-4b81-a908-0a3093000493" returned: 0 in 0.349s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-db0d13d5-ffdb-4a78-9dfa-61882e6352ba tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-db0d13d5-ffdb-4a78-9dfa-61882e6352ba tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-15ac8d59-e435-401b-b706-628b6482dc85 tempest-CreateVolumesFromImageTest-913962025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.310s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-15ac8d59-e435-401b-b706-628b6482dc85 tempest-CreateVolumesFromImageTest-913962025 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1828605103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b165eb14-4b97-40ba-a3a3-ec4b47f633b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e455968273f2436fb1e285865622455d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:26:24Z,use_quota=True,user_id='3e52d5b7fe9640878208e2540869b727',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-15ac8d59-e435-401b-b706-628b6482dc85 tempest-CreateVolumesFromImageTest-913962025 None] Creating volume b165eb14-4b97-40ba-a3a3-ec4b47f633b8 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-15ac8d59-e435-401b-b706-628b6482dc85 tempest-CreateVolumesFromImageTest-913962025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-15ac8d59-e435-401b-b706-628b6482dc85 tempest-CreateVolumesFromImageTest-913962025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-15ac8d59-e435-401b-b706-628b6482dc85 tempest-CreateVolumesFromImageTest-913962025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-15ac8d59-e435-401b-b706-628b6482dc85 tempest-CreateVolumesFromImageTest-913962025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-15ac8d59-e435-401b-b706-628b6482dc85 tempest-CreateVolumesFromImageTest-913962025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-15ac8d59-e435-401b-b706-628b6482dc85 tempest-CreateVolumesFromImageTest-913962025 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:26:25 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-15ac8d59-e435-401b-b706-628b6482dc85 tempest-CreateVolumesFromImageTest-913962025 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-15ac8d59-e435-401b-b706-628b6482dc85 tempest-CreateVolumesFromImageTest-913962025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b165eb14-4b97-40ba-a3a3-ec4b47f633b8 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-db0d13d5-ffdb-4a78-9dfa-61882e6352ba tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (712b4f5b-6860-4d46-a7d8-551c28d391c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6c039f6-aa52-4b81-a908-0a3093000493', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-db0d13d5-ffdb-4a78-9dfa-61882e6352ba tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dd4da8d-ffa8-428c-b166-075d181ddcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:25 devstack sudo[104747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b165eb14-4b97-40ba-a3a3-ec4b47f633b8 1073741824
Nov 05 19:26:25 devstack sudo[104747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:25 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-db0d13d5-ffdb-4a78-9dfa-61882e6352ba tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Volume volume-d6c039f6-aa52-4b81-a908-0a3093000493 (d6c039f6-aa52-4b81-a908-0a3093000493): created successfully
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-db0d13d5-ffdb-4a78-9dfa-61882e6352ba tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dd4da8d-ffa8-428c-b166-075d181ddcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-db0d13d5-ffdb-4a78-9dfa-61882e6352ba tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Flow 'volume_create_manager' (26d3b857-9dfd-4daf-94df-5f7dd5b1ca6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:26:25 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-db0d13d5-ffdb-4a78-9dfa-61882e6352ba tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Created volume successfully.
Nov 05 19:26:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-926d86e9-11be-4d5e-97e8-963f51c60396 tempest-VolumeDependencyTests-1893183406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:26 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc2b8058-b1f9-4876-aa24-790b028e2711 tempest-CreateVolumesFromImageTest-913962025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:26:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fc2b8058-b1f9-4876-aa24-790b028e2711 tempest-CreateVolumesFromImageTest-913962025 None] Flow 'volume_create_manager' (7a5dfc7a-2d87-4f77-a4bc-c1233674ffea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:26:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fc2b8058-b1f9-4876-aa24-790b028e2711 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3771ad75-bab1-41cf-9e8c-955c426f6554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fc2b8058-b1f9-4876-aa24-790b028e2711 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3771ad75-bab1-41cf-9e8c-955c426f6554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1043145579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fc9e83b-44ef-4320-8795-e18551b043d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e455968273f2436fb1e285865622455d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:26:26Z,use_quota=True,user_id='3e52d5b7fe9640878208e2540869b727',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fc2b8058-b1f9-4876-aa24-790b028e2711 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f9bb069-8c86-4303-a809-bdfdb633b530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fc2b8058-b1f9-4876-aa24-790b028e2711 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f9bb069-8c86-4303-a809-bdfdb633b530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fc2b8058-b1f9-4876-aa24-790b028e2711 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (330b2aac-76dc-4ef6-a661-99d640236fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fc2b8058-b1f9-4876-aa24-790b028e2711 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (330b2aac-76dc-4ef6-a661-99d640236fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fc9e83b-44ef-4320-8795-e18551b043d9', 'volume_name': 'volume-2fc9e83b-44ef-4320-8795-e18551b043d9', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fc2b8058-b1f9-4876-aa24-790b028e2711 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9be3404-5c27-43eb-aa12-04f7005e014b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fc2b8058-b1f9-4876-aa24-790b028e2711 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9be3404-5c27-43eb-aa12-04f7005e014b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fc2b8058-b1f9-4876-aa24-790b028e2711 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f6fa0e7-e747-42a5-a9cc-e8424082cb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:26 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-fc2b8058-b1f9-4876-aa24-790b028e2711 tempest-CreateVolumesFromImageTest-913962025 None] Volume 2fc9e83b-44ef-4320-8795-e18551b043d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fc9e83b-44ef-4320-8795-e18551b043d9', 'volume_size': 1}
Nov 05 19:26:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fc2b8058-b1f9-4876-aa24-790b028e2711 tempest-CreateVolumesFromImageTest-913962025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:26 devstack sudo[104747]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-15ac8d59-e435-401b-b706-628b6482dc85 tempest-CreateVolumesFromImageTest-913962025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b165eb14-4b97-40ba-a3a3-ec4b47f633b8 1073741824" returned: 0 in 0.585s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-15ac8d59-e435-401b-b706-628b6482dc85 tempest-CreateVolumesFromImageTest-913962025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b165eb14-4b97-40ba-a3a3-ec4b47f633b8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:26 devstack sudo[104752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b165eb14-4b97-40ba-a3a3-ec4b47f633b8
Nov 05 19:26:26 devstack sudo[104752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:26 devstack sudo[104752]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-15ac8d59-e435-401b-b706-628b6482dc85 tempest-CreateVolumesFromImageTest-913962025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b165eb14-4b97-40ba-a3a3-ec4b47f633b8" returned: 0 in 0.247s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-15ac8d59-e435-401b-b706-628b6482dc85 tempest-CreateVolumesFromImageTest-913962025 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:26:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-15ac8d59-e435-401b-b706-628b6482dc85 tempest-CreateVolumesFromImageTest-913962025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-03de86ff-4c53-422a-9c18-b83e465eaca5 tempest-CreateVolumesFromImageTest-913962025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.670s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-03de86ff-4c53-422a-9c18-b83e465eaca5 tempest-CreateVolumesFromImageTest-913962025 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-118339041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b16a835b-a3ad-4bb6-adf1-488f82fd4973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e455968273f2436fb1e285865622455d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:26:25Z,use_quota=True,user_id='3e52d5b7fe9640878208e2540869b727',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:26:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-03de86ff-4c53-422a-9c18-b83e465eaca5 tempest-CreateVolumesFromImageTest-913962025 None] Creating volume b16a835b-a3ad-4bb6-adf1-488f82fd4973 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:26:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-03de86ff-4c53-422a-9c18-b83e465eaca5 tempest-CreateVolumesFromImageTest-913962025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-03de86ff-4c53-422a-9c18-b83e465eaca5 tempest-CreateVolumesFromImageTest-913962025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-03de86ff-4c53-422a-9c18-b83e465eaca5 tempest-CreateVolumesFromImageTest-913962025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:26:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-03de86ff-4c53-422a-9c18-b83e465eaca5 tempest-CreateVolumesFromImageTest-913962025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:26:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-03de86ff-4c53-422a-9c18-b83e465eaca5 tempest-CreateVolumesFromImageTest-913962025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-03de86ff-4c53-422a-9c18-b83e465eaca5 tempest-CreateVolumesFromImageTest-913962025 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:26:26 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-03de86ff-4c53-422a-9c18-b83e465eaca5 tempest-CreateVolumesFromImageTest-913962025 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:26:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-03de86ff-4c53-422a-9c18-b83e465eaca5 tempest-CreateVolumesFromImageTest-913962025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b16a835b-a3ad-4bb6-adf1-488f82fd4973 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:26 devstack sudo[104755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b16a835b-a3ad-4bb6-adf1-488f82fd4973 1073741824
Nov 05 19:26:26 devstack sudo[104755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-15ac8d59-e435-401b-b706-628b6482dc85 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c01eecdd-5870-4208-803b-3c7e69217db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b165eb14-4b97-40ba-a3a3-ec4b47f633b8', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-15ac8d59-e435-401b-b706-628b6482dc85 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7bd8572-651e-47f2-a9c4-80b62ca19c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:26 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-15ac8d59-e435-401b-b706-628b6482dc85 tempest-CreateVolumesFromImageTest-913962025 None] Volume volume-b165eb14-4b97-40ba-a3a3-ec4b47f633b8 (b165eb14-4b97-40ba-a3a3-ec4b47f633b8): created successfully
Nov 05 19:26:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-15ac8d59-e435-401b-b706-628b6482dc85 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7bd8572-651e-47f2-a9c4-80b62ca19c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-15ac8d59-e435-401b-b706-628b6482dc85 tempest-CreateVolumesFromImageTest-913962025 None] Flow 'volume_create_manager' (899464d6-30ac-4ba5-a78d-0d0aeb2c7d86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:26:26 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-15ac8d59-e435-401b-b706-628b6482dc85 tempest-CreateVolumesFromImageTest-913962025 None] Created volume successfully.
Nov 05 19:26:27 devstack sudo[104755]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-03de86ff-4c53-422a-9c18-b83e465eaca5 tempest-CreateVolumesFromImageTest-913962025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b16a835b-a3ad-4bb6-adf1-488f82fd4973 1073741824" returned: 0 in 0.567s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-03de86ff-4c53-422a-9c18-b83e465eaca5 tempest-CreateVolumesFromImageTest-913962025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b16a835b-a3ad-4bb6-adf1-488f82fd4973 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:27 devstack sudo[104761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b16a835b-a3ad-4bb6-adf1-488f82fd4973
Nov 05 19:26:27 devstack sudo[104761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-f22a0dde-35be-4e19-9ff2-ab755ba7743c tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f22a0dde-35be-4e19-9ff2-ab755ba7743c tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Flow 'volume_create_manager' (76465036-c5ce-4432-866d-5ed747515490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f22a0dde-35be-4e19-9ff2-ab755ba7743c tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26f3ba9f-7293-4fd1-8b7f-889e25c39e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f22a0dde-35be-4e19-9ff2-ab755ba7743c tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26f3ba9f-7293-4fd1-8b7f-889e25c39e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-149924835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07d1e4d9-5678-47b2-adfc-3a423876e952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25948ebfc9aa40ea85f787a08c8c28d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:26:27Z,use_quota=True,user_id='99892162098147f5bd99622391c69052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f22a0dde-35be-4e19-9ff2-ab755ba7743c tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef542fe7-dd11-4c7c-bdc0-85d7fb62a337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f22a0dde-35be-4e19-9ff2-ab755ba7743c tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef542fe7-dd11-4c7c-bdc0-85d7fb62a337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f22a0dde-35be-4e19-9ff2-ab755ba7743c tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a07dc446-6a8a-41c2-a603-78510fa906dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f22a0dde-35be-4e19-9ff2-ab755ba7743c tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a07dc446-6a8a-41c2-a603-78510fa906dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07d1e4d9-5678-47b2-adfc-3a423876e952', 'volume_name': 'volume-07d1e4d9-5678-47b2-adfc-3a423876e952', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f22a0dde-35be-4e19-9ff2-ab755ba7743c tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f38fcd-5956-45a3-a734-a932e5579b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f22a0dde-35be-4e19-9ff2-ab755ba7743c tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f38fcd-5956-45a3-a734-a932e5579b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f22a0dde-35be-4e19-9ff2-ab755ba7743c tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c022dcb-9a8d-4ff3-92f7-233a3d713248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:27 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-f22a0dde-35be-4e19-9ff2-ab755ba7743c tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Volume 07d1e4d9-5678-47b2-adfc-3a423876e952: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07d1e4d9-5678-47b2-adfc-3a423876e952', 'volume_size': 1}
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f22a0dde-35be-4e19-9ff2-ab755ba7743c tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:27 devstack sudo[104761]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-03de86ff-4c53-422a-9c18-b83e465eaca5 tempest-CreateVolumesFromImageTest-913962025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b16a835b-a3ad-4bb6-adf1-488f82fd4973" returned: 0 in 0.325s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-03de86ff-4c53-422a-9c18-b83e465eaca5 tempest-CreateVolumesFromImageTest-913962025 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-03de86ff-4c53-422a-9c18-b83e465eaca5 tempest-CreateVolumesFromImageTest-913962025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2809342b-9ebd-473b-ab26-a8e4f2d74a77 tempest-CreateVolumesFromImageTest-913962025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.290s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2809342b-9ebd-473b-ab26-a8e4f2d74a77 tempest-CreateVolumesFromImageTest-913962025 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1979737686',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7c5890a-cbd2-419c-825b-65c8661d9a5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e455968273f2436fb1e285865622455d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:26:25Z,use_quota=True,user_id='3e52d5b7fe9640878208e2540869b727',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-2809342b-9ebd-473b-ab26-a8e4f2d74a77 tempest-CreateVolumesFromImageTest-913962025 None] Creating volume a7c5890a-cbd2-419c-825b-65c8661d9a5d {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2809342b-9ebd-473b-ab26-a8e4f2d74a77 tempest-CreateVolumesFromImageTest-913962025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2809342b-9ebd-473b-ab26-a8e4f2d74a77 tempest-CreateVolumesFromImageTest-913962025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2809342b-9ebd-473b-ab26-a8e4f2d74a77 tempest-CreateVolumesFromImageTest-913962025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2809342b-9ebd-473b-ab26-a8e4f2d74a77 tempest-CreateVolumesFromImageTest-913962025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2809342b-9ebd-473b-ab26-a8e4f2d74a77 tempest-CreateVolumesFromImageTest-913962025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2809342b-9ebd-473b-ab26-a8e4f2d74a77 tempest-CreateVolumesFromImageTest-913962025 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:26:27 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-2809342b-9ebd-473b-ab26-a8e4f2d74a77 tempest-CreateVolumesFromImageTest-913962025 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2809342b-9ebd-473b-ab26-a8e4f2d74a77 tempest-CreateVolumesFromImageTest-913962025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a7c5890a-cbd2-419c-825b-65c8661d9a5d 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-03de86ff-4c53-422a-9c18-b83e465eaca5 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (530c475a-ff3b-4af3-bfa0-cfe936c528b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b16a835b-a3ad-4bb6-adf1-488f82fd4973', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:27 devstack sudo[104765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a7c5890a-cbd2-419c-825b-65c8661d9a5d 1073741824
Nov 05 19:26:27 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-03de86ff-4c53-422a-9c18-b83e465eaca5 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec0949ad-0091-45ee-862f-7638a486d84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-18c2370e-0bf3-468c-a0a6-cbef991112e4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-18c2370e-0bf3-468c-a0a6-cbef991112e4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Flow 'volume_create_manager' (01604c51-b35e-4cb8-99f1-10fdad8c90fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-18c2370e-0bf3-468c-a0a6-cbef991112e4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f42b0e1c-2a50-4850-a80e-aa65ee670a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:27 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-03de86ff-4c53-422a-9c18-b83e465eaca5 tempest-CreateVolumesFromImageTest-913962025 None] Volume volume-b16a835b-a3ad-4bb6-adf1-488f82fd4973 (b16a835b-a3ad-4bb6-adf1-488f82fd4973): created successfully
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-03de86ff-4c53-422a-9c18-b83e465eaca5 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec0949ad-0091-45ee-862f-7638a486d84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-03de86ff-4c53-422a-9c18-b83e465eaca5 tempest-CreateVolumesFromImageTest-913962025 None] Flow 'volume_create_manager' (a67a2f87-28ed-4108-9c4f-9e993161e639) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-18c2370e-0bf3-468c-a0a6-cbef991112e4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f42b0e1c-2a50-4850-a80e-aa65ee670a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2087598167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=729799f4-e5df-46f8-8bfd-ef79a656393f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25948ebfc9aa40ea85f787a08c8c28d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:26:28Z,use_quota=True,user_id='99892162098147f5bd99622391c69052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-18c2370e-0bf3-468c-a0a6-cbef991112e4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (132f25e5-4eb0-48e0-863d-278808bb317b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-18c2370e-0bf3-468c-a0a6-cbef991112e4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (132f25e5-4eb0-48e0-863d-278808bb317b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-18c2370e-0bf3-468c-a0a6-cbef991112e4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ae3c7b7-4797-4c18-8d27-d7a3804b4c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-18c2370e-0bf3-468c-a0a6-cbef991112e4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ae3c7b7-4797-4c18-8d27-d7a3804b4c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '729799f4-e5df-46f8-8bfd-ef79a656393f', 'volume_name': 'volume-729799f4-e5df-46f8-8bfd-ef79a656393f', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-18c2370e-0bf3-468c-a0a6-cbef991112e4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13052107-cf4f-42de-bc2b-3eb2a8f9221a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-18c2370e-0bf3-468c-a0a6-cbef991112e4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13052107-cf4f-42de-bc2b-3eb2a8f9221a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-18c2370e-0bf3-468c-a0a6-cbef991112e4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74524bc9-ba2e-4257-a6cd-f06d7e90583f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:27 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-18c2370e-0bf3-468c-a0a6-cbef991112e4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Volume 729799f4-e5df-46f8-8bfd-ef79a656393f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-729799f4-e5df-46f8-8bfd-ef79a656393f', 'volume_size': 1}
Nov 05 19:26:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-18c2370e-0bf3-468c-a0a6-cbef991112e4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:27 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-03de86ff-4c53-422a-9c18-b83e465eaca5 tempest-CreateVolumesFromImageTest-913962025 None] Created volume successfully.
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-f19b67e9-6acb-42d3-ba43-bdfa0dfb627f tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f19b67e9-6acb-42d3-ba43-bdfa0dfb627f tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Flow 'volume_create_manager' (a5f5a4ca-619a-4bd8-aa55-0dea7536b6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:26:28 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f19b67e9-6acb-42d3-ba43-bdfa0dfb627f tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfd68c62-799d-4211-851e-70618cc4facc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2809342b-9ebd-473b-ab26-a8e4f2d74a77 tempest-CreateVolumesFromImageTest-913962025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a7c5890a-cbd2-419c-825b-65c8661d9a5d 1073741824" returned: 0 in 0.685s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f19b67e9-6acb-42d3-ba43-bdfa0dfb627f tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfd68c62-799d-4211-851e-70618cc4facc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-738995162',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a12afa5f-7b4b-4f77-8553-c21f72bd26ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25948ebfc9aa40ea85f787a08c8c28d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:26:28Z,use_quota=True,user_id='99892162098147f5bd99622391c69052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f19b67e9-6acb-42d3-ba43-bdfa0dfb627f tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4620b5d7-d290-45b2-9f32-8ccdc4467f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f19b67e9-6acb-42d3-ba43-bdfa0dfb627f tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4620b5d7-d290-45b2-9f32-8ccdc4467f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f19b67e9-6acb-42d3-ba43-bdfa0dfb627f tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67e15b74-71db-4991-8915-78e4bca38a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f19b67e9-6acb-42d3-ba43-bdfa0dfb627f tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67e15b74-71db-4991-8915-78e4bca38a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a12afa5f-7b4b-4f77-8553-c21f72bd26ca', 'volume_name': 'volume-a12afa5f-7b4b-4f77-8553-c21f72bd26ca', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f19b67e9-6acb-42d3-ba43-bdfa0dfb627f tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47ab83d5-4031-4486-a1b1-7d4ee1d96835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f19b67e9-6acb-42d3-ba43-bdfa0dfb627f tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47ab83d5-4031-4486-a1b1-7d4ee1d96835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f19b67e9-6acb-42d3-ba43-bdfa0dfb627f tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8389f24d-240e-4096-a36b-94603fef7d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:28 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-f19b67e9-6acb-42d3-ba43-bdfa0dfb627f tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Volume a12afa5f-7b4b-4f77-8553-c21f72bd26ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a12afa5f-7b4b-4f77-8553-c21f72bd26ca', 'volume_size': 1}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f19b67e9-6acb-42d3-ba43-bdfa0dfb627f tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2809342b-9ebd-473b-ab26-a8e4f2d74a77 tempest-CreateVolumesFromImageTest-913962025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a7c5890a-cbd2-419c-825b-65c8661d9a5d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:28 devstack sudo[104770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a7c5890a-cbd2-419c-825b-65c8661d9a5d
Nov 05 19:26:28 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Flow 'volume_create_manager' (6229a3c4-01b1-4697-a545-71b26190f2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48b861ec-9deb-4d58-9c75-a9ca61f6062d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:28 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2809342b-9ebd-473b-ab26-a8e4f2d74a77 tempest-CreateVolumesFromImageTest-913962025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a7c5890a-cbd2-419c-825b-65c8661d9a5d" returned: 0 in 0.279s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2809342b-9ebd-473b-ab26-a8e4f2d74a77 tempest-CreateVolumesFromImageTest-913962025 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2809342b-9ebd-473b-ab26-a8e4f2d74a77 tempest-CreateVolumesFromImageTest-913962025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-23286ac7-8529-42f9-8edb-32002d085ad0 tempest-CreateVolumesFromImageTest-913962025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.988s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-23286ac7-8529-42f9-8edb-32002d085ad0 tempest-CreateVolumesFromImageTest-913962025 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1330970692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42c5f8e3-e03d-4842-8062-c61865e11aa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e455968273f2436fb1e285865622455d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:26:26Z,use_quota=True,user_id='3e52d5b7fe9640878208e2540869b727',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-23286ac7-8529-42f9-8edb-32002d085ad0 tempest-CreateVolumesFromImageTest-913962025 None] Creating volume 42c5f8e3-e03d-4842-8062-c61865e11aa5 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-23286ac7-8529-42f9-8edb-32002d085ad0 tempest-CreateVolumesFromImageTest-913962025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-23286ac7-8529-42f9-8edb-32002d085ad0 tempest-CreateVolumesFromImageTest-913962025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-23286ac7-8529-42f9-8edb-32002d085ad0 tempest-CreateVolumesFromImageTest-913962025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-23286ac7-8529-42f9-8edb-32002d085ad0 tempest-CreateVolumesFromImageTest-913962025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-23286ac7-8529-42f9-8edb-32002d085ad0 tempest-CreateVolumesFromImageTest-913962025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-23286ac7-8529-42f9-8edb-32002d085ad0 tempest-CreateVolumesFromImageTest-913962025 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:26:28 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-23286ac7-8529-42f9-8edb-32002d085ad0 tempest-CreateVolumesFromImageTest-913962025 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-23286ac7-8529-42f9-8edb-32002d085ad0 tempest-CreateVolumesFromImageTest-913962025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-42c5f8e3-e03d-4842-8062-c61865e11aa5 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2809342b-9ebd-473b-ab26-a8e4f2d74a77 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48ae5f5c-1f04-4951-8ad9-90be44766539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7c5890a-cbd2-419c-825b-65c8661d9a5d', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2809342b-9ebd-473b-ab26-a8e4f2d74a77 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (258c8cf7-8f83-427a-899f-e40ca372a6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:28 devstack sudo[104774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-42c5f8e3-e03d-4842-8062-c61865e11aa5 1073741824
Nov 05 19:26:28 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48b861ec-9deb-4d58-9c75-a9ca61f6062d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d82d6940-6b43-46e9-b3ad-c4c8d0c8bcd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16c4e6bb36274bf3a2f13f8a4c493539',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:26:28Z,use_quota=True,user_id='602b0994aff044529dd58046fa49e53d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb76662b-b64d-4fdd-ac96-4d58ff3a3898),volume_type_id=bb76662b-b64d-4fdd-ac96-4d58ff3a3898)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (480251ad-bcf1-4d9e-88ab-bcce427c2f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (480251ad-bcf1-4d9e-88ab-bcce427c2f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d58607d-e014-414a-9983-938626117678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.image.glance [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Creating Keystone auth plugin from conf {{(pid=87184) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 19:26:28 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-2809342b-9ebd-473b-ab26-a8e4f2d74a77 tempest-CreateVolumesFromImageTest-913962025 None] Volume volume-a7c5890a-cbd2-419c-825b-65c8661d9a5d (a7c5890a-cbd2-419c-825b-65c8661d9a5d): created successfully
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2809342b-9ebd-473b-ab26-a8e4f2d74a77 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (258c8cf7-8f83-427a-899f-e40ca372a6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2809342b-9ebd-473b-ab26-a8e4f2d74a77 tempest-CreateVolumesFromImageTest-913962025 None] Flow 'volume_create_manager' (b640f3c9-e490-4fbc-9b00-934511813bdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:26:28 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-2809342b-9ebd-473b-ab26-a8e4f2d74a77 tempest-CreateVolumesFromImageTest-913962025 None] Created volume successfully.
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c5e16c9-fd9d-4acc-940c-698a6a4824a4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3c5e16c9-fd9d-4acc-940c-698a6a4824a4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Flow 'volume_create_manager' (6bf0763a-3437-4d79-9f56-9e252f3e33f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3c5e16c9-fd9d-4acc-940c-698a6a4824a4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d20a06f7-8625-483c-9051-fc639f5e7dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3c5e16c9-fd9d-4acc-940c-698a6a4824a4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d20a06f7-8625-483c-9051-fc639f5e7dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1746827816',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13f92cdd-c7db-4d2a-ae87-8b5bbdd46baa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25948ebfc9aa40ea85f787a08c8c28d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:26:29Z,use_quota=True,user_id='99892162098147f5bd99622391c69052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3c5e16c9-fd9d-4acc-940c-698a6a4824a4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62b08270-5558-41d1-9e0d-f67d1ff0d2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3c5e16c9-fd9d-4acc-940c-698a6a4824a4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62b08270-5558-41d1-9e0d-f67d1ff0d2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3c5e16c9-fd9d-4acc-940c-698a6a4824a4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c96018ec-762d-477a-bd24-76a060b02dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3c5e16c9-fd9d-4acc-940c-698a6a4824a4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c96018ec-762d-477a-bd24-76a060b02dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13f92cdd-c7db-4d2a-ae87-8b5bbdd46baa', 'volume_name': 'volume-13f92cdd-c7db-4d2a-ae87-8b5bbdd46baa', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3c5e16c9-fd9d-4acc-940c-698a6a4824a4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27afdfed-5080-4ff1-b035-e79d2eadc7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3c5e16c9-fd9d-4acc-940c-698a6a4824a4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27afdfed-5080-4ff1-b035-e79d2eadc7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3c5e16c9-fd9d-4acc-940c-698a6a4824a4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1059b8d-977a-4554-9a9a-e7cb6c3864e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:28 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-3c5e16c9-fd9d-4acc-940c-698a6a4824a4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Volume 13f92cdd-c7db-4d2a-ae87-8b5bbdd46baa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13f92cdd-c7db-4d2a-ae87-8b5bbdd46baa', 'volume_size': 1}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3c5e16c9-fd9d-4acc-940c-698a6a4824a4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3a053ca-77a9-42a2-87fc-a460dd2d5448 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d3a053ca-77a9-42a2-87fc-a460dd2d5448 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Flow 'volume_create_manager' (8746942a-1fbe-467a-abeb-96511192fa2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:26:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d3a053ca-77a9-42a2-87fc-a460dd2d5448 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d0eaeb7-1f3f-411c-957c-0cd4dd3fa82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d3a053ca-77a9-42a2-87fc-a460dd2d5448 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d0eaeb7-1f3f-411c-957c-0cd4dd3fa82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-37199690',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11d10849-6919-4437-af7b-c3dd4004ba8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25948ebfc9aa40ea85f787a08c8c28d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:26:29Z,use_quota=True,user_id='99892162098147f5bd99622391c69052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d3a053ca-77a9-42a2-87fc-a460dd2d5448 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef144cfb-848f-4a60-969c-7cbb0aa41a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d3a053ca-77a9-42a2-87fc-a460dd2d5448 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef144cfb-848f-4a60-969c-7cbb0aa41a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d3a053ca-77a9-42a2-87fc-a460dd2d5448 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3399cf8-b7f7-4531-83ac-78b374e8c5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d3a053ca-77a9-42a2-87fc-a460dd2d5448 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3399cf8-b7f7-4531-83ac-78b374e8c5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11d10849-6919-4437-af7b-c3dd4004ba8a', 'volume_name': 'volume-11d10849-6919-4437-af7b-c3dd4004ba8a', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d3a053ca-77a9-42a2-87fc-a460dd2d5448 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f53e02ce-b686-482b-a16d-c6a49fe0aba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d3a053ca-77a9-42a2-87fc-a460dd2d5448 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f53e02ce-b686-482b-a16d-c6a49fe0aba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d3a053ca-77a9-42a2-87fc-a460dd2d5448 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (655bfcd4-69c9-49b1-9ea4-475da86fd4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:29 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-d3a053ca-77a9-42a2-87fc-a460dd2d5448 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Volume 11d10849-6919-4437-af7b-c3dd4004ba8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11d10849-6919-4437-af7b-c3dd4004ba8a', 'volume_size': 1}
Nov 05 19:26:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d3a053ca-77a9-42a2-87fc-a460dd2d5448 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d58607d-e014-414a-9983-938626117678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd82d6940-6b43-46e9-b3ad-c4c8d0c8bcd1', 'volume_name': 'volume-d82d6940-6b43-46e9-b3ad-c4c8d0c8bcd1', 'volume_size': 1, 'image_id': 'b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2a276b2380e0179f6c2254c6bccc5047', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '16c4e6bb36274bf3a2f13f8a4c493539', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '76731964095ac2499bd73ce87f6fcb26955ba28f189155205ba4723b7d075a50c5aee24cafd191cbc69f3895024036c0781867f0b6aa68710ca68cdd5adaf64d', 'id': 'b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf', 'created_at': datetime.datetime(2026, 11, 5, 18, 26, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 18, 26, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x736631e6f410>}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63fa4b50-b424-4eb2-b994-85c3eda553e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63fa4b50-b424-4eb2-b994-85c3eda553e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9cff4d9-f87d-4658-90be-a3964bd5756f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:29 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Volume d82d6940-6b43-46e9-b3ad-c4c8d0c8bcd1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d82d6940-6b43-46e9-b3ad-c4c8d0c8bcd1', 'volume_size': 1, 'image_id': 'b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2a276b2380e0179f6c2254c6bccc5047', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '16c4e6bb36274bf3a2f13f8a4c493539', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '76731964095ac2499bd73ce87f6fcb26955ba28f189155205ba4723b7d075a50c5aee24cafd191cbc69f3895024036c0781867f0b6aa68710ca68cdd5adaf64d', 'id': 'b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf', 'created_at': datetime.datetime(2026, 11, 5, 18, 26, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 18, 26, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x736631e6f410>}
Nov 05 19:26:29 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Trying to clone d82d6940-6b43-46e9-b3ad-c4c8d0c8bcd1 from image b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf at location (None, [{'url': 'file:///opt/stack/data/glance/images/b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf', 'metadata': {}}]). {{(pid=87184) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 19:26:29 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-23286ac7-8529-42f9-8edb-32002d085ad0 tempest-CreateVolumesFromImageTest-913962025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-42c5f8e3-e03d-4842-8062-c61865e11aa5 1073741824" returned: 0 in 0.478s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-23286ac7-8529-42f9-8edb-32002d085ad0 tempest-CreateVolumesFromImageTest-913962025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-42c5f8e3-e03d-4842-8062-c61865e11aa5 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:29 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf_kr0jxb5sdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 19:26:29 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Image download 0.00 MB at 0.00 MB/s
Nov 05 19:26:29 devstack sudo[104779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-42c5f8e3-e03d-4842-8062-c61865e11aa5
Nov 05 19:26:29 devstack sudo[104779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:29 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d669cf1c-badf-416a-907a-592312d9b9d0]: (4, 'raw') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:26:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf_kr0jxb5sdevstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:29 devstack sudo[104781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf_kr0jxb5sdevstack@QuobyteHD
Nov 05 19:26:29 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:29 devstack sudo[104779]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-23286ac7-8529-42f9-8edb-32002d085ad0 tempest-CreateVolumesFromImageTest-913962025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-42c5f8e3-e03d-4842-8062-c61865e11aa5" returned: 0 in 0.263s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:29 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-23286ac7-8529-42f9-8edb-32002d085ad0 tempest-CreateVolumesFromImageTest-913962025 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:26:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-23286ac7-8529-42f9-8edb-32002d085ad0 tempest-CreateVolumesFromImageTest-913962025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-926d86e9-11be-4d5e-97e8-963f51c60396 tempest-VolumeDependencyTests-1893183406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.593s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-23286ac7-8529-42f9-8edb-32002d085ad0 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a852c10-26ca-402f-b441-8b1a81203a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42c5f8e3-e03d-4842-8062-c61865e11aa5', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-23286ac7-8529-42f9-8edb-32002d085ad0 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6c5f7c5-d5cd-407c-b5a5-2829bd17d28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:29 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-926d86e9-11be-4d5e-97e8-963f51c60396 tempest-VolumeDependencyTests-1893183406 None] Creating offline snapshot 136f76eb-706b-49d3-b5b7-49720e59f891 of volume 283b6041-9ccd-4729-9a6b-f0c0d86c3b86 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:26:29 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-23286ac7-8529-42f9-8edb-32002d085ad0 tempest-CreateVolumesFromImageTest-913962025 None] Volume volume-42c5f8e3-e03d-4842-8062-c61865e11aa5 (42c5f8e3-e03d-4842-8062-c61865e11aa5): created successfully
Nov 05 19:26:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-23286ac7-8529-42f9-8edb-32002d085ad0 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6c5f7c5-d5cd-407c-b5a5-2829bd17d28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-23286ac7-8529-42f9-8edb-32002d085ad0 tempest-CreateVolumesFromImageTest-913962025 None] Flow 'volume_create_manager' (9a4811d2-b842-4f34-923a-d1d332a233ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:26:29 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7dfd63-cb30-4760-bc2d-101ada980aa3]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:26:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-926d86e9-11be-4d5e-97e8-963f51c60396 tempest-VolumeDependencyTests-1893183406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:29 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-23286ac7-8529-42f9-8edb-32002d085ad0 tempest-CreateVolumesFromImageTest-913962025 None] Created volume successfully.
Nov 05 19:26:29 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf_kr0jxb5sdevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf_kr0jxb5sdevstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:29 devstack sudo[104784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86
Nov 05 19:26:29 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:29 devstack sudo[104787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf_kr0jxb5sdevstack@QuobyteHD
Nov 05 19:26:29 devstack sudo[104787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:29 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-926d86e9-11be-4d5e-97e8-963f51c60396 tempest-VolumeDependencyTests-1893183406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86" returned: 0 in 0.368s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-926d86e9-11be-4d5e-97e8-963f51c60396 tempest-VolumeDependencyTests-1893183406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86.136f76eb-706b-49d3-b5b7-49720e59f891 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:29 devstack sudo[104793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86.136f76eb-706b-49d3-b5b7-49720e59f891 1G
Nov 05 19:26:29 devstack sudo[104793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:29 devstack sudo[104787]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf_kr0jxb5sdevstack@QuobyteHD" returned: 1 in 0.344s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf_kr0jxb5sdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 19:26:30 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Temporary image b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf is fetched for user 602b0994aff044529dd58046fa49e53d. {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 19:26:30 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab894fad-d672-4451-a3cd-558bd53d445a]: (4, 'raw') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:26:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf_kr0jxb5sdevstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:30 devstack sudo[104798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf_kr0jxb5sdevstack@QuobyteHD
Nov 05 19:26:30 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:30 devstack sudo[104793]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-926d86e9-11be-4d5e-97e8-963f51c60396 tempest-VolumeDependencyTests-1893183406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86.136f76eb-706b-49d3-b5b7-49720e59f891 1G" returned: 0 in 0.418s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-926d86e9-11be-4d5e-97e8-963f51c60396 tempest-VolumeDependencyTests-1893183406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86.136f76eb-706b-49d3-b5b7-49720e59f891 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:30 devstack sudo[104803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86.136f76eb-706b-49d3-b5b7-49720e59f891
Nov 05 19:26:30 devstack sudo[104803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:30 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf_kr0jxb5sdevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf_kr0jxb5sdevstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:30 devstack sudo[104807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf_kr0jxb5sdevstack@QuobyteHD
Nov 05 19:26:30 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:30 devstack sudo[104803]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-926d86e9-11be-4d5e-97e8-963f51c60396 tempest-VolumeDependencyTests-1893183406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86.136f76eb-706b-49d3-b5b7-49720e59f891" returned: 0 in 0.307s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:30 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-926d86e9-11be-4d5e-97e8-963f51c60396 tempest-VolumeDependencyTests-1893183406 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86.136f76eb-706b-49d3-b5b7-49720e59f891 is being set with open permissions: ugo+rw
Nov 05 19:26:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-926d86e9-11be-4d5e-97e8-963f51c60396 tempest-VolumeDependencyTests-1893183406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86.136f76eb-706b-49d3-b5b7-49720e59f891 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:30 devstack sudo[104812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86.136f76eb-706b-49d3-b5b7-49720e59f891
Nov 05 19:26:30 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:30 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf_kr0jxb5sdevstack@QuobyteHD" returned: 1 in 0.319s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf_kr0jxb5sdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 19:26:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:30 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-926d86e9-11be-4d5e-97e8-963f51c60396 tempest-VolumeDependencyTests-1893183406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86.136f76eb-706b-49d3-b5b7-49720e59f891" returned: 0 in 0.244s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-926d86e9-11be-4d5e-97e8-963f51c60396 tempest-VolumeDependencyTests-1893183406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:30 devstack sudo[104818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86.info
Nov 05 19:26:30 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:31 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-926d86e9-11be-4d5e-97e8-963f51c60396 tempest-VolumeDependencyTests-1893183406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86.info" returned: 0 in 0.244s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:31 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-926d86e9-11be-4d5e-97e8-963f51c60396 tempest-VolumeDependencyTests-1893183406 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86.info is being set with open permissions: ugo+rw
Nov 05 19:26:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-926d86e9-11be-4d5e-97e8-963f51c60396 tempest-VolumeDependencyTests-1893183406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:31 devstack sudo[104821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86.info
Nov 05 19:26:31 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:31 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-926d86e9-11be-4d5e-97e8-963f51c60396 tempest-VolumeDependencyTests-1893183406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86.info" returned: 0 in 0.240s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-926d86e9-11be-4d5e-97e8-963f51c60396 tempest-VolumeDependencyTests-1893183406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.931s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fc2b8058-b1f9-4876-aa24-790b028e2711 tempest-CreateVolumesFromImageTest-913962025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.227s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fc2b8058-b1f9-4876-aa24-790b028e2711 tempest-CreateVolumesFromImageTest-913962025 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1043145579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fc9e83b-44ef-4320-8795-e18551b043d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e455968273f2436fb1e285865622455d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:26:26Z,use_quota=True,user_id='3e52d5b7fe9640878208e2540869b727',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:26:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-fc2b8058-b1f9-4876-aa24-790b028e2711 tempest-CreateVolumesFromImageTest-913962025 None] Creating volume 2fc9e83b-44ef-4320-8795-e18551b043d9 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:26:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fc2b8058-b1f9-4876-aa24-790b028e2711 tempest-CreateVolumesFromImageTest-913962025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fc2b8058-b1f9-4876-aa24-790b028e2711 tempest-CreateVolumesFromImageTest-913962025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fc2b8058-b1f9-4876-aa24-790b028e2711 tempest-CreateVolumesFromImageTest-913962025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:26:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fc2b8058-b1f9-4876-aa24-790b028e2711 tempest-CreateVolumesFromImageTest-913962025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:26:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fc2b8058-b1f9-4876-aa24-790b028e2711 tempest-CreateVolumesFromImageTest-913962025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fc2b8058-b1f9-4876-aa24-790b028e2711 tempest-CreateVolumesFromImageTest-913962025 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:26:31 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-fc2b8058-b1f9-4876-aa24-790b028e2711 tempest-CreateVolumesFromImageTest-913962025 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:26:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fc2b8058-b1f9-4876-aa24-790b028e2711 tempest-CreateVolumesFromImageTest-913962025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-2fc9e83b-44ef-4320-8795-e18551b043d9 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:31 devstack sudo[104824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-2fc9e83b-44ef-4320-8795-e18551b043d9 1073741824
Nov 05 19:26:31 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:31 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-926d86e9-11be-4d5e-97e8-963f51c60396 tempest-VolumeDependencyTests-1893183406 None] Create snapshot completed successfully
Nov 05 19:26:31 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fc2b8058-b1f9-4876-aa24-790b028e2711 tempest-CreateVolumesFromImageTest-913962025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-2fc9e83b-44ef-4320-8795-e18551b043d9 1073741824" returned: 0 in 0.418s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fc2b8058-b1f9-4876-aa24-790b028e2711 tempest-CreateVolumesFromImageTest-913962025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-2fc9e83b-44ef-4320-8795-e18551b043d9 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:31 devstack sudo[104830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-2fc9e83b-44ef-4320-8795-e18551b043d9
Nov 05 19:26:31 devstack sudo[104830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:32 devstack sudo[104830]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fc2b8058-b1f9-4876-aa24-790b028e2711 tempest-CreateVolumesFromImageTest-913962025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-2fc9e83b-44ef-4320-8795-e18551b043d9" returned: 0 in 0.248s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fc2b8058-b1f9-4876-aa24-790b028e2711 tempest-CreateVolumesFromImageTest-913962025 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fc2b8058-b1f9-4876-aa24-790b028e2711 tempest-CreateVolumesFromImageTest-913962025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f22a0dde-35be-4e19-9ff2-ab755ba7743c tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.757s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f22a0dde-35be-4e19-9ff2-ab755ba7743c tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-149924835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07d1e4d9-5678-47b2-adfc-3a423876e952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25948ebfc9aa40ea85f787a08c8c28d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:26:27Z,use_quota=True,user_id='99892162098147f5bd99622391c69052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-f22a0dde-35be-4e19-9ff2-ab755ba7743c tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Creating volume 07d1e4d9-5678-47b2-adfc-3a423876e952 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f22a0dde-35be-4e19-9ff2-ab755ba7743c tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f22a0dde-35be-4e19-9ff2-ab755ba7743c tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f22a0dde-35be-4e19-9ff2-ab755ba7743c tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f22a0dde-35be-4e19-9ff2-ab755ba7743c tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f22a0dde-35be-4e19-9ff2-ab755ba7743c tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f22a0dde-35be-4e19-9ff2-ab755ba7743c tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:26:32 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-f22a0dde-35be-4e19-9ff2-ab755ba7743c tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f22a0dde-35be-4e19-9ff2-ab755ba7743c tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-07d1e4d9-5678-47b2-adfc-3a423876e952 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fc2b8058-b1f9-4876-aa24-790b028e2711 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f6fa0e7-e747-42a5-a9cc-e8424082cb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fc9e83b-44ef-4320-8795-e18551b043d9', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:32 devstack sudo[104833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-07d1e4d9-5678-47b2-adfc-3a423876e952 1073741824
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fc2b8058-b1f9-4876-aa24-790b028e2711 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb8dcac0-8e56-4389-ae8b-a41ae0a62181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:32 devstack sudo[104833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:32 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-fc2b8058-b1f9-4876-aa24-790b028e2711 tempest-CreateVolumesFromImageTest-913962025 None] Volume volume-2fc9e83b-44ef-4320-8795-e18551b043d9 (2fc9e83b-44ef-4320-8795-e18551b043d9): created successfully
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fc2b8058-b1f9-4876-aa24-790b028e2711 tempest-CreateVolumesFromImageTest-913962025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb8dcac0-8e56-4389-ae8b-a41ae0a62181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fc2b8058-b1f9-4876-aa24-790b028e2711 tempest-CreateVolumesFromImageTest-913962025 None] Flow 'volume_create_manager' (7a5dfc7a-2d87-4f77-a4bc-c1233674ffea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:26:32 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-fc2b8058-b1f9-4876-aa24-790b028e2711 tempest-CreateVolumesFromImageTest-913962025 None] Created volume successfully.
Nov 05 19:26:32 devstack sudo[104833]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f22a0dde-35be-4e19-9ff2-ab755ba7743c tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-07d1e4d9-5678-47b2-adfc-3a423876e952 1073741824" returned: 0 in 0.457s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f22a0dde-35be-4e19-9ff2-ab755ba7743c tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-07d1e4d9-5678-47b2-adfc-3a423876e952 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:32 devstack sudo[104839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-07d1e4d9-5678-47b2-adfc-3a423876e952
Nov 05 19:26:32 devstack sudo[104839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7cf41b6f-a830-4f1a-8ffd-cc1f76e56ace tempest-CreateVolumesFromImageTest-913962025 None] Acquiring lock "cinder-2fc9e83b-44ef-4320-8795-e18551b043d9-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7cf41b6f-a830-4f1a-8ffd-cc1f76e56ace tempest-CreateVolumesFromImageTest-913962025 None] Lock "cinder-2fc9e83b-44ef-4320-8795-e18551b043d9-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Flow 'volume_create_manager' (b1c4e788-7ddc-45a6-ac8d-de2e17dc14b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09723129-6a4e-4882-9c14-a1b0259aec39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:32 devstack sudo[104839]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09723129-6a4e-4882-9c14-a1b0259aec39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-822088577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2382de9-03fb-4a34-be2c-fa3776937c8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e98bc67e06a493bbc5f56981d82c3af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=136f76eb-706b-49d3-b5b7-49720e59f891,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:26:33Z,use_quota=True,user_id='1ebd949977e942f8b984ba19b2189fff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (737892fb-9350-448c-ab39-480ef91b0c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (737892fb-9350-448c-ab39-480ef91b0c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ce96be-dcde-406c-8b7a-2e3997f20fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ce96be-dcde-406c-8b7a-2e3997f20fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f2382de9-03fb-4a34-be2c-fa3776937c8c', 'volume_name': 'volume-f2382de9-03fb-4a34-be2c-fa3776937c8c', 'volume_size': 1, 'snapshot_id': '136f76eb-706b-49d3-b5b7-49720e59f891'}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (403728ff-72f1-48da-bb4b-0924a8a349c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (403728ff-72f1-48da-bb4b-0924a8a349c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (986c8517-df7b-4e37-bd30-0ee8c7a510cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:32 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Volume f2382de9-03fb-4a34-be2c-fa3776937c8c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f2382de9-03fb-4a34-be2c-fa3776937c8c', 'volume_size': 1, 'snapshot_id': '136f76eb-706b-49d3-b5b7-49720e59f891'}
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f22a0dde-35be-4e19-9ff2-ab755ba7743c tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-07d1e4d9-5678-47b2-adfc-3a423876e952" returned: 0 in 0.333s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f22a0dde-35be-4e19-9ff2-ab755ba7743c tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f22a0dde-35be-4e19-9ff2-ab755ba7743c tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-18c2370e-0bf3-468c-a0a6-cbef991112e4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.185s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-18c2370e-0bf3-468c-a0a6-cbef991112e4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2087598167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=729799f4-e5df-46f8-8bfd-ef79a656393f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25948ebfc9aa40ea85f787a08c8c28d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:26:28Z,use_quota=True,user_id='99892162098147f5bd99622391c69052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-18c2370e-0bf3-468c-a0a6-cbef991112e4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Creating volume 729799f4-e5df-46f8-8bfd-ef79a656393f {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-18c2370e-0bf3-468c-a0a6-cbef991112e4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-18c2370e-0bf3-468c-a0a6-cbef991112e4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-18c2370e-0bf3-468c-a0a6-cbef991112e4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-18c2370e-0bf3-468c-a0a6-cbef991112e4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-18c2370e-0bf3-468c-a0a6-cbef991112e4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-18c2370e-0bf3-468c-a0a6-cbef991112e4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:26:32 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-18c2370e-0bf3-468c-a0a6-cbef991112e4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:26:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-18c2370e-0bf3-468c-a0a6-cbef991112e4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-729799f4-e5df-46f8-8bfd-ef79a656393f 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:33 devstack sudo[104843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-729799f4-e5df-46f8-8bfd-ef79a656393f 1073741824
Nov 05 19:26:33 devstack sudo[104843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f22a0dde-35be-4e19-9ff2-ab755ba7743c tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c022dcb-9a8d-4ff3-92f7-233a3d713248) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07d1e4d9-5678-47b2-adfc-3a423876e952', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f22a0dde-35be-4e19-9ff2-ab755ba7743c tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19b490d-d11a-4678-902d-5f94d0b4c433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7cf41b6f-a830-4f1a-8ffd-cc1f76e56ace tempest-CreateVolumesFromImageTest-913962025 None] Acquiring lock "cinder-quobyte-2fc9e83b-44ef-4320-8795-e18551b043d9" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:26:33 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-f22a0dde-35be-4e19-9ff2-ab755ba7743c tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Volume volume-07d1e4d9-5678-47b2-adfc-3a423876e952 (07d1e4d9-5678-47b2-adfc-3a423876e952): created successfully
Nov 05 19:26:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f22a0dde-35be-4e19-9ff2-ab755ba7743c tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19b490d-d11a-4678-902d-5f94d0b4c433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f22a0dde-35be-4e19-9ff2-ab755ba7743c tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Flow 'volume_create_manager' (76465036-c5ce-4432-866d-5ed747515490) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:26:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7cf41b6f-a830-4f1a-8ffd-cc1f76e56ace tempest-CreateVolumesFromImageTest-913962025 None] Lock "cinder-quobyte-2fc9e83b-44ef-4320-8795-e18551b043d9" acquired by "delete_volume" :: waited 0.031s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:26:33 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f22a0dde-35be-4e19-9ff2-ab755ba7743c tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Created volume successfully.
Nov 05 19:26:33 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a19cfa-82c3-4eb9-bf9b-93271e5c19ea]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:26:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7cf41b6f-a830-4f1a-8ffd-cc1f76e56ace tempest-CreateVolumesFromImageTest-913962025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-2fc9e83b-44ef-4320-8795-e18551b043d9 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:33 devstack sudo[104845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-2fc9e83b-44ef-4320-8795-e18551b043d9
Nov 05 19:26:33 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:33 devstack sudo[104843]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-18c2370e-0bf3-468c-a0a6-cbef991112e4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-729799f4-e5df-46f8-8bfd-ef79a656393f 1073741824" returned: 0 in 0.417s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-18c2370e-0bf3-468c-a0a6-cbef991112e4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-729799f4-e5df-46f8-8bfd-ef79a656393f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:33 devstack sudo[104852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-729799f4-e5df-46f8-8bfd-ef79a656393f
Nov 05 19:26:33 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:33 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7cf41b6f-a830-4f1a-8ffd-cc1f76e56ace tempest-CreateVolumesFromImageTest-913962025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-2fc9e83b-44ef-4320-8795-e18551b043d9" returned: 0 in 0.394s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7cf41b6f-a830-4f1a-8ffd-cc1f76e56ace tempest-CreateVolumesFromImageTest-913962025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-2fc9e83b-44ef-4320-8795-e18551b043d9 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:33 devstack sudo[104855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-2fc9e83b-44ef-4320-8795-e18551b043d9
Nov 05 19:26:33 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:33 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-18c2370e-0bf3-468c-a0a6-cbef991112e4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-729799f4-e5df-46f8-8bfd-ef79a656393f" returned: 0 in 0.257s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-18c2370e-0bf3-468c-a0a6-cbef991112e4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:26:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-18c2370e-0bf3-468c-a0a6-cbef991112e4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f19b67e9-6acb-42d3-ba43-bdfa0dfb627f tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.333s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f19b67e9-6acb-42d3-ba43-bdfa0dfb627f tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-738995162',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a12afa5f-7b4b-4f77-8553-c21f72bd26ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25948ebfc9aa40ea85f787a08c8c28d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:26:28Z,use_quota=True,user_id='99892162098147f5bd99622391c69052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:26:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-f19b67e9-6acb-42d3-ba43-bdfa0dfb627f tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Creating volume a12afa5f-7b4b-4f77-8553-c21f72bd26ca {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:26:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f19b67e9-6acb-42d3-ba43-bdfa0dfb627f tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f19b67e9-6acb-42d3-ba43-bdfa0dfb627f tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f19b67e9-6acb-42d3-ba43-bdfa0dfb627f tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:26:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f19b67e9-6acb-42d3-ba43-bdfa0dfb627f tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:26:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f19b67e9-6acb-42d3-ba43-bdfa0dfb627f tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f19b67e9-6acb-42d3-ba43-bdfa0dfb627f tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:26:33 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-f19b67e9-6acb-42d3-ba43-bdfa0dfb627f tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:26:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f19b67e9-6acb-42d3-ba43-bdfa0dfb627f tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a12afa5f-7b4b-4f77-8553-c21f72bd26ca 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:33 devstack sudo[104858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a12afa5f-7b4b-4f77-8553-c21f72bd26ca 1073741824
Nov 05 19:26:33 devstack sudo[104858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-18c2370e-0bf3-468c-a0a6-cbef991112e4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74524bc9-ba2e-4257-a6cd-f06d7e90583f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-729799f4-e5df-46f8-8bfd-ef79a656393f', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-18c2370e-0bf3-468c-a0a6-cbef991112e4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0e83ef3-464e-4a67-8bc1-7f3915cfbe11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:33 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-18c2370e-0bf3-468c-a0a6-cbef991112e4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Volume volume-729799f4-e5df-46f8-8bfd-ef79a656393f (729799f4-e5df-46f8-8bfd-ef79a656393f): created successfully
Nov 05 19:26:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-18c2370e-0bf3-468c-a0a6-cbef991112e4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0e83ef3-464e-4a67-8bc1-7f3915cfbe11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:33 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-18c2370e-0bf3-468c-a0a6-cbef991112e4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Flow 'volume_create_manager' (01604c51-b35e-4cb8-99f1-10fdad8c90fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:26:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7cf41b6f-a830-4f1a-8ffd-cc1f76e56ace tempest-CreateVolumesFromImageTest-913962025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-2fc9e83b-44ef-4320-8795-e18551b043d9" returned: 0 in 0.267s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:33 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-18c2370e-0bf3-468c-a0a6-cbef991112e4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Created volume successfully.
Nov 05 19:26:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7cf41b6f-a830-4f1a-8ffd-cc1f76e56ace tempest-CreateVolumesFromImageTest-913962025 None] Lock "cinder-quobyte-2fc9e83b-44ef-4320-8795-e18551b043d9" released by "delete_volume" :: held 0.732s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:26:33 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-7cf41b6f-a830-4f1a-8ffd-cc1f76e56ace tempest-CreateVolumesFromImageTest-913962025 None] Created reservations ['b3482804-033d-4ff3-abfa-238466ec3d9e', '12c3bed5-c6e1-4830-891f-6532eadbe67f', 'd7ecd230-ace8-47d9-ab34-25266f9a0db2', 'de4d1bd6-2fac-4c7f-8a5f-ca937c3f3a99'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:26:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7cf41b6f-a830-4f1a-8ffd-cc1f76e56ace tempest-CreateVolumesFromImageTest-913962025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7cf41b6f-a830-4f1a-8ffd-cc1f76e56ace tempest-CreateVolumesFromImageTest-913962025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7cf41b6f-a830-4f1a-8ffd-cc1f76e56ace tempest-CreateVolumesFromImageTest-913962025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:26:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7cf41b6f-a830-4f1a-8ffd-cc1f76e56ace tempest-CreateVolumesFromImageTest-913962025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:26:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7cf41b6f-a830-4f1a-8ffd-cc1f76e56ace tempest-CreateVolumesFromImageTest-913962025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7cf41b6f-a830-4f1a-8ffd-cc1f76e56ace tempest-CreateVolumesFromImageTest-913962025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:33 devstack sudo[104861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:26:33 devstack sudo[104861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-743dd1a5-528d-4e16-ba29-559454f9adaa tempest-CreateVolumesFromImageTest-913962025 None] Acquiring lock "cinder-42c5f8e3-e03d-4842-8062-c61865e11aa5-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:26:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-743dd1a5-528d-4e16-ba29-559454f9adaa tempest-CreateVolumesFromImageTest-913962025 None] Lock "cinder-42c5f8e3-e03d-4842-8062-c61865e11aa5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:26:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-743dd1a5-528d-4e16-ba29-559454f9adaa tempest-CreateVolumesFromImageTest-913962025 None] Acquiring lock "cinder-quobyte-42c5f8e3-e03d-4842-8062-c61865e11aa5" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:26:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-743dd1a5-528d-4e16-ba29-559454f9adaa tempest-CreateVolumesFromImageTest-913962025 None] Lock "cinder-quobyte-42c5f8e3-e03d-4842-8062-c61865e11aa5" acquired by "delete_volume" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:26:34 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6690b627-52f3-42bd-9c22-afddf9ace038]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:26:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-743dd1a5-528d-4e16-ba29-559454f9adaa tempest-CreateVolumesFromImageTest-913962025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-42c5f8e3-e03d-4842-8062-c61865e11aa5 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:34 devstack sudo[104861]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:34 devstack sudo[104866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-42c5f8e3-e03d-4842-8062-c61865e11aa5
Nov 05 19:26:34 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7cf41b6f-a830-4f1a-8ffd-cc1f76e56ace tempest-CreateVolumesFromImageTest-913962025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.320s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:34 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-7cf41b6f-a830-4f1a-8ffd-cc1f76e56ace tempest-CreateVolumesFromImageTest-913962025 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:26:34 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-7cf41b6f-a830-4f1a-8ffd-cc1f76e56ace tempest-CreateVolumesFromImageTest-913962025 None] Deleted volume successfully.
Nov 05 19:26:34 devstack sudo[104858]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f19b67e9-6acb-42d3-ba43-bdfa0dfb627f tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a12afa5f-7b4b-4f77-8553-c21f72bd26ca 1073741824" returned: 0 in 0.576s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7cf41b6f-a830-4f1a-8ffd-cc1f76e56ace tempest-CreateVolumesFromImageTest-913962025 None] Lock "cinder-2fc9e83b-44ef-4320-8795-e18551b043d9-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:26:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f19b67e9-6acb-42d3-ba43-bdfa0dfb627f tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a12afa5f-7b4b-4f77-8553-c21f72bd26ca {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:34 devstack sudo[104869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a12afa5f-7b4b-4f77-8553-c21f72bd26ca
Nov 05 19:26:34 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:34 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-743dd1a5-528d-4e16-ba29-559454f9adaa tempest-CreateVolumesFromImageTest-913962025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-42c5f8e3-e03d-4842-8062-c61865e11aa5" returned: 0 in 0.379s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-743dd1a5-528d-4e16-ba29-559454f9adaa tempest-CreateVolumesFromImageTest-913962025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-42c5f8e3-e03d-4842-8062-c61865e11aa5 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:34 devstack sudo[104874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-42c5f8e3-e03d-4842-8062-c61865e11aa5
Nov 05 19:26:34 devstack sudo[104874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:34 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f19b67e9-6acb-42d3-ba43-bdfa0dfb627f tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a12afa5f-7b4b-4f77-8553-c21f72bd26ca" returned: 0 in 0.285s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f19b67e9-6acb-42d3-ba43-bdfa0dfb627f tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:26:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f19b67e9-6acb-42d3-ba43-bdfa0dfb627f tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3c5e16c9-fd9d-4acc-940c-698a6a4824a4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.690s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3c5e16c9-fd9d-4acc-940c-698a6a4824a4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1746827816',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13f92cdd-c7db-4d2a-ae87-8b5bbdd46baa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25948ebfc9aa40ea85f787a08c8c28d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:26:29Z,use_quota=True,user_id='99892162098147f5bd99622391c69052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:26:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-3c5e16c9-fd9d-4acc-940c-698a6a4824a4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Creating volume 13f92cdd-c7db-4d2a-ae87-8b5bbdd46baa {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:26:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3c5e16c9-fd9d-4acc-940c-698a6a4824a4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3c5e16c9-fd9d-4acc-940c-698a6a4824a4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3c5e16c9-fd9d-4acc-940c-698a6a4824a4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:26:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3c5e16c9-fd9d-4acc-940c-698a6a4824a4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:26:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3c5e16c9-fd9d-4acc-940c-698a6a4824a4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3c5e16c9-fd9d-4acc-940c-698a6a4824a4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:26:34 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-3c5e16c9-fd9d-4acc-940c-698a6a4824a4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:26:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3c5e16c9-fd9d-4acc-940c-698a6a4824a4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-13f92cdd-c7db-4d2a-ae87-8b5bbdd46baa 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:34 devstack sudo[104877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-13f92cdd-c7db-4d2a-ae87-8b5bbdd46baa 1073741824
Nov 05 19:26:34 devstack sudo[104877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f19b67e9-6acb-42d3-ba43-bdfa0dfb627f tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8389f24d-240e-4096-a36b-94603fef7d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a12afa5f-7b4b-4f77-8553-c21f72bd26ca', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f19b67e9-6acb-42d3-ba43-bdfa0dfb627f tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48e7d326-4615-4d42-b3fa-61d084ee14a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:34 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-f19b67e9-6acb-42d3-ba43-bdfa0dfb627f tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Volume volume-a12afa5f-7b4b-4f77-8553-c21f72bd26ca (a12afa5f-7b4b-4f77-8553-c21f72bd26ca): created successfully
Nov 05 19:26:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f19b67e9-6acb-42d3-ba43-bdfa0dfb627f tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48e7d326-4615-4d42-b3fa-61d084ee14a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:34 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f19b67e9-6acb-42d3-ba43-bdfa0dfb627f tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Flow 'volume_create_manager' (a5f5a4ca-619a-4bd8-aa55-0dea7536b6a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:26:34 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f19b67e9-6acb-42d3-ba43-bdfa0dfb627f tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Created volume successfully.
Nov 05 19:26:34 devstack sudo[104874]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-743dd1a5-528d-4e16-ba29-559454f9adaa tempest-CreateVolumesFromImageTest-913962025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-42c5f8e3-e03d-4842-8062-c61865e11aa5" returned: 0 in 0.268s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-743dd1a5-528d-4e16-ba29-559454f9adaa tempest-CreateVolumesFromImageTest-913962025 None] Lock "cinder-quobyte-42c5f8e3-e03d-4842-8062-c61865e11aa5" released by "delete_volume" :: held 0.693s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:26:34 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-743dd1a5-528d-4e16-ba29-559454f9adaa tempest-CreateVolumesFromImageTest-913962025 None] Created reservations ['44036894-42fb-4349-900e-e73454a96978', '9c55d5c3-f47c-4ee1-bdd1-30867598668f', 'aeb23df7-0c1a-494b-a3d1-75f0613ad397', 'acab551d-4444-4318-b5a2-501809f7b4cd'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:26:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-743dd1a5-528d-4e16-ba29-559454f9adaa tempest-CreateVolumesFromImageTest-913962025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-743dd1a5-528d-4e16-ba29-559454f9adaa tempest-CreateVolumesFromImageTest-913962025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-743dd1a5-528d-4e16-ba29-559454f9adaa tempest-CreateVolumesFromImageTest-913962025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:26:34 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-743dd1a5-528d-4e16-ba29-559454f9adaa tempest-CreateVolumesFromImageTest-913962025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:26:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-743dd1a5-528d-4e16-ba29-559454f9adaa tempest-CreateVolumesFromImageTest-913962025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-743dd1a5-528d-4e16-ba29-559454f9adaa tempest-CreateVolumesFromImageTest-913962025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:34 devstack sudo[104883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:26:34 devstack sudo[104883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:35 devstack sudo[104877]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3c5e16c9-fd9d-4acc-940c-698a6a4824a4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-13f92cdd-c7db-4d2a-ae87-8b5bbdd46baa 1073741824" returned: 0 in 0.443s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3c5e16c9-fd9d-4acc-940c-698a6a4824a4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-13f92cdd-c7db-4d2a-ae87-8b5bbdd46baa {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:35 devstack sudo[104886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-13f92cdd-c7db-4d2a-ae87-8b5bbdd46baa
Nov 05 19:26:35 devstack sudo[104886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:35 devstack sudo[104883]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-743dd1a5-528d-4e16-ba29-559454f9adaa tempest-CreateVolumesFromImageTest-913962025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.270s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:35 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-743dd1a5-528d-4e16-ba29-559454f9adaa tempest-CreateVolumesFromImageTest-913962025 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:26:35 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-743dd1a5-528d-4e16-ba29-559454f9adaa tempest-CreateVolumesFromImageTest-913962025 None] Deleted volume successfully.
Nov 05 19:26:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-eaea1447-c134-45c8-8587-d5eac94c0c65 tempest-CreateVolumesFromImageTest-913962025 None] Acquiring lock "cinder-a7c5890a-cbd2-419c-825b-65c8661d9a5d-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:26:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-eaea1447-c134-45c8-8587-d5eac94c0c65 tempest-CreateVolumesFromImageTest-913962025 None] Lock "cinder-a7c5890a-cbd2-419c-825b-65c8661d9a5d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:26:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-743dd1a5-528d-4e16-ba29-559454f9adaa tempest-CreateVolumesFromImageTest-913962025 None] Lock "cinder-42c5f8e3-e03d-4842-8062-c61865e11aa5-delete_volume" released by "delete_volume" :: held 1.228s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:26:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-eaea1447-c134-45c8-8587-d5eac94c0c65 tempest-CreateVolumesFromImageTest-913962025 None] Acquiring lock "cinder-quobyte-a7c5890a-cbd2-419c-825b-65c8661d9a5d" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:26:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-eaea1447-c134-45c8-8587-d5eac94c0c65 tempest-CreateVolumesFromImageTest-913962025 None] Lock "cinder-quobyte-a7c5890a-cbd2-419c-825b-65c8661d9a5d" acquired by "delete_volume" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:26:35 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bd3ee1-3739-424b-8520-88f26f3b9eb9]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:26:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-eaea1447-c134-45c8-8587-d5eac94c0c65 tempest-CreateVolumesFromImageTest-913962025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a7c5890a-cbd2-419c-825b-65c8661d9a5d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:35 devstack sudo[104886]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-3c5e16c9-fd9d-4acc-940c-698a6a4824a4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-13f92cdd-c7db-4d2a-ae87-8b5bbdd46baa" returned: 0 in 0.319s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-3c5e16c9-fd9d-4acc-940c-698a6a4824a4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:26:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-3c5e16c9-fd9d-4acc-940c-698a6a4824a4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d3a053ca-77a9-42a2-87fc-a460dd2d5448 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.381s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d3a053ca-77a9-42a2-87fc-a460dd2d5448 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-37199690',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11d10849-6919-4437-af7b-c3dd4004ba8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25948ebfc9aa40ea85f787a08c8c28d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:26:29Z,use_quota=True,user_id='99892162098147f5bd99622391c69052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:26:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-d3a053ca-77a9-42a2-87fc-a460dd2d5448 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Creating volume 11d10849-6919-4437-af7b-c3dd4004ba8a {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:26:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d3a053ca-77a9-42a2-87fc-a460dd2d5448 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d3a053ca-77a9-42a2-87fc-a460dd2d5448 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d3a053ca-77a9-42a2-87fc-a460dd2d5448 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:26:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d3a053ca-77a9-42a2-87fc-a460dd2d5448 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:26:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d3a053ca-77a9-42a2-87fc-a460dd2d5448 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d3a053ca-77a9-42a2-87fc-a460dd2d5448 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:26:35 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-d3a053ca-77a9-42a2-87fc-a460dd2d5448 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:26:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d3a053ca-77a9-42a2-87fc-a460dd2d5448 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-11d10849-6919-4437-af7b-c3dd4004ba8a 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3c5e16c9-fd9d-4acc-940c-698a6a4824a4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1059b8d-977a-4554-9a9a-e7cb6c3864e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13f92cdd-c7db-4d2a-ae87-8b5bbdd46baa', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:35 devstack sudo[104891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-11d10849-6919-4437-af7b-c3dd4004ba8a 1073741824
Nov 05 19:26:35 devstack sudo[104891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3c5e16c9-fd9d-4acc-940c-698a6a4824a4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (248449fc-1205-47de-b8ce-6defdb7a2435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:35 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-3c5e16c9-fd9d-4acc-940c-698a6a4824a4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Volume volume-13f92cdd-c7db-4d2a-ae87-8b5bbdd46baa (13f92cdd-c7db-4d2a-ae87-8b5bbdd46baa): created successfully
Nov 05 19:26:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3c5e16c9-fd9d-4acc-940c-698a6a4824a4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (248449fc-1205-47de-b8ce-6defdb7a2435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:35 devstack sudo[104890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a7c5890a-cbd2-419c-825b-65c8661d9a5d
Nov 05 19:26:35 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:35 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-3c5e16c9-fd9d-4acc-940c-698a6a4824a4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Flow 'volume_create_manager' (6bf0763a-3437-4d79-9f56-9e252f3e33f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:26:35 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-3c5e16c9-fd9d-4acc-940c-698a6a4824a4 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Created volume successfully.
Nov 05 19:26:35 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-eaea1447-c134-45c8-8587-d5eac94c0c65 tempest-CreateVolumesFromImageTest-913962025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a7c5890a-cbd2-419c-825b-65c8661d9a5d" returned: 0 in 0.398s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-eaea1447-c134-45c8-8587-d5eac94c0c65 tempest-CreateVolumesFromImageTest-913962025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a7c5890a-cbd2-419c-825b-65c8661d9a5d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:35 devstack sudo[104903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a7c5890a-cbd2-419c-825b-65c8661d9a5d
Nov 05 19:26:35 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:35 devstack sudo[104891]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d3a053ca-77a9-42a2-87fc-a460dd2d5448 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-11d10849-6919-4437-af7b-c3dd4004ba8a 1073741824" returned: 0 in 0.434s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d3a053ca-77a9-42a2-87fc-a460dd2d5448 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-11d10849-6919-4437-af7b-c3dd4004ba8a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:35 devstack sudo[104905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-11d10849-6919-4437-af7b-c3dd4004ba8a
Nov 05 19:26:35 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:36 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-eaea1447-c134-45c8-8587-d5eac94c0c65 tempest-CreateVolumesFromImageTest-913962025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a7c5890a-cbd2-419c-825b-65c8661d9a5d" returned: 0 in 0.262s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-eaea1447-c134-45c8-8587-d5eac94c0c65 tempest-CreateVolumesFromImageTest-913962025 None] Lock "cinder-quobyte-a7c5890a-cbd2-419c-825b-65c8661d9a5d" released by "delete_volume" :: held 0.710s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-eaea1447-c134-45c8-8587-d5eac94c0c65 tempest-CreateVolumesFromImageTest-913962025 None] Created reservations ['ad397dbe-d841-4a5a-aee6-53d94160eed0', '45322dac-8bb2-4c2e-ac07-86a460363f45', 'e937397a-bb7d-404c-8435-82742263e5e9', '84ae40dd-b7cb-450a-be3d-5d2f3069757d'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-eaea1447-c134-45c8-8587-d5eac94c0c65 tempest-CreateVolumesFromImageTest-913962025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-eaea1447-c134-45c8-8587-d5eac94c0c65 tempest-CreateVolumesFromImageTest-913962025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-eaea1447-c134-45c8-8587-d5eac94c0c65 tempest-CreateVolumesFromImageTest-913962025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:26:36 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-eaea1447-c134-45c8-8587-d5eac94c0c65 tempest-CreateVolumesFromImageTest-913962025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-eaea1447-c134-45c8-8587-d5eac94c0c65 tempest-CreateVolumesFromImageTest-913962025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-eaea1447-c134-45c8-8587-d5eac94c0c65 tempest-CreateVolumesFromImageTest-913962025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d3a053ca-77a9-42a2-87fc-a460dd2d5448 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-11d10849-6919-4437-af7b-c3dd4004ba8a" returned: 0 in 0.263s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d3a053ca-77a9-42a2-87fc-a460dd2d5448 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d3a053ca-77a9-42a2-87fc-a460dd2d5448 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.457s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d82d6940-6b43-46e9-b3ad-c4c8d0c8bcd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16c4e6bb36274bf3a2f13f8a4c493539',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:26:28Z,use_quota=True,user_id='602b0994aff044529dd58046fa49e53d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb76662b-b64d-4fdd-ac96-4d58ff3a3898),volume_type_id=bb76662b-b64d-4fdd-ac96-4d58ff3a3898)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Creating volume d82d6940-6b43-46e9-b3ad-c4c8d0c8bcd1 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:26:36 devstack sudo[104909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:26:36 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:26:36 devstack sudo[104909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d82d6940-6b43-46e9-b3ad-c4c8d0c8bcd1 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d3a053ca-77a9-42a2-87fc-a460dd2d5448 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (655bfcd4-69c9-49b1-9ea4-475da86fd4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11d10849-6919-4437-af7b-c3dd4004ba8a', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:36 devstack sudo[104911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d82d6940-6b43-46e9-b3ad-c4c8d0c8bcd1 1073741824
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d3a053ca-77a9-42a2-87fc-a460dd2d5448 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88eb95d0-5359-4289-96f1-de5d79e06d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:36 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:36 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-d3a053ca-77a9-42a2-87fc-a460dd2d5448 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Volume volume-11d10849-6919-4437-af7b-c3dd4004ba8a (11d10849-6919-4437-af7b-c3dd4004ba8a): created successfully
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d3a053ca-77a9-42a2-87fc-a460dd2d5448 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88eb95d0-5359-4289-96f1-de5d79e06d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d3a053ca-77a9-42a2-87fc-a460dd2d5448 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Flow 'volume_create_manager' (8746942a-1fbe-467a-abeb-96511192fa2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:26:36 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-d3a053ca-77a9-42a2-87fc-a460dd2d5448 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Created volume successfully.
Nov 05 19:26:36 devstack sudo[104909]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-eaea1447-c134-45c8-8587-d5eac94c0c65 tempest-CreateVolumesFromImageTest-913962025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.253s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-eaea1447-c134-45c8-8587-d5eac94c0c65 tempest-CreateVolumesFromImageTest-913962025 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:26:36 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-eaea1447-c134-45c8-8587-d5eac94c0c65 tempest-CreateVolumesFromImageTest-913962025 None] Deleted volume successfully.
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-efefda1b-317a-4a66-93a8-600c71e3d6e3 tempest-CreateVolumesFromImageTest-913962025 None] Acquiring lock "cinder-b16a835b-a3ad-4bb6-adf1-488f82fd4973-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-efefda1b-317a-4a66-93a8-600c71e3d6e3 tempest-CreateVolumesFromImageTest-913962025 None] Lock "cinder-b16a835b-a3ad-4bb6-adf1-488f82fd4973-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-eaea1447-c134-45c8-8587-d5eac94c0c65 tempest-CreateVolumesFromImageTest-913962025 None] Lock "cinder-a7c5890a-cbd2-419c-825b-65c8661d9a5d-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-efefda1b-317a-4a66-93a8-600c71e3d6e3 tempest-CreateVolumesFromImageTest-913962025 None] Acquiring lock "cinder-quobyte-b16a835b-a3ad-4bb6-adf1-488f82fd4973" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-efefda1b-317a-4a66-93a8-600c71e3d6e3 tempest-CreateVolumesFromImageTest-913962025 None] Lock "cinder-quobyte-b16a835b-a3ad-4bb6-adf1-488f82fd4973" acquired by "delete_volume" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2300382-72ef-46a6-b0c4-aa128ed02397]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-efefda1b-317a-4a66-93a8-600c71e3d6e3 tempest-CreateVolumesFromImageTest-913962025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b16a835b-a3ad-4bb6-adf1-488f82fd4973 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cad4b09f-5a1b-4c23-80ca-e57d8d7aff59 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Acquiring lock "cinder-11d10849-6919-4437-af7b-c3dd4004ba8a-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cad4b09f-5a1b-4c23-80ca-e57d8d7aff59 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "cinder-11d10849-6919-4437-af7b-c3dd4004ba8a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:26:36 devstack sudo[104917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b16a835b-a3ad-4bb6-adf1-488f82fd4973
Nov 05 19:26:36 devstack sudo[104917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cad4b09f-5a1b-4c23-80ca-e57d8d7aff59 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Acquiring lock "cinder-quobyte-11d10849-6919-4437-af7b-c3dd4004ba8a" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cad4b09f-5a1b-4c23-80ca-e57d8d7aff59 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "cinder-quobyte-11d10849-6919-4437-af7b-c3dd4004ba8a" acquired by "delete_volume" :: waited 0.015s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f657ec3-8b00-4e65-bec9-f9ad2a3817d0]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cad4b09f-5a1b-4c23-80ca-e57d8d7aff59 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-11d10849-6919-4437-af7b-c3dd4004ba8a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:36 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d82d6940-6b43-46e9-b3ad-c4c8d0c8bcd1 1073741824" returned: 0 in 0.586s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d82d6940-6b43-46e9-b3ad-c4c8d0c8bcd1 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:36 devstack sudo[104921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d82d6940-6b43-46e9-b3ad-c4c8d0c8bcd1
Nov 05 19:26:36 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:36 devstack sudo[104920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-11d10849-6919-4437-af7b-c3dd4004ba8a
Nov 05 19:26:36 devstack sudo[104920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:37 devstack sudo[104917]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-efefda1b-317a-4a66-93a8-600c71e3d6e3 tempest-CreateVolumesFromImageTest-913962025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b16a835b-a3ad-4bb6-adf1-488f82fd4973" returned: 0 in 0.421s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-efefda1b-317a-4a66-93a8-600c71e3d6e3 tempest-CreateVolumesFromImageTest-913962025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b16a835b-a3ad-4bb6-adf1-488f82fd4973 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:37 devstack sudo[104928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b16a835b-a3ad-4bb6-adf1-488f82fd4973
Nov 05 19:26:37 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:37 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d82d6940-6b43-46e9-b3ad-c4c8d0c8bcd1" returned: 0 in 0.256s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.051s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Acquiring lock "cinder-quobyte-136f76eb-706b-49d3-b5b7-49720e59f891-f2382de9-03fb-4a34-be2c-fa3776937c8c" by "_create_volume_from_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Lock "cinder-quobyte-136f76eb-706b-49d3-b5b7-49720e59f891-f2382de9-03fb-4a34-be2c-fa3776937c8c" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Creating volume f2382de9-03fb-4a34-be2c-fa3776937c8c from snapshot 136f76eb-706b-49d3-b5b7-49720e59f891 {{(pid=87184) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Acquiring lock "cinder-quobyte-f2382de9-03fb-4a34-be2c-fa3776937c8c" by "_copy_volume_from_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Attempting download of b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf ((None, [{'url': 'file:///opt/stack/data/glance/images/b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf', 'metadata': {}}])) to volume d82d6940-6b43-46e9-b3ad-c4c8d0c8bcd1. {{(pid=87184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Lock "cinder-quobyte-f2382de9-03fb-4a34-be2c-fa3776937c8c" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] snapshot: 136f76eb-706b-49d3-b5b7-49720e59f891, volume: f2382de9-03fb-4a34-be2c-fa3776937c8c,  {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 19:26:37 devstack sudo[104920]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cad4b09f-5a1b-4c23-80ca-e57d8d7aff59 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-11d10849-6919-4437-af7b-c3dd4004ba8a" returned: 0 in 0.435s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cad4b09f-5a1b-4c23-80ca-e57d8d7aff59 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-11d10849-6919-4437-af7b-c3dd4004ba8a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cceaf7-1147-4dea-b172-1b086e57a9c2]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86.136f76eb-706b-49d3-b5b7-49720e59f891 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:37 devstack sudo[104933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-11d10849-6919-4437-af7b-c3dd4004ba8a
Nov 05 19:26:37 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6eb172-8052-4756-aaf6-812b4de32465]: (4, 'raw') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf_4vs_8jzf {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:37 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-efefda1b-317a-4a66-93a8-600c71e3d6e3 tempest-CreateVolumesFromImageTest-913962025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b16a835b-a3ad-4bb6-adf1-488f82fd4973" returned: 0 in 0.313s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:37 devstack sudo[104934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86.136f76eb-706b-49d3-b5b7-49720e59f891
Nov 05 19:26:37 devstack sudo[104934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-efefda1b-317a-4a66-93a8-600c71e3d6e3 tempest-CreateVolumesFromImageTest-913962025 None] Lock "cinder-quobyte-b16a835b-a3ad-4bb6-adf1-488f82fd4973" released by "delete_volume" :: held 0.793s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:26:37 devstack sudo[104936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf_4vs_8jzf
Nov 05 19:26:37 devstack sudo[104936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-efefda1b-317a-4a66-93a8-600c71e3d6e3 tempest-CreateVolumesFromImageTest-913962025 None] Created reservations ['0f85e7cd-b9fe-4cda-8352-ba29125f5cf3', 'e0387787-ec45-42cd-8634-feba425439f7', '0c6dc38e-22c8-4c6b-a119-b016b47a5561', 'b72f5bb3-7b85-4461-9b66-41c2614131d8'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-efefda1b-317a-4a66-93a8-600c71e3d6e3 tempest-CreateVolumesFromImageTest-913962025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-efefda1b-317a-4a66-93a8-600c71e3d6e3 tempest-CreateVolumesFromImageTest-913962025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-efefda1b-317a-4a66-93a8-600c71e3d6e3 tempest-CreateVolumesFromImageTest-913962025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-efefda1b-317a-4a66-93a8-600c71e3d6e3 tempest-CreateVolumesFromImageTest-913962025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-efefda1b-317a-4a66-93a8-600c71e3d6e3 tempest-CreateVolumesFromImageTest-913962025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-efefda1b-317a-4a66-93a8-600c71e3d6e3 tempest-CreateVolumesFromImageTest-913962025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:37 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cad4b09f-5a1b-4c23-80ca-e57d8d7aff59 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-11d10849-6919-4437-af7b-c3dd4004ba8a" returned: 0 in 0.309s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:37 devstack sudo[104942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:26:37 devstack sudo[104942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cad4b09f-5a1b-4c23-80ca-e57d8d7aff59 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "cinder-quobyte-11d10849-6919-4437-af7b-c3dd4004ba8a" released by "delete_volume" :: held 0.800s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-cad4b09f-5a1b-4c23-80ca-e57d8d7aff59 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Created reservations ['764c6561-c3d7-44fd-95c3-91293aa4c511', 'ae3446c5-51c0-4f53-a804-d5b7177251ee', '021af739-1b8b-4a82-8b12-d3133c4390bc', '6a0cd2bc-6e8d-4e28-bba4-d2dc1571992d'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:26:37 devstack sudo[104936]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf_4vs_8jzf" returned: 0 in 0.419s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf_4vs_8jzf {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:37 devstack sudo[104934]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-61e2542c-7bd3-4055-bceb-e5185220ed46 tempest-CreateVolumesFromImageTest-913962025 None] Acquiring lock "cinder-b165eb14-4b97-40ba-a3a3-ec4b47f633b8-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86.136f76eb-706b-49d3-b5b7-49720e59f891" returned: 0 in 0.489s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-61e2542c-7bd3-4055-bceb-e5185220ed46 tempest-CreateVolumesFromImageTest-913962025 None] Lock "cinder-b165eb14-4b97-40ba-a3a3-ec4b47f633b8-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5608c389-71a8-418b-af92-5eafdce03127]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-61e2542c-7bd3-4055-bceb-e5185220ed46 tempest-CreateVolumesFromImageTest-913962025 None] Acquiring lock "cinder-quobyte-b165eb14-4b97-40ba-a3a3-ec4b47f633b8" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cad4b09f-5a1b-4c23-80ca-e57d8d7aff59 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cad4b09f-5a1b-4c23-80ca-e57d8d7aff59 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-cad4b09f-5a1b-4c23-80ca-e57d8d7aff59 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:26:37 devstack sudo[104949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf_4vs_8jzf
Nov 05 19:26:37 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-cad4b09f-5a1b-4c23-80ca-e57d8d7aff59 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cad4b09f-5a1b-4c23-80ca-e57d8d7aff59 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cad4b09f-5a1b-4c23-80ca-e57d8d7aff59 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-61e2542c-7bd3-4055-bceb-e5185220ed46 tempest-CreateVolumesFromImageTest-913962025 None] Lock "cinder-quobyte-b165eb14-4b97-40ba-a3a3-ec4b47f633b8" acquired by "delete_volume" :: waited 0.052s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:26:37 devstack sudo[104953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:26:37 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:37 devstack sudo[104942]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-98e87ade-ee05-4f04-ac77-82df17967ff2 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Acquiring lock "cinder-13f92cdd-c7db-4d2a-ae87-8b5bbdd46baa-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-efefda1b-317a-4a66-93a8-600c71e3d6e3 tempest-CreateVolumesFromImageTest-913962025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.459s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:37 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-efefda1b-317a-4a66-93a8-600c71e3d6e3 tempest-CreateVolumesFromImageTest-913962025 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:26:37 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-efefda1b-317a-4a66-93a8-600c71e3d6e3 tempest-CreateVolumesFromImageTest-913962025 None] Deleted volume successfully.
Nov 05 19:26:37 devstack sudo[104950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86
Nov 05 19:26:37 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:38 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[122308ac-5c9e-4c7e-a554-9ea6f0aeb7da]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:26:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-61e2542c-7bd3-4055-bceb-e5185220ed46 tempest-CreateVolumesFromImageTest-913962025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b165eb14-4b97-40ba-a3a3-ec4b47f633b8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-98e87ade-ee05-4f04-ac77-82df17967ff2 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "cinder-13f92cdd-c7db-4d2a-ae87-8b5bbdd46baa-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:26:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-efefda1b-317a-4a66-93a8-600c71e3d6e3 tempest-CreateVolumesFromImageTest-913962025 None] Lock "cinder-b16a835b-a3ad-4bb6-adf1-488f82fd4973-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:26:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-98e87ade-ee05-4f04-ac77-82df17967ff2 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Acquiring lock "cinder-quobyte-13f92cdd-c7db-4d2a-ae87-8b5bbdd46baa" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:26:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-98e87ade-ee05-4f04-ac77-82df17967ff2 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "cinder-quobyte-13f92cdd-c7db-4d2a-ae87-8b5bbdd46baa" acquired by "delete_volume" :: waited 0.032s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:26:38 devstack sudo[104956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b165eb14-4b97-40ba-a3a3-ec4b47f633b8
Nov 05 19:26:38 devstack sudo[104956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:38 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e115f44-c1e4-4a40-b71d-74a1e8b6e47c]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:26:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-98e87ade-ee05-4f04-ac77-82df17967ff2 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-13f92cdd-c7db-4d2a-ae87-8b5bbdd46baa {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:38 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cad4b09f-5a1b-4c23-80ca-e57d8d7aff59 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.406s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:38 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-cad4b09f-5a1b-4c23-80ca-e57d8d7aff59 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:26:38 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:38 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-cad4b09f-5a1b-4c23-80ca-e57d8d7aff59 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Deleted volume successfully.
Nov 05 19:26:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf_4vs_8jzf" returned: 1 in 0.623s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf_4vs_8jzf' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 19:26:38 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e1bd22-2943-453c-889b-39ac728f81a5]: (4, 'raw') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:26:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf_kr0jxb5sdevstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cad4b09f-5a1b-4c23-80ca-e57d8d7aff59 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "cinder-11d10849-6919-4437-af7b-c3dd4004ba8a-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:26:38 devstack sudo[104958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-13f92cdd-c7db-4d2a-ae87-8b5bbdd46baa
Nov 05 19:26:38 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:38 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:38 devstack sudo[104962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf_kr0jxb5sdevstack@QuobyteHD
Nov 05 19:26:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86" returned: 0 in 0.667s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86 {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 19:26:38 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Creating direct copy from snapshot {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 19:26:38 devstack cinder-volume[87184]: DEBUG cinder.utils [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Path /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f2382de9-03fb-4a34-be2c-fa3776937c8c not found in is_blk_device check {{(pid=87184) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 19:26:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f2382de9-03fb-4a34-be2c-fa3776937c8c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:38 devstack sudo[104972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f2382de9-03fb-4a34-be2c-fa3776937c8c
Nov 05 19:26:38 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:38 devstack sudo[104956]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-61e2542c-7bd3-4055-bceb-e5185220ed46 tempest-CreateVolumesFromImageTest-913962025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b165eb14-4b97-40ba-a3a3-ec4b47f633b8" returned: 0 in 0.453s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-61e2542c-7bd3-4055-bceb-e5185220ed46 tempest-CreateVolumesFromImageTest-913962025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b165eb14-4b97-40ba-a3a3-ec4b47f633b8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:38 devstack sudo[104974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b165eb14-4b97-40ba-a3a3-ec4b47f633b8
Nov 05 19:26:38 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:38 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-98e87ade-ee05-4f04-ac77-82df17967ff2 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-13f92cdd-c7db-4d2a-ae87-8b5bbdd46baa" returned: 0 in 0.461s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-98e87ade-ee05-4f04-ac77-82df17967ff2 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-13f92cdd-c7db-4d2a-ae87-8b5bbdd46baa {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:38 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf_kr0jxb5sdevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:38 devstack sudo[104982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-13f92cdd-c7db-4d2a-ae87-8b5bbdd46baa
Nov 05 19:26:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf_kr0jxb5sdevstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:38 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:38 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-61e2542c-7bd3-4055-bceb-e5185220ed46 tempest-CreateVolumesFromImageTest-913962025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b165eb14-4b97-40ba-a3a3-ec4b47f633b8" returned: 0 in 0.290s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-61e2542c-7bd3-4055-bceb-e5185220ed46 tempest-CreateVolumesFromImageTest-913962025 None] Lock "cinder-quobyte-b165eb14-4b97-40ba-a3a3-ec4b47f633b8" released by "delete_volume" :: held 0.891s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:26:38 devstack sudo[104986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf_kr0jxb5sdevstack@QuobyteHD
Nov 05 19:26:38 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:38 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-61e2542c-7bd3-4055-bceb-e5185220ed46 tempest-CreateVolumesFromImageTest-913962025 None] Created reservations ['6f7c8495-8a2c-49b7-bafa-8050bf9766bb', '65abc374-0877-4bfe-abab-8456cbfbbc79', 'db8dd018-3d5c-47dd-ba27-925adad513b7', '5b996c89-22d7-4b4a-bbf3-fba90e990e92'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:26:38 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-61e2542c-7bd3-4055-bceb-e5185220ed46 tempest-CreateVolumesFromImageTest-913962025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-61e2542c-7bd3-4055-bceb-e5185220ed46 tempest-CreateVolumesFromImageTest-913962025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-61e2542c-7bd3-4055-bceb-e5185220ed46 tempest-CreateVolumesFromImageTest-913962025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:26:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-61e2542c-7bd3-4055-bceb-e5185220ed46 tempest-CreateVolumesFromImageTest-913962025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:26:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-61e2542c-7bd3-4055-bceb-e5185220ed46 tempest-CreateVolumesFromImageTest-913962025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-61e2542c-7bd3-4055-bceb-e5185220ed46 tempest-CreateVolumesFromImageTest-913962025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-98e87ade-ee05-4f04-ac77-82df17967ff2 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-13f92cdd-c7db-4d2a-ae87-8b5bbdd46baa" returned: 0 in 0.329s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:39 devstack sudo[104992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:26:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-98e87ade-ee05-4f04-ac77-82df17967ff2 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "cinder-quobyte-13f92cdd-c7db-4d2a-ae87-8b5bbdd46baa" released by "delete_volume" :: held 0.875s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:26:39 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:39 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-98e87ade-ee05-4f04-ac77-82df17967ff2 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Created reservations ['c6185f48-0d86-44ee-b2ca-89bd8aab05a3', '876544d0-214d-4a66-b9ed-1d6db6912b42', 'd1c6d76d-9b0b-4d7f-be06-69fa090b5978', '20c45b01-bb4d-43e0-a2ad-973d908fb166'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:26:39 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf_kr0jxb5sdevstack@QuobyteHD" returned: 1 in 0.508s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf_kr0jxb5sdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 19:26:39 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf was raw, converting to qcow2 {{(pid=87184) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 19:26:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf_kr0jxb5sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d82d6940-6b43-46e9-b3ad-c4c8d0c8bcd1 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:39 devstack sudo[105006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf_kr0jxb5sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d82d6940-6b43-46e9-b3ad-c4c8d0c8bcd1
Nov 05 19:26:39 devstack sudo[105006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-98e87ade-ee05-4f04-ac77-82df17967ff2 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-98e87ade-ee05-4f04-ac77-82df17967ff2 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-98e87ade-ee05-4f04-ac77-82df17967ff2 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:26:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-98e87ade-ee05-4f04-ac77-82df17967ff2 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:26:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-98e87ade-ee05-4f04-ac77-82df17967ff2 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-98e87ade-ee05-4f04-ac77-82df17967ff2 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:39 devstack sudo[105011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:26:39 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:39 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-61e2542c-7bd3-4055-bceb-e5185220ed46 tempest-CreateVolumesFromImageTest-913962025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.584s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:39 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-61e2542c-7bd3-4055-bceb-e5185220ed46 tempest-CreateVolumesFromImageTest-913962025 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:26:39 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-61e2542c-7bd3-4055-bceb-e5185220ed46 tempest-CreateVolumesFromImageTest-913962025 None] Deleted volume successfully.
Nov 05 19:26:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-61e2542c-7bd3-4055-bceb-e5185220ed46 tempest-CreateVolumesFromImageTest-913962025 None] Lock "cinder-b165eb14-4b97-40ba-a3a3-ec4b47f633b8-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:26:39 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-98e87ade-ee05-4f04-ac77-82df17967ff2 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.461s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:39 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-98e87ade-ee05-4f04-ac77-82df17967ff2 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:26:39 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-98e87ade-ee05-4f04-ac77-82df17967ff2 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Deleted volume successfully.
Nov 05 19:26:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-98e87ade-ee05-4f04-ac77-82df17967ff2 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "cinder-13f92cdd-c7db-4d2a-ae87-8b5bbdd46baa-delete_volume" released by "delete_volume" :: held 1.828s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:26:40 devstack sudo[105006]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c3e9e253-8d22-4198-a1df-5f37dec93c56 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Acquiring lock "cinder-a12afa5f-7b4b-4f77-8553-c21f72bd26ca-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:26:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf_kr0jxb5sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d82d6940-6b43-46e9-b3ad-c4c8d0c8bcd1" returned: 0 in 1.199s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:40 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf_kr0jxb5sdevstack@QuobyteHD, size 0.00 MB, duration 1.20 sec, destination /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d82d6940-6b43-46e9-b3ad-c4c8d0c8bcd1 {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 19:26:40 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Converted 0.00 MB image at 0.00 MB/s
Nov 05 19:26:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d82d6940-6b43-46e9-b3ad-c4c8d0c8bcd1 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:40 devstack sudo[105020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d82d6940-6b43-46e9-b3ad-c4c8d0c8bcd1 1G
Nov 05 19:26:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c3e9e253-8d22-4198-a1df-5f37dec93c56 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "cinder-a12afa5f-7b4b-4f77-8553-c21f72bd26ca-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:26:40 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c3e9e253-8d22-4198-a1df-5f37dec93c56 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Acquiring lock "cinder-quobyte-a12afa5f-7b4b-4f77-8553-c21f72bd26ca" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:26:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c3e9e253-8d22-4198-a1df-5f37dec93c56 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "cinder-quobyte-a12afa5f-7b4b-4f77-8553-c21f72bd26ca" acquired by "delete_volume" :: waited 0.023s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:26:40 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc0b6b5-6ada-4c40-acfa-c5ca993a0890]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:26:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c3e9e253-8d22-4198-a1df-5f37dec93c56 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a12afa5f-7b4b-4f77-8553-c21f72bd26ca {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:40 devstack sudo[105022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a12afa5f-7b4b-4f77-8553-c21f72bd26ca
Nov 05 19:26:40 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:41 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d82d6940-6b43-46e9-b3ad-c4c8d0c8bcd1 1G" returned: 0 in 0.755s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:41 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Downloaded image b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf ((None, [{'url': 'file:///opt/stack/data/glance/images/b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf', 'metadata': {}}])) to volume d82d6940-6b43-46e9-b3ad-c4c8d0c8bcd1 successfully. {{(pid=87184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 19:26:41 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Temporary image b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf for user 602b0994aff044529dd58046fa49e53d is deleted. {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 19:26:41 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Marking volume d82d6940-6b43-46e9-b3ad-c4c8d0c8bcd1 as bootable. {{(pid=87184) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 19:26:41 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Copying metadata from image b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf to d82d6940-6b43-46e9-b3ad-c4c8d0c8bcd1. {{(pid=87184) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 19:26:41 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Creating volume glance metadata for volume d82d6940-6b43-46e9-b3ad-c4c8d0c8bcd1 backed by image b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '2a276b2380e0179f6c2254c6bccc5047', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87184) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 19:26:41 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c3e9e253-8d22-4198-a1df-5f37dec93c56 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a12afa5f-7b4b-4f77-8553-c21f72bd26ca" returned: 0 in 0.675s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c3e9e253-8d22-4198-a1df-5f37dec93c56 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a12afa5f-7b4b-4f77-8553-c21f72bd26ca {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:41 devstack sudo[105031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a12afa5f-7b4b-4f77-8553-c21f72bd26ca
Nov 05 19:26:41 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9cff4d9-f87d-4658-90be-a3964bd5756f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d82d6940-6b43-46e9-b3ad-c4c8d0c8bcd1', 'volume_size': 1, 'image_id': 'b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2a276b2380e0179f6c2254c6bccc5047', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '16c4e6bb36274bf3a2f13f8a4c493539', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '76731964095ac2499bd73ce87f6fcb26955ba28f189155205ba4723b7d075a50c5aee24cafd191cbc69f3895024036c0781867f0b6aa68710ca68cdd5adaf64d', 'id': 'b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf', 'created_at': datetime.datetime(2026, 11, 5, 18, 26, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 18, 26, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4105362-9f4f-4a3f-a82a-2b8ff3bbacdf/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x736631e6f410>}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (641b4749-94aa-4bfa-b750-2c8eef6ac367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:41 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Volume volume-d82d6940-6b43-46e9-b3ad-c4c8d0c8bcd1 (d82d6940-6b43-46e9-b3ad-c4c8d0c8bcd1): created successfully
Nov 05 19:26:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (641b4749-94aa-4bfa-b750-2c8eef6ac367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:41 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Flow 'volume_create_manager' (6229a3c4-01b1-4697-a545-71b26190f2d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:26:41 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-13fcbb5b-bdcc-4c8c-8221-53d553ac361f tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Created volume successfully.
Nov 05 19:26:41 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:41 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c3e9e253-8d22-4198-a1df-5f37dec93c56 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a12afa5f-7b4b-4f77-8553-c21f72bd26ca" returned: 0 in 0.672s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:41 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c3e9e253-8d22-4198-a1df-5f37dec93c56 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "cinder-quobyte-a12afa5f-7b4b-4f77-8553-c21f72bd26ca" released by "delete_volume" :: held 1.428s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:26:42 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-c3e9e253-8d22-4198-a1df-5f37dec93c56 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Created reservations ['6de8d524-838a-49d9-b51f-e9ecd9e185f8', '5579740f-cb83-465e-914b-75134fe57f34', '75f1cbcb-7730-4e1d-ab22-e2109c9e72e9', 'fe0160ac-24bd-41b3-99ab-1352cec6512c'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:26:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c3e9e253-8d22-4198-a1df-5f37dec93c56 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c3e9e253-8d22-4198-a1df-5f37dec93c56 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c3e9e253-8d22-4198-a1df-5f37dec93c56 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:26:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c3e9e253-8d22-4198-a1df-5f37dec93c56 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:26:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c3e9e253-8d22-4198-a1df-5f37dec93c56 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c3e9e253-8d22-4198-a1df-5f37dec93c56 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:42 devstack sudo[105035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:26:42 devstack sudo[105035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:42 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7acedbca-65ab-4ae5-81a7-f6092081bcb2 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Acquiring lock "cinder-729799f4-e5df-46f8-8bfd-ef79a656393f-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:26:42 devstack sudo[105035]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c3e9e253-8d22-4198-a1df-5f37dec93c56 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.702s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:42 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-c3e9e253-8d22-4198-a1df-5f37dec93c56 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:26:42 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7acedbca-65ab-4ae5-81a7-f6092081bcb2 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "cinder-729799f4-e5df-46f8-8bfd-ef79a656393f-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:26:42 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-c3e9e253-8d22-4198-a1df-5f37dec93c56 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Deleted volume successfully.
Nov 05 19:26:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-da9b073d-6e5a-4112-818f-69ffe886d50b tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Acquiring lock "cinder-d82d6940-6b43-46e9-b3ad-c4c8d0c8bcd1-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:26:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c3e9e253-8d22-4198-a1df-5f37dec93c56 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "cinder-a12afa5f-7b4b-4f77-8553-c21f72bd26ca-delete_volume" released by "delete_volume" :: held 2.606s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:26:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7acedbca-65ab-4ae5-81a7-f6092081bcb2 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Acquiring lock "cinder-quobyte-729799f4-e5df-46f8-8bfd-ef79a656393f" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:26:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-da9b073d-6e5a-4112-818f-69ffe886d50b tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Lock "cinder-d82d6940-6b43-46e9-b3ad-c4c8d0c8bcd1-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:26:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7acedbca-65ab-4ae5-81a7-f6092081bcb2 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "cinder-quobyte-729799f4-e5df-46f8-8bfd-ef79a656393f" acquired by "delete_volume" :: waited 0.033s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:26:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-da9b073d-6e5a-4112-818f-69ffe886d50b tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Acquiring lock "cinder-quobyte-d82d6940-6b43-46e9-b3ad-c4c8d0c8bcd1" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:26:43 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[407cc25f-e714-4d5b-950d-7b1f44d16762]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:26:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7acedbca-65ab-4ae5-81a7-f6092081bcb2 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-729799f4-e5df-46f8-8bfd-ef79a656393f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:43 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-da9b073d-6e5a-4112-818f-69ffe886d50b tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Lock "cinder-quobyte-d82d6940-6b43-46e9-b3ad-c4c8d0c8bcd1" acquired by "delete_volume" :: waited 0.042s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:26:43 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d26383-650d-4811-908f-99716b22d69b]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:26:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-da9b073d-6e5a-4112-818f-69ffe886d50b tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d82d6940-6b43-46e9-b3ad-c4c8d0c8bcd1 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:43 devstack sudo[105038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-729799f4-e5df-46f8-8bfd-ef79a656393f
Nov 05 19:26:43 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:43 devstack sudo[105039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d82d6940-6b43-46e9-b3ad-c4c8d0c8bcd1
Nov 05 19:26:43 devstack sudo[105039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:44 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7acedbca-65ab-4ae5-81a7-f6092081bcb2 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-729799f4-e5df-46f8-8bfd-ef79a656393f" returned: 0 in 0.827s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:44 devstack sudo[105039]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7acedbca-65ab-4ae5-81a7-f6092081bcb2 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-729799f4-e5df-46f8-8bfd-ef79a656393f {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-da9b073d-6e5a-4112-818f-69ffe886d50b tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d82d6940-6b43-46e9-b3ad-c4c8d0c8bcd1" returned: 0 in 0.770s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-da9b073d-6e5a-4112-818f-69ffe886d50b tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d82d6940-6b43-46e9-b3ad-c4c8d0c8bcd1 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:44 devstack sudo[105049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-729799f4-e5df-46f8-8bfd-ef79a656393f
Nov 05 19:26:44 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:44 devstack sudo[105051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d82d6940-6b43-46e9-b3ad-c4c8d0c8bcd1
Nov 05 19:26:44 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:44 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7acedbca-65ab-4ae5-81a7-f6092081bcb2 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-729799f4-e5df-46f8-8bfd-ef79a656393f" returned: 0 in 0.543s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7acedbca-65ab-4ae5-81a7-f6092081bcb2 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "cinder-quobyte-729799f4-e5df-46f8-8bfd-ef79a656393f" released by "delete_volume" :: held 1.469s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:26:44 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-7acedbca-65ab-4ae5-81a7-f6092081bcb2 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Created reservations ['2aff29d4-5955-4c63-943b-66f4f49606b3', 'efc1671e-5436-494a-8ffc-3f649c4d6e8d', 'b69cb799-5447-46a9-8d8e-e2fdf56151e4', 'd89d8681-444f-46fc-afec-d83f05be2ee0'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:26:44 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-da9b073d-6e5a-4112-818f-69ffe886d50b tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d82d6940-6b43-46e9-b3ad-c4c8d0c8bcd1" returned: 0 in 0.660s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:44 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-da9b073d-6e5a-4112-818f-69ffe886d50b tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Lock "cinder-quobyte-d82d6940-6b43-46e9-b3ad-c4c8d0c8bcd1" released by "delete_volume" :: held 1.554s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:26:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7acedbca-65ab-4ae5-81a7-f6092081bcb2 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7acedbca-65ab-4ae5-81a7-f6092081bcb2 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7acedbca-65ab-4ae5-81a7-f6092081bcb2 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:26:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7acedbca-65ab-4ae5-81a7-f6092081bcb2 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:26:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7acedbca-65ab-4ae5-81a7-f6092081bcb2 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7acedbca-65ab-4ae5-81a7-f6092081bcb2 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:45 devstack sudo[105057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:26:45 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:45 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-da9b073d-6e5a-4112-818f-69ffe886d50b tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Created reservations ['060cedc9-aba1-41b2-8075-8c583fcdcf7b', 'cd72d3f9-213e-48ea-8fa5-c1e0331572f2', '8837b73b-4cf2-4c1a-b40c-3f748709b616', '8d519a9d-4521-4bf4-9eca-866aa365bc4f'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:26:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-da9b073d-6e5a-4112-818f-69ffe886d50b tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-da9b073d-6e5a-4112-818f-69ffe886d50b tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-da9b073d-6e5a-4112-818f-69ffe886d50b tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:26:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-da9b073d-6e5a-4112-818f-69ffe886d50b tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:26:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-da9b073d-6e5a-4112-818f-69ffe886d50b tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-da9b073d-6e5a-4112-818f-69ffe886d50b tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:45 devstack sudo[105059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:26:45 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-383a4df5-4a08-4678-8c74-8ef6d480ee6d tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Acquiring lock "cinder-07d1e4d9-5678-47b2-adfc-3a423876e952-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:26:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-383a4df5-4a08-4678-8c74-8ef6d480ee6d tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "cinder-07d1e4d9-5678-47b2-adfc-3a423876e952-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:26:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-383a4df5-4a08-4678-8c74-8ef6d480ee6d tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Acquiring lock "cinder-quobyte-07d1e4d9-5678-47b2-adfc-3a423876e952" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:26:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-383a4df5-4a08-4678-8c74-8ef6d480ee6d tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "cinder-quobyte-07d1e4d9-5678-47b2-adfc-3a423876e952" acquired by "delete_volume" :: waited 0.029s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:26:45 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ccacb3-b5a6-4b03-8fb7-f1671944c0fd]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:26:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-383a4df5-4a08-4678-8c74-8ef6d480ee6d tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-07d1e4d9-5678-47b2-adfc-3a423876e952 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:45 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7acedbca-65ab-4ae5-81a7-f6092081bcb2 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.700s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:45 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-7acedbca-65ab-4ae5-81a7-f6092081bcb2 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:26:45 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-7acedbca-65ab-4ae5-81a7-f6092081bcb2 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Deleted volume successfully.
Nov 05 19:26:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7acedbca-65ab-4ae5-81a7-f6092081bcb2 tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "cinder-729799f4-e5df-46f8-8bfd-ef79a656393f-delete_volume" released by "delete_volume" :: held 2.852s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:26:45 devstack sudo[105062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-07d1e4d9-5678-47b2-adfc-3a423876e952
Nov 05 19:26:45 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:46 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-da9b073d-6e5a-4112-818f-69ffe886d50b tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.841s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:46 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-da9b073d-6e5a-4112-818f-69ffe886d50b tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:26:46 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-da9b073d-6e5a-4112-818f-69ffe886d50b tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Deleted volume successfully.
Nov 05 19:26:46 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-da9b073d-6e5a-4112-818f-69ffe886d50b tempest-VolumeAndVolumeTypeFromImageTest-1092427985 None] Lock "cinder-d82d6940-6b43-46e9-b3ad-c4c8d0c8bcd1-delete_volume" released by "delete_volume" :: held 2.995s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:26:46 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-383a4df5-4a08-4678-8c74-8ef6d480ee6d tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-07d1e4d9-5678-47b2-adfc-3a423876e952" returned: 0 in 0.788s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-383a4df5-4a08-4678-8c74-8ef6d480ee6d tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-07d1e4d9-5678-47b2-adfc-3a423876e952 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:46 devstack sudo[105068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-07d1e4d9-5678-47b2-adfc-3a423876e952
Nov 05 19:26:46 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:46 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-383a4df5-4a08-4678-8c74-8ef6d480ee6d tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-07d1e4d9-5678-47b2-adfc-3a423876e952" returned: 0 in 0.507s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-383a4df5-4a08-4678-8c74-8ef6d480ee6d tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "cinder-quobyte-07d1e4d9-5678-47b2-adfc-3a423876e952" released by "delete_volume" :: held 1.424s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:26:47 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-383a4df5-4a08-4678-8c74-8ef6d480ee6d tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Created reservations ['ae3f625d-c237-4eee-bedf-80c6d3b8c14a', 'ae62e183-aafa-4299-a3e2-00d804cacba2', '336abe46-8a92-4bbc-91a6-79a5bfc0c0dd', 'cf4dc71b-120c-4cbf-8b30-a4be2eacd253'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:26:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-383a4df5-4a08-4678-8c74-8ef6d480ee6d tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-383a4df5-4a08-4678-8c74-8ef6d480ee6d tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-383a4df5-4a08-4678-8c74-8ef6d480ee6d tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:26:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-383a4df5-4a08-4678-8c74-8ef6d480ee6d tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:26:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-383a4df5-4a08-4678-8c74-8ef6d480ee6d tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-383a4df5-4a08-4678-8c74-8ef6d480ee6d tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:47 devstack sudo[105071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:26:47 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:47 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-d62cdc39-7b68-4bcf-8010-6ae179b7d2aa tempest-ProjectAdminTests-188975659 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4295387268066, 'free_capacity_gb': 1773.4295387268066, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87184) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 05 19:26:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a0301c27-3688-40fc-bb48-278bf80645fa tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Acquiring lock "cinder-d6c039f6-aa52-4b81-a908-0a3093000493-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:26:47 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f2382de9-03fb-4a34-be2c-fa3776937c8c" returned: 0 in 9.532s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:47 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Image conversion details: src /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86, size 1024.00 MB, duration 9.53 sec, destination /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f2382de9-03fb-4a34-be2c-fa3776937c8c {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 19:26:47 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Converted 1024.00 MB image at 107.40 MB/s
Nov 05 19:26:47 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f2382de9-03fb-4a34-be2c-fa3776937c8c is being set with open permissions: ugo+rw
Nov 05 19:26:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f2382de9-03fb-4a34-be2c-fa3776937c8c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a0301c27-3688-40fc-bb48-278bf80645fa tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "cinder-d6c039f6-aa52-4b81-a908-0a3093000493-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:26:48 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-383a4df5-4a08-4678-8c74-8ef6d480ee6d tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.697s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:48 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-383a4df5-4a08-4678-8c74-8ef6d480ee6d tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:26:48 devstack sudo[105076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f2382de9-03fb-4a34-be2c-fa3776937c8c
Nov 05 19:26:48 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:48 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-383a4df5-4a08-4678-8c74-8ef6d480ee6d tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Deleted volume successfully.
Nov 05 19:26:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-383a4df5-4a08-4678-8c74-8ef6d480ee6d tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "cinder-07d1e4d9-5678-47b2-adfc-3a423876e952-delete_volume" released by "delete_volume" :: held 2.646s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:26:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a0301c27-3688-40fc-bb48-278bf80645fa tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Acquiring lock "cinder-quobyte-d6c039f6-aa52-4b81-a908-0a3093000493" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:26:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a0301c27-3688-40fc-bb48-278bf80645fa tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "cinder-quobyte-d6c039f6-aa52-4b81-a908-0a3093000493" acquired by "delete_volume" :: waited 0.032s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:26:48 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6d6e59-4cd4-4d12-855f-dfc1f7119f27]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:26:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a0301c27-3688-40fc-bb48-278bf80645fa tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d6c039f6-aa52-4b81-a908-0a3093000493 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:48 devstack sudo[105078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d6c039f6-aa52-4b81-a908-0a3093000493
Nov 05 19:26:48 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:48 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f2382de9-03fb-4a34-be2c-fa3776937c8c" returned: 0 in 0.443s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Lock "cinder-quobyte-f2382de9-03fb-4a34-be2c-fa3776937c8c" released by "_copy_volume_from_snapshot" :: held 11.268s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:26:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Lock "cinder-quobyte-136f76eb-706b-49d3-b5b7-49720e59f891-f2382de9-03fb-4a34-be2c-fa3776937c8c" released by "_create_volume_from_snapshot" :: held 11.381s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:26:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.413s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (986c8517-df7b-4e37-bd30-0ee8c7a510cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2382de9-03fb-4a34-be2c-fa3776937c8c', 'volume_size': 1, 'snapshot_id': '136f76eb-706b-49d3-b5b7-49720e59f891'}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d0311a4-dbc8-49fd-81ba-cd7ff0d42181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:48 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Volume volume-f2382de9-03fb-4a34-be2c-fa3776937c8c (f2382de9-03fb-4a34-be2c-fa3776937c8c): created successfully
Nov 05 19:26:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d0311a4-dbc8-49fd-81ba-cd7ff0d42181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Flow 'volume_create_manager' (b1c4e788-7ddc-45a6-ac8d-de2e17dc14b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:26:48 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-fa3b1ccb-d4ff-453d-b72c-5461f41a1974 tempest-VolumeDependencyTests-1893183406 None] Created volume successfully.
Nov 05 19:26:48 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a0301c27-3688-40fc-bb48-278bf80645fa tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d6c039f6-aa52-4b81-a908-0a3093000493" returned: 0 in 0.515s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a0301c27-3688-40fc-bb48-278bf80645fa tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d6c039f6-aa52-4b81-a908-0a3093000493 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:48 devstack sudo[105084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d6c039f6-aa52-4b81-a908-0a3093000493
Nov 05 19:26:48 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:49 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a0301c27-3688-40fc-bb48-278bf80645fa tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d6c039f6-aa52-4b81-a908-0a3093000493" returned: 0 in 0.299s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:49 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a0301c27-3688-40fc-bb48-278bf80645fa tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "cinder-quobyte-d6c039f6-aa52-4b81-a908-0a3093000493" released by "delete_volume" :: held 0.884s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:26:49 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-a0301c27-3688-40fc-bb48-278bf80645fa tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Created reservations ['1e7600c4-52fd-40fc-8782-4e40040f6f5b', '4eb5adb4-0604-4621-bfc2-c972af3a8c67', 'a7b658cf-7517-4333-928a-4807de15f567', '80c4343e-f497-4735-a0bb-6c395afe17fd'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:26:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a0301c27-3688-40fc-bb48-278bf80645fa tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a0301c27-3688-40fc-bb48-278bf80645fa tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a0301c27-3688-40fc-bb48-278bf80645fa tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:26:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a0301c27-3688-40fc-bb48-278bf80645fa tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:26:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a0301c27-3688-40fc-bb48-278bf80645fa tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a0301c27-3688-40fc-bb48-278bf80645fa tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:49 devstack sudo[105087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:26:49 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:49 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a0301c27-3688-40fc-bb48-278bf80645fa tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.341s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:49 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-a0301c27-3688-40fc-bb48-278bf80645fa tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:26:49 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-a0301c27-3688-40fc-bb48-278bf80645fa tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Deleted volume successfully.
Nov 05 19:26:49 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-feee7a4f-57bd-47ae-93c4-16efe6acaf66 tempest-VolumeDependencyTests-1893183406 None] Acquiring lock "cinder-136f76eb-706b-49d3-b5b7-49720e59f891-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:26:49 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a0301c27-3688-40fc-bb48-278bf80645fa tempest-CreateVolumesFromSourceVolumeTest-1955873912 None] Lock "cinder-d6c039f6-aa52-4b81-a908-0a3093000493-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:26:49 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-feee7a4f-57bd-47ae-93c4-16efe6acaf66 tempest-VolumeDependencyTests-1893183406 None] Lock "cinder-136f76eb-706b-49d3-b5b7-49720e59f891-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:26:49 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-feee7a4f-57bd-47ae-93c4-16efe6acaf66 tempest-VolumeDependencyTests-1893183406 None] Acquiring lock "cinder-quobyte-283b6041-9ccd-4729-9a6b-f0c0d86c3b86" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:26:49 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-feee7a4f-57bd-47ae-93c4-16efe6acaf66 tempest-VolumeDependencyTests-1893183406 None] Lock "cinder-quobyte-283b6041-9ccd-4729-9a6b-f0c0d86c3b86" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:26:49 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-feee7a4f-57bd-47ae-93c4-16efe6acaf66 tempest-VolumeDependencyTests-1893183406 None] Acquiring lock "cinder-quobyte-136f76eb-706b-49d3-b5b7-49720e59f891" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:26:49 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-feee7a4f-57bd-47ae-93c4-16efe6acaf66 tempest-VolumeDependencyTests-1893183406 None] Lock "cinder-quobyte-136f76eb-706b-49d3-b5b7-49720e59f891" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:26:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-feee7a4f-57bd-47ae-93c4-16efe6acaf66 tempest-VolumeDependencyTests-1893183406 None] Deleting offline snapshot 136f76eb-706b-49d3-b5b7-49720e59f891 of volume 283b6041-9ccd-4729-9a6b-f0c0d86c3b86 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:26:49 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-feee7a4f-57bd-47ae-93c4-16efe6acaf66 tempest-VolumeDependencyTests-1893183406 None] snapshot_file for this snap is: volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86.136f76eb-706b-49d3-b5b7-49720e59f891 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:26:49 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[00868fbe-c360-4de5-8dbf-397d7152da0c]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:26:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-feee7a4f-57bd-47ae-93c4-16efe6acaf66 tempest-VolumeDependencyTests-1893183406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86.136f76eb-706b-49d3-b5b7-49720e59f891 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:49 devstack sudo[105090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86.136f76eb-706b-49d3-b5b7-49720e59f891
Nov 05 19:26:49 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:50 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-feee7a4f-57bd-47ae-93c4-16efe6acaf66 tempest-VolumeDependencyTests-1893183406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86.136f76eb-706b-49d3-b5b7-49720e59f891" returned: 0 in 0.384s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-feee7a4f-57bd-47ae-93c4-16efe6acaf66 tempest-VolumeDependencyTests-1893183406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:26:50 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ecb1a69-73fd-424c-8d0a-ae2f62da43d2]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:26:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-feee7a4f-57bd-47ae-93c4-16efe6acaf66 tempest-VolumeDependencyTests-1893183406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:50 devstack sudo[105095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86
Nov 05 19:26:50 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:50 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-feee7a4f-57bd-47ae-93c4-16efe6acaf66 tempest-VolumeDependencyTests-1893183406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86" returned: 0 in 0.548s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-feee7a4f-57bd-47ae-93c4-16efe6acaf66 tempest-VolumeDependencyTests-1893183406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86.136f76eb-706b-49d3-b5b7-49720e59f891 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:50 devstack sudo[105100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86.136f76eb-706b-49d3-b5b7-49720e59f891
Nov 05 19:26:50 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:51 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-feee7a4f-57bd-47ae-93c4-16efe6acaf66 tempest-VolumeDependencyTests-1893183406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86.136f76eb-706b-49d3-b5b7-49720e59f891" returned: 0 in 0.404s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-feee7a4f-57bd-47ae-93c4-16efe6acaf66 tempest-VolumeDependencyTests-1893183406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86.136f76eb-706b-49d3-b5b7-49720e59f891 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:51 devstack sudo[105106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86.136f76eb-706b-49d3-b5b7-49720e59f891
Nov 05 19:26:51 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:51 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-feee7a4f-57bd-47ae-93c4-16efe6acaf66 tempest-VolumeDependencyTests-1893183406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86.136f76eb-706b-49d3-b5b7-49720e59f891" returned: 0 in 0.371s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-feee7a4f-57bd-47ae-93c4-16efe6acaf66 tempest-VolumeDependencyTests-1893183406 None] Lock "cinder-quobyte-136f76eb-706b-49d3-b5b7-49720e59f891" released by "_delete_snapshot" :: held 1.850s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:26:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-feee7a4f-57bd-47ae-93c4-16efe6acaf66 tempest-VolumeDependencyTests-1893183406 None] Lock "cinder-quobyte-283b6041-9ccd-4729-9a6b-f0c0d86c3b86" released by "delete_snapshot" :: held 1.884s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:26:51 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-feee7a4f-57bd-47ae-93c4-16efe6acaf66 tempest-VolumeDependencyTests-1893183406 None] Created reservations ['24f30947-2945-429f-8173-8e2a1395eedd', '32bc6401-7261-4cfe-b146-e0ab4800c00d', 'a37848c4-140c-49ee-9dcf-0a494d9a1afc', 'c8aefc16-2787-4928-be3e-b40d204ffd88'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:26:51 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-feee7a4f-57bd-47ae-93c4-16efe6acaf66 tempest-VolumeDependencyTests-1893183406 None] Delete snapshot completed successfully.
Nov 05 19:26:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-feee7a4f-57bd-47ae-93c4-16efe6acaf66 tempest-VolumeDependencyTests-1893183406 None] Lock "cinder-136f76eb-706b-49d3-b5b7-49720e59f891-delete_snapshot" released by "delete_snapshot" :: held 2.068s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:26:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4f670931-392b-4f55-83f9-e4c248350538 tempest-VolumeDependencyTests-1893183406 None] Acquiring lock "cinder-283b6041-9ccd-4729-9a6b-f0c0d86c3b86-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:26:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4f670931-392b-4f55-83f9-e4c248350538 tempest-VolumeDependencyTests-1893183406 None] Lock "cinder-283b6041-9ccd-4729-9a6b-f0c0d86c3b86-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:26:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4f670931-392b-4f55-83f9-e4c248350538 tempest-VolumeDependencyTests-1893183406 None] Acquiring lock "cinder-quobyte-283b6041-9ccd-4729-9a6b-f0c0d86c3b86" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:26:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4f670931-392b-4f55-83f9-e4c248350538 tempest-VolumeDependencyTests-1893183406 None] Lock "cinder-quobyte-283b6041-9ccd-4729-9a6b-f0c0d86c3b86" acquired by "delete_volume" :: waited 0.015s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:26:52 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad936d07-dbbe-4eae-a1ee-1c1a9b516fc9]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:26:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4f670931-392b-4f55-83f9-e4c248350538 tempest-VolumeDependencyTests-1893183406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:52 devstack sudo[105109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86
Nov 05 19:26:52 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:52 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-332db3a1-93a2-4ac8-8c30-5049b0fd2cc5 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:26:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-332db3a1-93a2-4ac8-8c30-5049b0fd2cc5 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Flow 'volume_create_manager' (8a8873d8-9705-4341-a3df-d2ecba666715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:26:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-332db3a1-93a2-4ac8-8c30-5049b0fd2cc5 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc2bcd41-266e-452c-8c6e-117d1f9ea774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-332db3a1-93a2-4ac8-8c30-5049b0fd2cc5 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc2bcd41-266e-452c-8c6e-117d1f9ea774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-700851439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a6a20b9-9ebb-4359-9b3b-3a8d2681df87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b82478cdada942f691a7114855f04aac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:26:52Z,use_quota=True,user_id='08e50ab150594947bc985f42abcfa7c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-332db3a1-93a2-4ac8-8c30-5049b0fd2cc5 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f854fd1a-91fe-4325-8223-b726f6ea671a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-332db3a1-93a2-4ac8-8c30-5049b0fd2cc5 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f854fd1a-91fe-4325-8223-b726f6ea671a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-332db3a1-93a2-4ac8-8c30-5049b0fd2cc5 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (491d629f-e383-4ab5-a384-a14623faecf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-332db3a1-93a2-4ac8-8c30-5049b0fd2cc5 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (491d629f-e383-4ab5-a384-a14623faecf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a6a20b9-9ebb-4359-9b3b-3a8d2681df87', 'volume_name': 'volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-332db3a1-93a2-4ac8-8c30-5049b0fd2cc5 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86aeb08e-8ee0-4ba6-931f-7d1399c51114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-332db3a1-93a2-4ac8-8c30-5049b0fd2cc5 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86aeb08e-8ee0-4ba6-931f-7d1399c51114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:52 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-332db3a1-93a2-4ac8-8c30-5049b0fd2cc5 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82635238-8ce3-4264-a63e-d2eef7ade529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:52 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-332db3a1-93a2-4ac8-8c30-5049b0fd2cc5 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Volume 7a6a20b9-9ebb-4359-9b3b-3a8d2681df87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87', 'volume_size': 1}
Nov 05 19:26:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-332db3a1-93a2-4ac8-8c30-5049b0fd2cc5 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-332db3a1-93a2-4ac8-8c30-5049b0fd2cc5 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-332db3a1-93a2-4ac8-8c30-5049b0fd2cc5 tempest-CreateVolumesFromSnapshotTest-1238074279 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-700851439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a6a20b9-9ebb-4359-9b3b-3a8d2681df87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b82478cdada942f691a7114855f04aac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:26:52Z,use_quota=True,user_id='08e50ab150594947bc985f42abcfa7c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:26:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-332db3a1-93a2-4ac8-8c30-5049b0fd2cc5 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Creating volume 7a6a20b9-9ebb-4359-9b3b-3a8d2681df87 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:26:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-332db3a1-93a2-4ac8-8c30-5049b0fd2cc5 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-332db3a1-93a2-4ac8-8c30-5049b0fd2cc5 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-332db3a1-93a2-4ac8-8c30-5049b0fd2cc5 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:26:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-332db3a1-93a2-4ac8-8c30-5049b0fd2cc5 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:26:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-332db3a1-93a2-4ac8-8c30-5049b0fd2cc5 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-332db3a1-93a2-4ac8-8c30-5049b0fd2cc5 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:26:52 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-332db3a1-93a2-4ac8-8c30-5049b0fd2cc5 tempest-CreateVolumesFromSnapshotTest-1238074279 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:26:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-332db3a1-93a2-4ac8-8c30-5049b0fd2cc5 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4f670931-392b-4f55-83f9-e4c248350538 tempest-VolumeDependencyTests-1893183406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86" returned: 0 in 0.501s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4f670931-392b-4f55-83f9-e4c248350538 tempest-VolumeDependencyTests-1893183406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:52 devstack sudo[105114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87 1073741824
Nov 05 19:26:52 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:52 devstack sudo[105115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86
Nov 05 19:26:52 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:52 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4f670931-392b-4f55-83f9-e4c248350538 tempest-VolumeDependencyTests-1893183406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-283b6041-9ccd-4729-9a6b-f0c0d86c3b86" returned: 0 in 0.308s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4f670931-392b-4f55-83f9-e4c248350538 tempest-VolumeDependencyTests-1893183406 None] Lock "cinder-quobyte-283b6041-9ccd-4729-9a6b-f0c0d86c3b86" released by "delete_volume" :: held 0.923s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:26:52 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-4f670931-392b-4f55-83f9-e4c248350538 tempest-VolumeDependencyTests-1893183406 None] Created reservations ['b306b7c3-f16d-44a8-88c0-d90bcf5b328a', '25548abe-ab10-4ab8-be32-1b6d74f84c95', '078fad28-8d4d-402b-9d8e-6a1334947687', '23c154ea-c848-4299-ac81-283a167f7efe'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:26:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4f670931-392b-4f55-83f9-e4c248350538 tempest-VolumeDependencyTests-1893183406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4f670931-392b-4f55-83f9-e4c248350538 tempest-VolumeDependencyTests-1893183406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4f670931-392b-4f55-83f9-e4c248350538 tempest-VolumeDependencyTests-1893183406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:26:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4f670931-392b-4f55-83f9-e4c248350538 tempest-VolumeDependencyTests-1893183406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:26:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4f670931-392b-4f55-83f9-e4c248350538 tempest-VolumeDependencyTests-1893183406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4f670931-392b-4f55-83f9-e4c248350538 tempest-VolumeDependencyTests-1893183406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:53 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-332db3a1-93a2-4ac8-8c30-5049b0fd2cc5 tempest-CreateVolumesFromSnapshotTest-1238074279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87 1073741824" returned: 0 in 0.623s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:53 devstack sudo[105157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:26:53 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-332db3a1-93a2-4ac8-8c30-5049b0fd2cc5 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:53 devstack sudo[105159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87
Nov 05 19:26:53 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:53 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4f670931-392b-4f55-83f9-e4c248350538 tempest-VolumeDependencyTests-1893183406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.357s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:53 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-4f670931-392b-4f55-83f9-e4c248350538 tempest-VolumeDependencyTests-1893183406 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:26:53 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-4f670931-392b-4f55-83f9-e4c248350538 tempest-VolumeDependencyTests-1893183406 None] Deleted volume successfully.
Nov 05 19:26:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4f670931-392b-4f55-83f9-e4c248350538 tempest-VolumeDependencyTests-1893183406 None] Lock "cinder-283b6041-9ccd-4729-9a6b-f0c0d86c3b86-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:26:53 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-332db3a1-93a2-4ac8-8c30-5049b0fd2cc5 tempest-CreateVolumesFromSnapshotTest-1238074279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87" returned: 0 in 0.415s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-332db3a1-93a2-4ac8-8c30-5049b0fd2cc5 tempest-CreateVolumesFromSnapshotTest-1238074279 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:26:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-332db3a1-93a2-4ac8-8c30-5049b0fd2cc5 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-332db3a1-93a2-4ac8-8c30-5049b0fd2cc5 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82635238-8ce3-4264-a63e-d2eef7ade529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-332db3a1-93a2-4ac8-8c30-5049b0fd2cc5 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b229296-e792-46eb-bfb6-23752240c2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:53 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-332db3a1-93a2-4ac8-8c30-5049b0fd2cc5 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Volume volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87 (7a6a20b9-9ebb-4359-9b3b-3a8d2681df87): created successfully
Nov 05 19:26:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-332db3a1-93a2-4ac8-8c30-5049b0fd2cc5 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b229296-e792-46eb-bfb6-23752240c2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:53 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-332db3a1-93a2-4ac8-8c30-5049b0fd2cc5 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Flow 'volume_create_manager' (8a8873d8-9705-4341-a3df-d2ecba666715) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:26:53 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-332db3a1-93a2-4ac8-8c30-5049b0fd2cc5 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Created volume successfully.
Nov 05 19:26:54 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fde31eea-55fd-479a-93b5-53db7726e1ed tempest-VolumeDependencyTests-1893183406 None] Acquiring lock "cinder-f2382de9-03fb-4a34-be2c-fa3776937c8c-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:26:54 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fde31eea-55fd-479a-93b5-53db7726e1ed tempest-VolumeDependencyTests-1893183406 None] Lock "cinder-f2382de9-03fb-4a34-be2c-fa3776937c8c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:26:54 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fde31eea-55fd-479a-93b5-53db7726e1ed tempest-VolumeDependencyTests-1893183406 None] Acquiring lock "cinder-quobyte-f2382de9-03fb-4a34-be2c-fa3776937c8c" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:26:54 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fde31eea-55fd-479a-93b5-53db7726e1ed tempest-VolumeDependencyTests-1893183406 None] Lock "cinder-quobyte-f2382de9-03fb-4a34-be2c-fa3776937c8c" acquired by "delete_volume" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:26:54 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4570026f-8f71-4448-a3dc-24c1d136c9da]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:26:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fde31eea-55fd-479a-93b5-53db7726e1ed tempest-VolumeDependencyTests-1893183406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f2382de9-03fb-4a34-be2c-fa3776937c8c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:54 devstack sudo[105165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f2382de9-03fb-4a34-be2c-fa3776937c8c
Nov 05 19:26:54 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:54 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fde31eea-55fd-479a-93b5-53db7726e1ed tempest-VolumeDependencyTests-1893183406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f2382de9-03fb-4a34-be2c-fa3776937c8c" returned: 0 in 0.409s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fde31eea-55fd-479a-93b5-53db7726e1ed tempest-VolumeDependencyTests-1893183406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f2382de9-03fb-4a34-be2c-fa3776937c8c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:54 devstack sudo[105170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f2382de9-03fb-4a34-be2c-fa3776937c8c
Nov 05 19:26:54 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-131c796d-0450-4a0b-8b48-29612ab10f93 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-131c796d-0450-4a0b-8b48-29612ab10f93 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-131c796d-0450-4a0b-8b48-29612ab10f93 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Creating offline snapshot db0ce854-dd54-433a-b610-1d60517124af of volume 7a6a20b9-9ebb-4359-9b3b-3a8d2681df87 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:26:54 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f329f5-f697-499f-9177-33715cddccd4]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:26:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-131c796d-0450-4a0b-8b48-29612ab10f93 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:54 devstack sudo[105172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87
Nov 05 19:26:54 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:54 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fde31eea-55fd-479a-93b5-53db7726e1ed tempest-VolumeDependencyTests-1893183406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f2382de9-03fb-4a34-be2c-fa3776937c8c" returned: 0 in 0.337s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fde31eea-55fd-479a-93b5-53db7726e1ed tempest-VolumeDependencyTests-1893183406 None] Lock "cinder-quobyte-f2382de9-03fb-4a34-be2c-fa3776937c8c" released by "delete_volume" :: held 0.803s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:26:55 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-fde31eea-55fd-479a-93b5-53db7726e1ed tempest-VolumeDependencyTests-1893183406 None] Created reservations ['85547a09-852d-4be5-ba8b-7b0e6e2502f5', '0aa3ae71-2f0a-428f-8383-528163d14317', '8d9b8b1e-9241-4eb1-ad26-4f68e8096963', '9f53053e-d1ac-47b5-ba09-8d35276b7b98'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:26:55 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-85d60730-f18c-4b8d-9d46-4a2216145fca tempest-ProjectMemberTests-1640873908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:26:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-85d60730-f18c-4b8d-9d46-4a2216145fca tempest-ProjectMemberTests-1640873908 None] Flow 'volume_create_manager' (7792dbb8-c4c4-4db9-a74a-2b32a30b650b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:26:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-85d60730-f18c-4b8d-9d46-4a2216145fca tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (083a9d44-e562-484b-aa66-e9287fb4bc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-85d60730-f18c-4b8d-9d46-4a2216145fca tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (083a9d44-e562-484b-aa66-e9287fb4bc29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:26:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-701133620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6faa54d9-5f9d-41bb-b9e0-0f09536f2446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d5b238d03346c2b35a48086a4ecc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:26:55Z,use_quota=True,user_id='9c94d9844c6446c58716ae4b34ced8c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-85d60730-f18c-4b8d-9d46-4a2216145fca tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e9f7e9-1ec7-4342-a6f8-33ff248111db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-85d60730-f18c-4b8d-9d46-4a2216145fca tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e9f7e9-1ec7-4342-a6f8-33ff248111db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-85d60730-f18c-4b8d-9d46-4a2216145fca tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a0914cc-31b3-4041-8288-c5734d3d605e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-85d60730-f18c-4b8d-9d46-4a2216145fca tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a0914cc-31b3-4041-8288-c5734d3d605e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6faa54d9-5f9d-41bb-b9e0-0f09536f2446', 'volume_name': 'volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:55 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-85d60730-f18c-4b8d-9d46-4a2216145fca tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c63b4ec-e7f7-49dc-b517-3eb77e433887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-85d60730-f18c-4b8d-9d46-4a2216145fca tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c63b4ec-e7f7-49dc-b517-3eb77e433887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-85d60730-f18c-4b8d-9d46-4a2216145fca tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40f77ffb-9ecc-407c-8a35-02aab9c7c854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:55 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-85d60730-f18c-4b8d-9d46-4a2216145fca tempest-ProjectMemberTests-1640873908 None] Volume 6faa54d9-5f9d-41bb-b9e0-0f09536f2446: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446', 'volume_size': 1}
Nov 05 19:26:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-85d60730-f18c-4b8d-9d46-4a2216145fca tempest-ProjectMemberTests-1640873908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-131c796d-0450-4a0b-8b48-29612ab10f93 tempest-CreateVolumesFromSnapshotTest-1238074279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87" returned: 0 in 0.530s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-131c796d-0450-4a0b-8b48-29612ab10f93 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87.db0ce854-dd54-433a-b610-1d60517124af 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fde31eea-55fd-479a-93b5-53db7726e1ed tempest-VolumeDependencyTests-1893183406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fde31eea-55fd-479a-93b5-53db7726e1ed tempest-VolumeDependencyTests-1893183406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:55 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fde31eea-55fd-479a-93b5-53db7726e1ed tempest-VolumeDependencyTests-1893183406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:26:55 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-fde31eea-55fd-479a-93b5-53db7726e1ed tempest-VolumeDependencyTests-1893183406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:26:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-fde31eea-55fd-479a-93b5-53db7726e1ed tempest-VolumeDependencyTests-1893183406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fde31eea-55fd-479a-93b5-53db7726e1ed tempest-VolumeDependencyTests-1893183406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:55 devstack sudo[105178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87.db0ce854-dd54-433a-b610-1d60517124af 1G
Nov 05 19:26:55 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:55 devstack sudo[105179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:26:55 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:55 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-fde31eea-55fd-479a-93b5-53db7726e1ed tempest-VolumeDependencyTests-1893183406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.327s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:55 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-fde31eea-55fd-479a-93b5-53db7726e1ed tempest-VolumeDependencyTests-1893183406 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:26:55 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-fde31eea-55fd-479a-93b5-53db7726e1ed tempest-VolumeDependencyTests-1893183406 None] Deleted volume successfully.
Nov 05 19:26:55 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-fde31eea-55fd-479a-93b5-53db7726e1ed tempest-VolumeDependencyTests-1893183406 None] Lock "cinder-f2382de9-03fb-4a34-be2c-fa3776937c8c-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:26:55 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-131c796d-0450-4a0b-8b48-29612ab10f93 tempest-CreateVolumesFromSnapshotTest-1238074279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87.db0ce854-dd54-433a-b610-1d60517124af 1G" returned: 0 in 0.547s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-131c796d-0450-4a0b-8b48-29612ab10f93 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87.db0ce854-dd54-433a-b610-1d60517124af {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:55 devstack sudo[105187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87.db0ce854-dd54-433a-b610-1d60517124af
Nov 05 19:26:55 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:56 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-131c796d-0450-4a0b-8b48-29612ab10f93 tempest-CreateVolumesFromSnapshotTest-1238074279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87.db0ce854-dd54-433a-b610-1d60517124af" returned: 0 in 0.393s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:56 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-131c796d-0450-4a0b-8b48-29612ab10f93 tempest-CreateVolumesFromSnapshotTest-1238074279 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87.db0ce854-dd54-433a-b610-1d60517124af is being set with open permissions: ugo+rw
Nov 05 19:26:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-131c796d-0450-4a0b-8b48-29612ab10f93 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87.db0ce854-dd54-433a-b610-1d60517124af {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:56 devstack sudo[105192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87.db0ce854-dd54-433a-b610-1d60517124af
Nov 05 19:26:56 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:56 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-131c796d-0450-4a0b-8b48-29612ab10f93 tempest-CreateVolumesFromSnapshotTest-1238074279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87.db0ce854-dd54-433a-b610-1d60517124af" returned: 0 in 0.268s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-131c796d-0450-4a0b-8b48-29612ab10f93 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:56 devstack sudo[105195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87.info
Nov 05 19:26:56 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:56 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-131c796d-0450-4a0b-8b48-29612ab10f93 tempest-CreateVolumesFromSnapshotTest-1238074279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87.info" returned: 0 in 0.286s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:56 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-131c796d-0450-4a0b-8b48-29612ab10f93 tempest-CreateVolumesFromSnapshotTest-1238074279 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87.info is being set with open permissions: ugo+rw
Nov 05 19:26:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-131c796d-0450-4a0b-8b48-29612ab10f93 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:56 devstack sudo[105198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87.info
Nov 05 19:26:56 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:57 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-131c796d-0450-4a0b-8b48-29612ab10f93 tempest-CreateVolumesFromSnapshotTest-1238074279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87.info" returned: 0 in 0.260s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-131c796d-0450-4a0b-8b48-29612ab10f93 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.414s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-85d60730-f18c-4b8d-9d46-4a2216145fca tempest-ProjectMemberTests-1640873908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.846s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-85d60730-f18c-4b8d-9d46-4a2216145fca tempest-ProjectMemberTests-1640873908 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:26:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-701133620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6faa54d9-5f9d-41bb-b9e0-0f09536f2446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d5b238d03346c2b35a48086a4ecc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:26:55Z,use_quota=True,user_id='9c94d9844c6446c58716ae4b34ced8c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:26:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-85d60730-f18c-4b8d-9d46-4a2216145fca tempest-ProjectMemberTests-1640873908 None] Creating volume 6faa54d9-5f9d-41bb-b9e0-0f09536f2446 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:26:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-85d60730-f18c-4b8d-9d46-4a2216145fca tempest-ProjectMemberTests-1640873908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-85d60730-f18c-4b8d-9d46-4a2216145fca tempest-ProjectMemberTests-1640873908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-85d60730-f18c-4b8d-9d46-4a2216145fca tempest-ProjectMemberTests-1640873908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:26:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-85d60730-f18c-4b8d-9d46-4a2216145fca tempest-ProjectMemberTests-1640873908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:26:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-85d60730-f18c-4b8d-9d46-4a2216145fca tempest-ProjectMemberTests-1640873908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-85d60730-f18c-4b8d-9d46-4a2216145fca tempest-ProjectMemberTests-1640873908 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:26:57 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-85d60730-f18c-4b8d-9d46-4a2216145fca tempest-ProjectMemberTests-1640873908 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:26:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-85d60730-f18c-4b8d-9d46-4a2216145fca tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:57 devstack sudo[105202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446 1073741824
Nov 05 19:26:57 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:57 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-131c796d-0450-4a0b-8b48-29612ab10f93 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Create snapshot completed successfully
Nov 05 19:26:57 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-85d60730-f18c-4b8d-9d46-4a2216145fca tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446 1073741824" returned: 0 in 0.511s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-85d60730-f18c-4b8d-9d46-4a2216145fca tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:57 devstack sudo[105209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446
Nov 05 19:26:57 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:57 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-85d60730-f18c-4b8d-9d46-4a2216145fca tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446" returned: 0 in 0.265s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-85d60730-f18c-4b8d-9d46-4a2216145fca tempest-ProjectMemberTests-1640873908 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:26:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-85d60730-f18c-4b8d-9d46-4a2216145fca tempest-ProjectMemberTests-1640873908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-85d60730-f18c-4b8d-9d46-4a2216145fca tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40f77ffb-9ecc-407c-8a35-02aab9c7c854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:57 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-85d60730-f18c-4b8d-9d46-4a2216145fca tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e952c46b-8395-4a18-950b-613fee5abf48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:58 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-85d60730-f18c-4b8d-9d46-4a2216145fca tempest-ProjectMemberTests-1640873908 None] Volume volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446 (6faa54d9-5f9d-41bb-b9e0-0f09536f2446): created successfully
Nov 05 19:26:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-85d60730-f18c-4b8d-9d46-4a2216145fca tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e952c46b-8395-4a18-950b-613fee5abf48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-85d60730-f18c-4b8d-9d46-4a2216145fca tempest-ProjectMemberTests-1640873908 None] Flow 'volume_create_manager' (7792dbb8-c4c4-4db9-a74a-2b32a30b650b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:26:58 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-85d60730-f18c-4b8d-9d46-4a2216145fca tempest-ProjectMemberTests-1640873908 None] Created volume successfully.
Nov 05 19:26:58 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f8ebe27-827e-4d04-896f-9c9251f2e54a tempest-CreateVolumesFromSnapshotTest-1238074279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:26:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1f8ebe27-827e-4d04-896f-9c9251f2e54a tempest-CreateVolumesFromSnapshotTest-1238074279 None] Flow 'volume_create_manager' (d26cfa12-c063-47e0-9fe2-2bca7dd4cb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:26:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1f8ebe27-827e-4d04-896f-9c9251f2e54a tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d84cc4a8-47ed-4e47-adf1-2dfc8c0681f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1f8ebe27-827e-4d04-896f-9c9251f2e54a tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d84cc4a8-47ed-4e47-adf1-2dfc8c0681f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-571389209',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e00c9e54-8531-4b97-97c5-d856b958aeb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b82478cdada942f691a7114855f04aac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:26:58Z,use_quota=True,user_id='08e50ab150594947bc985f42abcfa7c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1f8ebe27-827e-4d04-896f-9c9251f2e54a tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3a27004-b7f0-4d55-abaa-22a653082ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1f8ebe27-827e-4d04-896f-9c9251f2e54a tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3a27004-b7f0-4d55-abaa-22a653082ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1f8ebe27-827e-4d04-896f-9c9251f2e54a tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79b02d78-58d3-4222-a3c5-19c47dcefd7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1f8ebe27-827e-4d04-896f-9c9251f2e54a tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79b02d78-58d3-4222-a3c5-19c47dcefd7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e00c9e54-8531-4b97-97c5-d856b958aeb2', 'volume_name': 'volume-e00c9e54-8531-4b97-97c5-d856b958aeb2', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1f8ebe27-827e-4d04-896f-9c9251f2e54a tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08ad12be-dca6-4049-bc4d-0edd2f889cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1f8ebe27-827e-4d04-896f-9c9251f2e54a tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08ad12be-dca6-4049-bc4d-0edd2f889cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1f8ebe27-827e-4d04-896f-9c9251f2e54a tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c5d8da9-eabb-4df0-8b81-71fbb8d897e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:58 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-1f8ebe27-827e-4d04-896f-9c9251f2e54a tempest-CreateVolumesFromSnapshotTest-1238074279 None] Volume e00c9e54-8531-4b97-97c5-d856b958aeb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e00c9e54-8531-4b97-97c5-d856b958aeb2', 'volume_size': 1}
Nov 05 19:26:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1f8ebe27-827e-4d04-896f-9c9251f2e54a tempest-CreateVolumesFromSnapshotTest-1238074279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1f8ebe27-827e-4d04-896f-9c9251f2e54a tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1f8ebe27-827e-4d04-896f-9c9251f2e54a tempest-CreateVolumesFromSnapshotTest-1238074279 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-571389209',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e00c9e54-8531-4b97-97c5-d856b958aeb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b82478cdada942f691a7114855f04aac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:26:58Z,use_quota=True,user_id='08e50ab150594947bc985f42abcfa7c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:26:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-1f8ebe27-827e-4d04-896f-9c9251f2e54a tempest-CreateVolumesFromSnapshotTest-1238074279 None] Creating volume e00c9e54-8531-4b97-97c5-d856b958aeb2 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:26:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1f8ebe27-827e-4d04-896f-9c9251f2e54a tempest-CreateVolumesFromSnapshotTest-1238074279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1f8ebe27-827e-4d04-896f-9c9251f2e54a tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1f8ebe27-827e-4d04-896f-9c9251f2e54a tempest-CreateVolumesFromSnapshotTest-1238074279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:26:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1f8ebe27-827e-4d04-896f-9c9251f2e54a tempest-CreateVolumesFromSnapshotTest-1238074279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:26:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1f8ebe27-827e-4d04-896f-9c9251f2e54a tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1f8ebe27-827e-4d04-896f-9c9251f2e54a tempest-CreateVolumesFromSnapshotTest-1238074279 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:26:58 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-1f8ebe27-827e-4d04-896f-9c9251f2e54a tempest-CreateVolumesFromSnapshotTest-1238074279 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:26:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1f8ebe27-827e-4d04-896f-9c9251f2e54a tempest-CreateVolumesFromSnapshotTest-1238074279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e00c9e54-8531-4b97-97c5-d856b958aeb2 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:58 devstack sudo[105212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e00c9e54-8531-4b97-97c5-d856b958aeb2 1073741824
Nov 05 19:26:58 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:59 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1f8ebe27-827e-4d04-896f-9c9251f2e54a tempest-CreateVolumesFromSnapshotTest-1238074279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e00c9e54-8531-4b97-97c5-d856b958aeb2 1073741824" returned: 0 in 0.541s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-a073521e-496c-4169-b2e3-df8e79c1d418 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a073521e-496c-4169-b2e3-df8e79c1d418 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Flow 'volume_create_manager' (2827adfc-e6b1-4cfc-bf57-46d60b925910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a073521e-496c-4169-b2e3-df8e79c1d418 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7aa330c-7238-4a42-8a21-4433f6eb4048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a073521e-496c-4169-b2e3-df8e79c1d418 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7aa330c-7238-4a42-8a21-4433f6eb4048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-979196793',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56bbdfcf-6d48-469c-8ea0-00d13f8bdd85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b82478cdada942f691a7114855f04aac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:26:59Z,use_quota=True,user_id='08e50ab150594947bc985f42abcfa7c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a073521e-496c-4169-b2e3-df8e79c1d418 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef8ca2bd-866b-4d2f-8e16-850c57620753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a073521e-496c-4169-b2e3-df8e79c1d418 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef8ca2bd-866b-4d2f-8e16-850c57620753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a073521e-496c-4169-b2e3-df8e79c1d418 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd0b27a0-0d95-40b1-a061-ee7ae26b174a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a073521e-496c-4169-b2e3-df8e79c1d418 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd0b27a0-0d95-40b1-a061-ee7ae26b174a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56bbdfcf-6d48-469c-8ea0-00d13f8bdd85', 'volume_name': 'volume-56bbdfcf-6d48-469c-8ea0-00d13f8bdd85', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a073521e-496c-4169-b2e3-df8e79c1d418 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb21fec6-47b7-4504-8ab7-fa8a6ae7025f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a073521e-496c-4169-b2e3-df8e79c1d418 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb21fec6-47b7-4504-8ab7-fa8a6ae7025f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a073521e-496c-4169-b2e3-df8e79c1d418 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cae26ee0-014e-4383-8e43-53ee7ade6526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:59 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-a073521e-496c-4169-b2e3-df8e79c1d418 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Volume 56bbdfcf-6d48-469c-8ea0-00d13f8bdd85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56bbdfcf-6d48-469c-8ea0-00d13f8bdd85', 'volume_size': 1}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a073521e-496c-4169-b2e3-df8e79c1d418 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1f8ebe27-827e-4d04-896f-9c9251f2e54a tempest-CreateVolumesFromSnapshotTest-1238074279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e00c9e54-8531-4b97-97c5-d856b958aeb2 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:59 devstack sudo[105218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e00c9e54-8531-4b97-97c5-d856b958aeb2
Nov 05 19:26:59 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-4be413ef-f402-48b2-b81f-733d5d2a7726 tempest-CinderUnicodeTest-853941933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4be413ef-f402-48b2-b81f-733d5d2a7726 tempest-CinderUnicodeTest-853941933 None] Flow 'volume_create_manager' (9e701183-ed01-4181-bbd0-bd58ab2faa13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4be413ef-f402-48b2-b81f-733d5d2a7726 tempest-CinderUnicodeTest-853941933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f023cf7b-e49a-442d-b5e8-d5b58bffd4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4be413ef-f402-48b2-b81f-733d5d2a7726 tempest-CinderUnicodeTest-853941933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f023cf7b-e49a-442d-b5e8-d5b58bffd4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f2a4277-50ac-4ed8-88fb-f1b16556bf3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77a82abbe104445a5792f181f123592',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:26:59Z,use_quota=True,user_id='6043491bfb11429dad3d9743cb26c526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4be413ef-f402-48b2-b81f-733d5d2a7726 tempest-CinderUnicodeTest-853941933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e3a79e2-ebd5-4c45-847a-5a7d70227730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4be413ef-f402-48b2-b81f-733d5d2a7726 tempest-CinderUnicodeTest-853941933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e3a79e2-ebd5-4c45-847a-5a7d70227730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4be413ef-f402-48b2-b81f-733d5d2a7726 tempest-CinderUnicodeTest-853941933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db24cd48-ef17-4098-9a07-b255dc6a11df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4be413ef-f402-48b2-b81f-733d5d2a7726 tempest-CinderUnicodeTest-853941933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db24cd48-ef17-4098-9a07-b255dc6a11df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f2a4277-50ac-4ed8-88fb-f1b16556bf3d', 'volume_name': 'volume-2f2a4277-50ac-4ed8-88fb-f1b16556bf3d', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4be413ef-f402-48b2-b81f-733d5d2a7726 tempest-CinderUnicodeTest-853941933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42c5ee38-9b0e-485b-a137-34ce27759507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4be413ef-f402-48b2-b81f-733d5d2a7726 tempest-CinderUnicodeTest-853941933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42c5ee38-9b0e-485b-a137-34ce27759507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4be413ef-f402-48b2-b81f-733d5d2a7726 tempest-CinderUnicodeTest-853941933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2ee655f-0beb-4318-aca9-9340f9bf8733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:59 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-4be413ef-f402-48b2-b81f-733d5d2a7726 tempest-CinderUnicodeTest-853941933 None] Volume 2f2a4277-50ac-4ed8-88fb-f1b16556bf3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f2a4277-50ac-4ed8-88fb-f1b16556bf3d', 'volume_size': 1}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4be413ef-f402-48b2-b81f-733d5d2a7726 tempest-CinderUnicodeTest-853941933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1cd2f625-2dfa-4751-a842-c1ee3547a181 tempest-ProjectMemberTests-1640873908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:59 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1f8ebe27-827e-4d04-896f-9c9251f2e54a tempest-CreateVolumesFromSnapshotTest-1238074279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e00c9e54-8531-4b97-97c5-d856b958aeb2" returned: 0 in 0.458s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1f8ebe27-827e-4d04-896f-9c9251f2e54a tempest-CreateVolumesFromSnapshotTest-1238074279 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1f8ebe27-827e-4d04-896f-9c9251f2e54a tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a073521e-496c-4169-b2e3-df8e79c1d418 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.467s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a073521e-496c-4169-b2e3-df8e79c1d418 tempest-CreateVolumesFromSnapshotTest-1238074279 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-979196793',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56bbdfcf-6d48-469c-8ea0-00d13f8bdd85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b82478cdada942f691a7114855f04aac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:26:59Z,use_quota=True,user_id='08e50ab150594947bc985f42abcfa7c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-a073521e-496c-4169-b2e3-df8e79c1d418 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Creating volume 56bbdfcf-6d48-469c-8ea0-00d13f8bdd85 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a073521e-496c-4169-b2e3-df8e79c1d418 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a073521e-496c-4169-b2e3-df8e79c1d418 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a073521e-496c-4169-b2e3-df8e79c1d418 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a073521e-496c-4169-b2e3-df8e79c1d418 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a073521e-496c-4169-b2e3-df8e79c1d418 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a073521e-496c-4169-b2e3-df8e79c1d418 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:26:59 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-a073521e-496c-4169-b2e3-df8e79c1d418 tempest-CreateVolumesFromSnapshotTest-1238074279 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a073521e-496c-4169-b2e3-df8e79c1d418 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-56bbdfcf-6d48-469c-8ea0-00d13f8bdd85 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:26:59 devstack sudo[105222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-56bbdfcf-6d48-469c-8ea0-00d13f8bdd85 1073741824
Nov 05 19:26:59 devstack sudo[105222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e7a7370-8077-4490-b30a-5f7d67c38158 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2e7a7370-8077-4490-b30a-5f7d67c38158 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Flow 'volume_create_manager' (793331e9-1827-43ec-b0e0-62db17ddc324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2e7a7370-8077-4490-b30a-5f7d67c38158 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a024fc0-6a97-410f-9941-539777101b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1f8ebe27-827e-4d04-896f-9c9251f2e54a tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c5d8da9-eabb-4df0-8b81-71fbb8d897e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e00c9e54-8531-4b97-97c5-d856b958aeb2', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1f8ebe27-827e-4d04-896f-9c9251f2e54a tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff83b523-4daf-4aec-8c39-edbf546d0707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2e7a7370-8077-4490-b30a-5f7d67c38158 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a024fc0-6a97-410f-9941-539777101b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-520594559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb6a1821-b70e-41d0-ab52-6ad47e433922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b82478cdada942f691a7114855f04aac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:27:00Z,use_quota=True,user_id='08e50ab150594947bc985f42abcfa7c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2e7a7370-8077-4490-b30a-5f7d67c38158 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f768fc9b-cc81-47b6-b9bd-e27041a4e841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2e7a7370-8077-4490-b30a-5f7d67c38158 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f768fc9b-cc81-47b6-b9bd-e27041a4e841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2e7a7370-8077-4490-b30a-5f7d67c38158 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e10a717b-9404-4819-833d-78ae1b2f2d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2e7a7370-8077-4490-b30a-5f7d67c38158 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e10a717b-9404-4819-833d-78ae1b2f2d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb6a1821-b70e-41d0-ab52-6ad47e433922', 'volume_name': 'volume-fb6a1821-b70e-41d0-ab52-6ad47e433922', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2e7a7370-8077-4490-b30a-5f7d67c38158 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eeb5bbd-2eb7-4c6a-8e24-5e4d6fc12670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2e7a7370-8077-4490-b30a-5f7d67c38158 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eeb5bbd-2eb7-4c6a-8e24-5e4d6fc12670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2e7a7370-8077-4490-b30a-5f7d67c38158 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (283fc311-6ca1-49a1-9605-3243d373b839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:26:59 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-2e7a7370-8077-4490-b30a-5f7d67c38158 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Volume fb6a1821-b70e-41d0-ab52-6ad47e433922: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb6a1821-b70e-41d0-ab52-6ad47e433922', 'volume_size': 1}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2e7a7370-8077-4490-b30a-5f7d67c38158 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:26:59 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-1f8ebe27-827e-4d04-896f-9c9251f2e54a tempest-CreateVolumesFromSnapshotTest-1238074279 None] Volume volume-e00c9e54-8531-4b97-97c5-d856b958aeb2 (e00c9e54-8531-4b97-97c5-d856b958aeb2): created successfully
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1f8ebe27-827e-4d04-896f-9c9251f2e54a tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff83b523-4daf-4aec-8c39-edbf546d0707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-1f8ebe27-827e-4d04-896f-9c9251f2e54a tempest-CreateVolumesFromSnapshotTest-1238074279 None] Flow 'volume_create_manager' (d26cfa12-c063-47e0-9fe2-2bca7dd4cb04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:26:59 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-1f8ebe27-827e-4d04-896f-9c9251f2e54a tempest-CreateVolumesFromSnapshotTest-1238074279 None] Created volume successfully.
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-4786f361-6357-46d7-8089-1ef416a46434 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4786f361-6357-46d7-8089-1ef416a46434 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Flow 'volume_create_manager' (dace10d5-3a5c-4f0e-9b65-5be6369b3e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:26:59 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4786f361-6357-46d7-8089-1ef416a46434 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50c737cc-e4d7-4525-ab58-958807628652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4786f361-6357-46d7-8089-1ef416a46434 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50c737cc-e4d7-4525-ab58-958807628652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1048348274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8baed7bd-e000-42ce-bb9b-9303d42b359e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b82478cdada942f691a7114855f04aac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:27:00Z,use_quota=True,user_id='08e50ab150594947bc985f42abcfa7c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4786f361-6357-46d7-8089-1ef416a46434 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d49197c5-f82d-4f8e-9a46-553acc95dbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4786f361-6357-46d7-8089-1ef416a46434 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d49197c5-f82d-4f8e-9a46-553acc95dbb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4786f361-6357-46d7-8089-1ef416a46434 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13ef3190-0b6a-4644-82e7-33fa31a7ce71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4786f361-6357-46d7-8089-1ef416a46434 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13ef3190-0b6a-4644-82e7-33fa31a7ce71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8baed7bd-e000-42ce-bb9b-9303d42b359e', 'volume_name': 'volume-8baed7bd-e000-42ce-bb9b-9303d42b359e', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4786f361-6357-46d7-8089-1ef416a46434 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (051a7d28-9a21-437b-b511-da3d5b487867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4786f361-6357-46d7-8089-1ef416a46434 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (051a7d28-9a21-437b-b511-da3d5b487867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4786f361-6357-46d7-8089-1ef416a46434 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efa96407-c877-47b5-81d2-4546ff2b2187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:00 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-4786f361-6357-46d7-8089-1ef416a46434 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Volume 8baed7bd-e000-42ce-bb9b-9303d42b359e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8baed7bd-e000-42ce-bb9b-9303d42b359e', 'volume_size': 1}
Nov 05 19:27:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4786f361-6357-46d7-8089-1ef416a46434 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:00 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-945eef4a-225c-418e-b92d-73d1ee41a66d tempest-CreateVolumesFromSnapshotTest-1238074279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:27:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-945eef4a-225c-418e-b92d-73d1ee41a66d tempest-CreateVolumesFromSnapshotTest-1238074279 None] Flow 'volume_create_manager' (3f6c0b8e-9bf0-4f78-8b77-f996320be32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:27:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-945eef4a-225c-418e-b92d-73d1ee41a66d tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc6a4d64-ec8a-4648-9391-99a1aef9d305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-945eef4a-225c-418e-b92d-73d1ee41a66d tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc6a4d64-ec8a-4648-9391-99a1aef9d305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-435474004',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86f6b6c9-b97e-4541-9b91-1007a0c96ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b82478cdada942f691a7114855f04aac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:27:00Z,use_quota=True,user_id='08e50ab150594947bc985f42abcfa7c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-945eef4a-225c-418e-b92d-73d1ee41a66d tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b539b7-0320-4d78-9e47-87f8139322c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-945eef4a-225c-418e-b92d-73d1ee41a66d tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b539b7-0320-4d78-9e47-87f8139322c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-945eef4a-225c-418e-b92d-73d1ee41a66d tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e9218c-1736-4aba-a0b5-e42fe9230fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-945eef4a-225c-418e-b92d-73d1ee41a66d tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e9218c-1736-4aba-a0b5-e42fe9230fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86f6b6c9-b97e-4541-9b91-1007a0c96ceb', 'volume_name': 'volume-86f6b6c9-b97e-4541-9b91-1007a0c96ceb', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-945eef4a-225c-418e-b92d-73d1ee41a66d tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d26e40b-823a-41f1-b30f-669c9a176df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-945eef4a-225c-418e-b92d-73d1ee41a66d tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d26e40b-823a-41f1-b30f-669c9a176df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-945eef4a-225c-418e-b92d-73d1ee41a66d tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93e7716c-ad57-4530-80ce-e520b616a9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:00 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-945eef4a-225c-418e-b92d-73d1ee41a66d tempest-CreateVolumesFromSnapshotTest-1238074279 None] Volume 86f6b6c9-b97e-4541-9b91-1007a0c96ceb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86f6b6c9-b97e-4541-9b91-1007a0c96ceb', 'volume_size': 1}
Nov 05 19:27:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-945eef4a-225c-418e-b92d-73d1ee41a66d tempest-CreateVolumesFromSnapshotTest-1238074279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:00 devstack sudo[105222]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a073521e-496c-4169-b2e3-df8e79c1d418 tempest-CreateVolumesFromSnapshotTest-1238074279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-56bbdfcf-6d48-469c-8ea0-00d13f8bdd85 1073741824" returned: 0 in 0.668s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a073521e-496c-4169-b2e3-df8e79c1d418 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-56bbdfcf-6d48-469c-8ea0-00d13f8bdd85 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:00 devstack sudo[105229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-56bbdfcf-6d48-469c-8ea0-00d13f8bdd85
Nov 05 19:27:00 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:00 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a073521e-496c-4169-b2e3-df8e79c1d418 tempest-CreateVolumesFromSnapshotTest-1238074279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-56bbdfcf-6d48-469c-8ea0-00d13f8bdd85" returned: 0 in 0.248s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a073521e-496c-4169-b2e3-df8e79c1d418 tempest-CreateVolumesFromSnapshotTest-1238074279 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:27:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a073521e-496c-4169-b2e3-df8e79c1d418 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4be413ef-f402-48b2-b81f-733d5d2a7726 tempest-CinderUnicodeTest-853941933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.116s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4be413ef-f402-48b2-b81f-733d5d2a7726 tempest-CinderUnicodeTest-853941933 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f2a4277-50ac-4ed8-88fb-f1b16556bf3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77a82abbe104445a5792f181f123592',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:26:59Z,use_quota=True,user_id='6043491bfb11429dad3d9743cb26c526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:27:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-4be413ef-f402-48b2-b81f-733d5d2a7726 tempest-CinderUnicodeTest-853941933 None] Creating volume 2f2a4277-50ac-4ed8-88fb-f1b16556bf3d {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:27:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4be413ef-f402-48b2-b81f-733d5d2a7726 tempest-CinderUnicodeTest-853941933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4be413ef-f402-48b2-b81f-733d5d2a7726 tempest-CinderUnicodeTest-853941933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4be413ef-f402-48b2-b81f-733d5d2a7726 tempest-CinderUnicodeTest-853941933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:27:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4be413ef-f402-48b2-b81f-733d5d2a7726 tempest-CinderUnicodeTest-853941933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:27:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4be413ef-f402-48b2-b81f-733d5d2a7726 tempest-CinderUnicodeTest-853941933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4be413ef-f402-48b2-b81f-733d5d2a7726 tempest-CinderUnicodeTest-853941933 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:27:00 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-4be413ef-f402-48b2-b81f-733d5d2a7726 tempest-CinderUnicodeTest-853941933 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:27:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4be413ef-f402-48b2-b81f-733d5d2a7726 tempest-CinderUnicodeTest-853941933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-2f2a4277-50ac-4ed8-88fb-f1b16556bf3d 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a073521e-496c-4169-b2e3-df8e79c1d418 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cae26ee0-014e-4383-8e43-53ee7ade6526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56bbdfcf-6d48-469c-8ea0-00d13f8bdd85', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:00 devstack sudo[105232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-2f2a4277-50ac-4ed8-88fb-f1b16556bf3d 1073741824
Nov 05 19:27:00 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a073521e-496c-4169-b2e3-df8e79c1d418 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfaf3d08-5173-47f0-9389-a3657172c669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:00 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-a073521e-496c-4169-b2e3-df8e79c1d418 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Volume volume-56bbdfcf-6d48-469c-8ea0-00d13f8bdd85 (56bbdfcf-6d48-469c-8ea0-00d13f8bdd85): created successfully
Nov 05 19:27:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a073521e-496c-4169-b2e3-df8e79c1d418 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfaf3d08-5173-47f0-9389-a3657172c669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a073521e-496c-4169-b2e3-df8e79c1d418 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Flow 'volume_create_manager' (2827adfc-e6b1-4cfc-bf57-46d60b925910) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:27:00 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-a073521e-496c-4169-b2e3-df8e79c1d418 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Created volume successfully.
Nov 05 19:27:01 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4be413ef-f402-48b2-b81f-733d5d2a7726 tempest-CinderUnicodeTest-853941933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-2f2a4277-50ac-4ed8-88fb-f1b16556bf3d 1073741824" returned: 0 in 0.444s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4be413ef-f402-48b2-b81f-733d5d2a7726 tempest-CinderUnicodeTest-853941933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-2f2a4277-50ac-4ed8-88fb-f1b16556bf3d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:01 devstack sudo[105238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-2f2a4277-50ac-4ed8-88fb-f1b16556bf3d
Nov 05 19:27:01 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:01 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4be413ef-f402-48b2-b81f-733d5d2a7726 tempest-CinderUnicodeTest-853941933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-2f2a4277-50ac-4ed8-88fb-f1b16556bf3d" returned: 0 in 0.267s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4be413ef-f402-48b2-b81f-733d5d2a7726 tempest-CinderUnicodeTest-853941933 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:27:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4be413ef-f402-48b2-b81f-733d5d2a7726 tempest-CinderUnicodeTest-853941933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1cd2f625-2dfa-4751-a842-c1ee3547a181 tempest-ProjectMemberTests-1640873908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.841s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4be413ef-f402-48b2-b81f-733d5d2a7726 tempest-CinderUnicodeTest-853941933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2ee655f-0beb-4318-aca9-9340f9bf8733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f2a4277-50ac-4ed8-88fb-f1b16556bf3d', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4be413ef-f402-48b2-b81f-733d5d2a7726 tempest-CinderUnicodeTest-853941933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a30f6c4d-92f1-4738-8491-96e806ad1671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-1cd2f625-2dfa-4751-a842-c1ee3547a181 tempest-ProjectMemberTests-1640873908 None] Creating offline snapshot 4f360af5-b5de-4c9f-950d-7eae9757b455 of volume 6faa54d9-5f9d-41bb-b9e0-0f09536f2446 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:27:01 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-4be413ef-f402-48b2-b81f-733d5d2a7726 tempest-CinderUnicodeTest-853941933 None] Volume volume-2f2a4277-50ac-4ed8-88fb-f1b16556bf3d (2f2a4277-50ac-4ed8-88fb-f1b16556bf3d): created successfully
Nov 05 19:27:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4be413ef-f402-48b2-b81f-733d5d2a7726 tempest-CinderUnicodeTest-853941933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a30f6c4d-92f1-4738-8491-96e806ad1671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:01 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4be413ef-f402-48b2-b81f-733d5d2a7726 tempest-CinderUnicodeTest-853941933 None] Flow 'volume_create_manager' (9e701183-ed01-4181-bbd0-bd58ab2faa13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:27:01 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce2c917-8108-49b3-a342-f62d0aa13b47]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1cd2f625-2dfa-4751-a842-c1ee3547a181 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:01 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-4be413ef-f402-48b2-b81f-733d5d2a7726 tempest-CinderUnicodeTest-853941933 None] Created volume successfully.
Nov 05 19:27:01 devstack sudo[105241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446
Nov 05 19:27:01 devstack sudo[105241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:01 devstack sudo[105241]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1cd2f625-2dfa-4751-a842-c1ee3547a181 tempest-ProjectMemberTests-1640873908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446" returned: 0 in 0.380s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1cd2f625-2dfa-4751-a842-c1ee3547a181 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446.4f360af5-b5de-4c9f-950d-7eae9757b455 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:01 devstack sudo[105246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446.4f360af5-b5de-4c9f-950d-7eae9757b455 1G
Nov 05 19:27:01 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:02 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1cd2f625-2dfa-4751-a842-c1ee3547a181 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446.4f360af5-b5de-4c9f-950d-7eae9757b455 1G" returned: 0 in 0.471s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1cd2f625-2dfa-4751-a842-c1ee3547a181 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446.4f360af5-b5de-4c9f-950d-7eae9757b455 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:02 devstack sudo[105251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446.4f360af5-b5de-4c9f-950d-7eae9757b455
Nov 05 19:27:02 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:02 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1cd2f625-2dfa-4751-a842-c1ee3547a181 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446.4f360af5-b5de-4c9f-950d-7eae9757b455" returned: 0 in 0.353s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:02 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-1cd2f625-2dfa-4751-a842-c1ee3547a181 tempest-ProjectMemberTests-1640873908 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446.4f360af5-b5de-4c9f-950d-7eae9757b455 is being set with open permissions: ugo+rw
Nov 05 19:27:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1cd2f625-2dfa-4751-a842-c1ee3547a181 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446.4f360af5-b5de-4c9f-950d-7eae9757b455 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:02 devstack sudo[105257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446.4f360af5-b5de-4c9f-950d-7eae9757b455
Nov 05 19:27:02 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:02 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1cd2f625-2dfa-4751-a842-c1ee3547a181 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446.4f360af5-b5de-4c9f-950d-7eae9757b455" returned: 0 in 0.278s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1cd2f625-2dfa-4751-a842-c1ee3547a181 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:03 devstack sudo[105260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446.info
Nov 05 19:27:03 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:03 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee7f81c8-680b-4c3b-8d9e-95b39af9ec32 tempest-CinderUnicodeTest-853941933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:27:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ee7f81c8-680b-4c3b-8d9e-95b39af9ec32 tempest-CinderUnicodeTest-853941933 None] Flow 'volume_create_manager' (872c8519-1842-4cb8-8961-f48a7c892597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:27:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ee7f81c8-680b-4c3b-8d9e-95b39af9ec32 tempest-CinderUnicodeTest-853941933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d1b8bf6-6e48-47c3-85fc-b0bf0e1dcc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ee7f81c8-680b-4c3b-8d9e-95b39af9ec32 tempest-CinderUnicodeTest-853941933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d1b8bf6-6e48-47c3-85fc-b0bf0e1dcc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:27:03Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1882821166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90866496-aafb-4fa5-b554-0b873853bee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77a82abbe104445a5792f181f123592',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:27:03Z,use_quota=True,user_id='6043491bfb11429dad3d9743cb26c526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ee7f81c8-680b-4c3b-8d9e-95b39af9ec32 tempest-CinderUnicodeTest-853941933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (920391ae-a91d-4ee5-a8bd-02646a1103b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ee7f81c8-680b-4c3b-8d9e-95b39af9ec32 tempest-CinderUnicodeTest-853941933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (920391ae-a91d-4ee5-a8bd-02646a1103b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ee7f81c8-680b-4c3b-8d9e-95b39af9ec32 tempest-CinderUnicodeTest-853941933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73dba404-4897-4b22-a421-83fcdb21a55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ee7f81c8-680b-4c3b-8d9e-95b39af9ec32 tempest-CinderUnicodeTest-853941933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73dba404-4897-4b22-a421-83fcdb21a55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90866496-aafb-4fa5-b554-0b873853bee7', 'volume_name': 'volume-90866496-aafb-4fa5-b554-0b873853bee7', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ee7f81c8-680b-4c3b-8d9e-95b39af9ec32 tempest-CinderUnicodeTest-853941933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25fda8a8-db8f-4036-b2f2-56d26da2e2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ee7f81c8-680b-4c3b-8d9e-95b39af9ec32 tempest-CinderUnicodeTest-853941933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25fda8a8-db8f-4036-b2f2-56d26da2e2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:03 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ee7f81c8-680b-4c3b-8d9e-95b39af9ec32 tempest-CinderUnicodeTest-853941933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cc2d68f-d037-43ae-846f-480d85f831ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:03 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-ee7f81c8-680b-4c3b-8d9e-95b39af9ec32 tempest-CinderUnicodeTest-853941933 None] Volume 90866496-aafb-4fa5-b554-0b873853bee7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90866496-aafb-4fa5-b554-0b873853bee7', 'volume_size': 1}
Nov 05 19:27:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ee7f81c8-680b-4c3b-8d9e-95b39af9ec32 tempest-CinderUnicodeTest-853941933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:03 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1cd2f625-2dfa-4751-a842-c1ee3547a181 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446.info" returned: 0 in 0.272s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:03 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-1cd2f625-2dfa-4751-a842-c1ee3547a181 tempest-ProjectMemberTests-1640873908 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446.info is being set with open permissions: ugo+rw
Nov 05 19:27:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1cd2f625-2dfa-4751-a842-c1ee3547a181 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:03 devstack sudo[105263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446.info
Nov 05 19:27:03 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:03 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1cd2f625-2dfa-4751-a842-c1ee3547a181 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446.info" returned: 0 in 0.259s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1cd2f625-2dfa-4751-a842-c1ee3547a181 tempest-ProjectMemberTests-1640873908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.143s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2e7a7370-8077-4490-b30a-5f7d67c38158 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.680s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2e7a7370-8077-4490-b30a-5f7d67c38158 tempest-CreateVolumesFromSnapshotTest-1238074279 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-520594559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb6a1821-b70e-41d0-ab52-6ad47e433922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b82478cdada942f691a7114855f04aac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:27:00Z,use_quota=True,user_id='08e50ab150594947bc985f42abcfa7c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:27:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-2e7a7370-8077-4490-b30a-5f7d67c38158 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Creating volume fb6a1821-b70e-41d0-ab52-6ad47e433922 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:27:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2e7a7370-8077-4490-b30a-5f7d67c38158 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2e7a7370-8077-4490-b30a-5f7d67c38158 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2e7a7370-8077-4490-b30a-5f7d67c38158 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:27:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2e7a7370-8077-4490-b30a-5f7d67c38158 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:27:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2e7a7370-8077-4490-b30a-5f7d67c38158 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:03 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2e7a7370-8077-4490-b30a-5f7d67c38158 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:27:03 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-2e7a7370-8077-4490-b30a-5f7d67c38158 tempest-CreateVolumesFromSnapshotTest-1238074279 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:27:03 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2e7a7370-8077-4490-b30a-5f7d67c38158 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fb6a1821-b70e-41d0-ab52-6ad47e433922 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:03 devstack sudo[105266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fb6a1821-b70e-41d0-ab52-6ad47e433922 1073741824
Nov 05 19:27:03 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:03 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-1cd2f625-2dfa-4751-a842-c1ee3547a181 tempest-ProjectMemberTests-1640873908 None] Create snapshot completed successfully
Nov 05 19:27:04 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2e7a7370-8077-4490-b30a-5f7d67c38158 tempest-CreateVolumesFromSnapshotTest-1238074279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fb6a1821-b70e-41d0-ab52-6ad47e433922 1073741824" returned: 0 in 0.437s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2e7a7370-8077-4490-b30a-5f7d67c38158 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fb6a1821-b70e-41d0-ab52-6ad47e433922 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:04 devstack sudo[105272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fb6a1821-b70e-41d0-ab52-6ad47e433922
Nov 05 19:27:04 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:04 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2e7a7370-8077-4490-b30a-5f7d67c38158 tempest-CreateVolumesFromSnapshotTest-1238074279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fb6a1821-b70e-41d0-ab52-6ad47e433922" returned: 0 in 0.250s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2e7a7370-8077-4490-b30a-5f7d67c38158 tempest-CreateVolumesFromSnapshotTest-1238074279 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2e7a7370-8077-4490-b30a-5f7d67c38158 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4786f361-6357-46d7-8089-1ef416a46434 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.248s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4786f361-6357-46d7-8089-1ef416a46434 tempest-CreateVolumesFromSnapshotTest-1238074279 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1048348274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8baed7bd-e000-42ce-bb9b-9303d42b359e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b82478cdada942f691a7114855f04aac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:27:00Z,use_quota=True,user_id='08e50ab150594947bc985f42abcfa7c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-4786f361-6357-46d7-8089-1ef416a46434 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Creating volume 8baed7bd-e000-42ce-bb9b-9303d42b359e {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4786f361-6357-46d7-8089-1ef416a46434 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4786f361-6357-46d7-8089-1ef416a46434 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4786f361-6357-46d7-8089-1ef416a46434 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4786f361-6357-46d7-8089-1ef416a46434 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4786f361-6357-46d7-8089-1ef416a46434 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4786f361-6357-46d7-8089-1ef416a46434 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:27:04 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-4786f361-6357-46d7-8089-1ef416a46434 tempest-CreateVolumesFromSnapshotTest-1238074279 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4786f361-6357-46d7-8089-1ef416a46434 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8baed7bd-e000-42ce-bb9b-9303d42b359e 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2e7a7370-8077-4490-b30a-5f7d67c38158 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (283fc311-6ca1-49a1-9605-3243d373b839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb6a1821-b70e-41d0-ab52-6ad47e433922', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2e7a7370-8077-4490-b30a-5f7d67c38158 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4014b45d-0f40-46e9-b3e7-d7544550330a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:04 devstack sudo[105275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8baed7bd-e000-42ce-bb9b-9303d42b359e 1073741824
Nov 05 19:27:04 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:04 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-2e7a7370-8077-4490-b30a-5f7d67c38158 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Volume volume-fb6a1821-b70e-41d0-ab52-6ad47e433922 (fb6a1821-b70e-41d0-ab52-6ad47e433922): created successfully
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2e7a7370-8077-4490-b30a-5f7d67c38158 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4014b45d-0f40-46e9-b3e7-d7544550330a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2e7a7370-8077-4490-b30a-5f7d67c38158 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Flow 'volume_create_manager' (793331e9-1827-43ec-b0e0-62db17ddc324) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:27:04 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-2e7a7370-8077-4490-b30a-5f7d67c38158 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Created volume successfully.
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6220154e-bd55-492f-8985-ed5c5d9c76a2 tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-4f360af5-b5de-4c9f-950d-7eae9757b455-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6220154e-bd55-492f-8985-ed5c5d9c76a2 tempest-ProjectMemberTests-1640873908 None] Lock "cinder-4f360af5-b5de-4c9f-950d-7eae9757b455-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6220154e-bd55-492f-8985-ed5c5d9c76a2 tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-quobyte-6faa54d9-5f9d-41bb-b9e0-0f09536f2446" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6220154e-bd55-492f-8985-ed5c5d9c76a2 tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-6faa54d9-5f9d-41bb-b9e0-0f09536f2446" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6220154e-bd55-492f-8985-ed5c5d9c76a2 tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-quobyte-4f360af5-b5de-4c9f-950d-7eae9757b455" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6220154e-bd55-492f-8985-ed5c5d9c76a2 tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-4f360af5-b5de-4c9f-950d-7eae9757b455" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-6220154e-bd55-492f-8985-ed5c5d9c76a2 tempest-ProjectMemberTests-1640873908 None] Deleting offline snapshot 4f360af5-b5de-4c9f-950d-7eae9757b455 of volume 6faa54d9-5f9d-41bb-b9e0-0f09536f2446 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-6220154e-bd55-492f-8985-ed5c5d9c76a2 tempest-ProjectMemberTests-1640873908 None] snapshot_file for this snap is: volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446.4f360af5-b5de-4c9f-950d-7eae9757b455 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fc03ae-130e-4a27-bab9-7416afc26272]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6220154e-bd55-492f-8985-ed5c5d9c76a2 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446.4f360af5-b5de-4c9f-950d-7eae9757b455 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-45596ad0-d0b0-4328-a556-f739481792ca tempest-ProjectReaderTests-329876153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-45596ad0-d0b0-4328-a556-f739481792ca tempest-ProjectReaderTests-329876153 None] Flow 'volume_create_manager' (6d59f7fd-3037-4bf7-8f9c-80f0fac1dd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-45596ad0-d0b0-4328-a556-f739481792ca tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0c50282-e2f3-4b69-849b-4ab536eef52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-45596ad0-d0b0-4328-a556-f739481792ca tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0c50282-e2f3-4b69-849b-4ab536eef52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1497808786',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91dee85d-4720-48d2-86ee-0ccdb8e7b2d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bbc2c4029f146e685644b03e00966bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:27:05Z,use_quota=True,user_id='b5aa2d370b9d459e80cb4a5d3a29e22d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-45596ad0-d0b0-4328-a556-f739481792ca tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22dd92a2-9c2d-4bfc-aa19-79199b9ab783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-45596ad0-d0b0-4328-a556-f739481792ca tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22dd92a2-9c2d-4bfc-aa19-79199b9ab783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-45596ad0-d0b0-4328-a556-f739481792ca tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5aa4bf2-6fc6-4226-a601-6dcb63fb8581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-45596ad0-d0b0-4328-a556-f739481792ca tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5aa4bf2-6fc6-4226-a601-6dcb63fb8581) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91dee85d-4720-48d2-86ee-0ccdb8e7b2d3', 'volume_name': 'volume-91dee85d-4720-48d2-86ee-0ccdb8e7b2d3', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:04 devstack sudo[105280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446.4f360af5-b5de-4c9f-950d-7eae9757b455
Nov 05 19:27:04 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-45596ad0-d0b0-4328-a556-f739481792ca tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64ee662b-8696-4c2c-942c-23bae8f18f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-45596ad0-d0b0-4328-a556-f739481792ca tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64ee662b-8696-4c2c-942c-23bae8f18f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-45596ad0-d0b0-4328-a556-f739481792ca tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6490210-75cb-4a23-a595-9141bd87ec16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:04 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-45596ad0-d0b0-4328-a556-f739481792ca tempest-ProjectReaderTests-329876153 None] Volume 91dee85d-4720-48d2-86ee-0ccdb8e7b2d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91dee85d-4720-48d2-86ee-0ccdb8e7b2d3', 'volume_size': 1}
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-45596ad0-d0b0-4328-a556-f739481792ca tempest-ProjectReaderTests-329876153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:04 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4786f361-6357-46d7-8089-1ef416a46434 tempest-CreateVolumesFromSnapshotTest-1238074279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8baed7bd-e000-42ce-bb9b-9303d42b359e 1073741824" returned: 0 in 0.529s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:04 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4786f361-6357-46d7-8089-1ef416a46434 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8baed7bd-e000-42ce-bb9b-9303d42b359e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:04 devstack sudo[105283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8baed7bd-e000-42ce-bb9b-9303d42b359e
Nov 05 19:27:04 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:05 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6220154e-bd55-492f-8985-ed5c5d9c76a2 tempest-ProjectMemberTests-1640873908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446.4f360af5-b5de-4c9f-950d-7eae9757b455" returned: 0 in 0.383s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-6220154e-bd55-492f-8985-ed5c5d9c76a2 tempest-ProjectMemberTests-1640873908 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a195ba41-6de8-4cd9-b923-11c3001acc9e]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6220154e-bd55-492f-8985-ed5c5d9c76a2 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:05 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4786f361-6357-46d7-8089-1ef416a46434 tempest-CreateVolumesFromSnapshotTest-1238074279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8baed7bd-e000-42ce-bb9b-9303d42b359e" returned: 0 in 0.267s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4786f361-6357-46d7-8089-1ef416a46434 tempest-CreateVolumesFromSnapshotTest-1238074279 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4786f361-6357-46d7-8089-1ef416a46434 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-945eef4a-225c-418e-b92d-73d1ee41a66d tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.794s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-945eef4a-225c-418e-b92d-73d1ee41a66d tempest-CreateVolumesFromSnapshotTest-1238074279 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-435474004',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86f6b6c9-b97e-4541-9b91-1007a0c96ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b82478cdada942f691a7114855f04aac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:27:00Z,use_quota=True,user_id='08e50ab150594947bc985f42abcfa7c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-945eef4a-225c-418e-b92d-73d1ee41a66d tempest-CreateVolumesFromSnapshotTest-1238074279 None] Creating volume 86f6b6c9-b97e-4541-9b91-1007a0c96ceb {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-945eef4a-225c-418e-b92d-73d1ee41a66d tempest-CreateVolumesFromSnapshotTest-1238074279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-945eef4a-225c-418e-b92d-73d1ee41a66d tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-945eef4a-225c-418e-b92d-73d1ee41a66d tempest-CreateVolumesFromSnapshotTest-1238074279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-945eef4a-225c-418e-b92d-73d1ee41a66d tempest-CreateVolumesFromSnapshotTest-1238074279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-945eef4a-225c-418e-b92d-73d1ee41a66d tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-945eef4a-225c-418e-b92d-73d1ee41a66d tempest-CreateVolumesFromSnapshotTest-1238074279 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:27:05 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-945eef4a-225c-418e-b92d-73d1ee41a66d tempest-CreateVolumesFromSnapshotTest-1238074279 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-945eef4a-225c-418e-b92d-73d1ee41a66d tempest-CreateVolumesFromSnapshotTest-1238074279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-86f6b6c9-b97e-4541-9b91-1007a0c96ceb 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4786f361-6357-46d7-8089-1ef416a46434 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efa96407-c877-47b5-81d2-4546ff2b2187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8baed7bd-e000-42ce-bb9b-9303d42b359e', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:05 devstack sudo[105288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446
Nov 05 19:27:05 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:05 devstack sudo[105290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-86f6b6c9-b97e-4541-9b91-1007a0c96ceb 1073741824
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4786f361-6357-46d7-8089-1ef416a46434 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73b42b8d-7270-4957-a3a0-6aeae31929f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:05 devstack sudo[105290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:05 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-4786f361-6357-46d7-8089-1ef416a46434 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Volume volume-8baed7bd-e000-42ce-bb9b-9303d42b359e (8baed7bd-e000-42ce-bb9b-9303d42b359e): created successfully
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4786f361-6357-46d7-8089-1ef416a46434 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73b42b8d-7270-4957-a3a0-6aeae31929f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-4786f361-6357-46d7-8089-1ef416a46434 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Flow 'volume_create_manager' (dace10d5-3a5c-4f0e-9b65-5be6369b3e30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:27:05 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-4786f361-6357-46d7-8089-1ef416a46434 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Created volume successfully.
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:05 devstack sudo[105294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:27:05 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:05 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6220154e-bd55-492f-8985-ed5c5d9c76a2 tempest-ProjectMemberTests-1640873908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446" returned: 0 in 0.387s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6220154e-bd55-492f-8985-ed5c5d9c76a2 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446.4f360af5-b5de-4c9f-950d-7eae9757b455 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:05 devstack sudo[105301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446.4f360af5-b5de-4c9f-950d-7eae9757b455
Nov 05 19:27:05 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:05 devstack sudo[105290]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-945eef4a-225c-418e-b92d-73d1ee41a66d tempest-CreateVolumesFromSnapshotTest-1238074279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-86f6b6c9-b97e-4541-9b91-1007a0c96ceb 1073741824" returned: 0 in 0.469s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:05 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.287s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread count: 28 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread info: [<_MainThread(MainThread, started 126882883072128)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126882770872512)>, <Thread(Thread-3 (stat_writer), started daemon 126882769837376)>, <Thread(Rabbit-heartbeat, started daemon 126882768896256)>, <Thread(Thread-5 (_runner), started daemon 126882768980928)>, <Thread(Thread-7 (_runner), started daemon 126882767016448)>, <Thread(fd_logger, started daemon 126882764561216)>, <Thread(privsep_reader, started daemon 126882764568576)>, <Thread(tpool_thread_0, started daemon 126882759292608)>, <Thread(tpool_thread_1, started daemon 126882750899904)>, <Thread(tpool_thread_2, started daemon 126882742507200)>, <Thread(tpool_thread_3, started daemon 126882734114496)>, <Thread(tpool_thread_4, started daemon 126882725721792)>, <Thread(tpool_thread_5, started daemon 126882717329088)>, <Thread(tpool_thread_6, started daemon 126882708920000)>, <Thread(tpool_thread_7, started daemon 126882700510912)>, <Thread(tpool_thread_8, started daemon 126882692101824)>, <Thread(tpool_thread_9, started daemon 126882683692736)>, <Thread(tpool_thread_10, started daemon 126882675283648)>, <Thread(tpool_thread_11, started daemon 126882666874560)>, <Thread(tpool_thread_12, started daemon 126882658465472)>, <Thread(tpool_thread_13, started daemon 126882650056384)>, <Thread(tpool_thread_14, started daemon 126882641647296)>, <Thread(tpool_thread_15, started daemon 126882633238208)>, <Thread(tpool_thread_16, started daemon 126882624829120)>, <Thread(tpool_thread_17, started daemon 126882616420032)>, <Thread(tpool_thread_18, started daemon 126882608010944)>, <Thread(tpool_thread_19, started daemon 126882599601856)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-945eef4a-225c-418e-b92d-73d1ee41a66d tempest-CreateVolumesFromSnapshotTest-1238074279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-86f6b6c9-b97e-4541-9b91-1007a0c96ceb {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:05 devstack sudo[105304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-86f6b6c9-b97e-4541-9b91-1007a0c96ceb
Nov 05 19:27:05 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:05 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6220154e-bd55-492f-8985-ed5c5d9c76a2 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446.4f360af5-b5de-4c9f-950d-7eae9757b455" returned: 0 in 0.392s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6220154e-bd55-492f-8985-ed5c5d9c76a2 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446.4f360af5-b5de-4c9f-950d-7eae9757b455 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:05 devstack sudo[105309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446.4f360af5-b5de-4c9f-950d-7eae9757b455
Nov 05 19:27:05 devstack sudo[105309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:05 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-945eef4a-225c-418e-b92d-73d1ee41a66d tempest-CreateVolumesFromSnapshotTest-1238074279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-86f6b6c9-b97e-4541-9b91-1007a0c96ceb" returned: 0 in 0.270s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-945eef4a-225c-418e-b92d-73d1ee41a66d tempest-CreateVolumesFromSnapshotTest-1238074279 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-945eef4a-225c-418e-b92d-73d1ee41a66d tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ee7f81c8-680b-4c3b-8d9e-95b39af9ec32 tempest-CinderUnicodeTest-853941933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.775s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ee7f81c8-680b-4c3b-8d9e-95b39af9ec32 tempest-CinderUnicodeTest-853941933 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:27:03Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1882821166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90866496-aafb-4fa5-b554-0b873853bee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77a82abbe104445a5792f181f123592',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:27:03Z,use_quota=True,user_id='6043491bfb11429dad3d9743cb26c526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-ee7f81c8-680b-4c3b-8d9e-95b39af9ec32 tempest-CinderUnicodeTest-853941933 None] Creating volume 90866496-aafb-4fa5-b554-0b873853bee7 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ee7f81c8-680b-4c3b-8d9e-95b39af9ec32 tempest-CinderUnicodeTest-853941933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ee7f81c8-680b-4c3b-8d9e-95b39af9ec32 tempest-CinderUnicodeTest-853941933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ee7f81c8-680b-4c3b-8d9e-95b39af9ec32 tempest-CinderUnicodeTest-853941933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ee7f81c8-680b-4c3b-8d9e-95b39af9ec32 tempest-CinderUnicodeTest-853941933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ee7f81c8-680b-4c3b-8d9e-95b39af9ec32 tempest-CinderUnicodeTest-853941933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ee7f81c8-680b-4c3b-8d9e-95b39af9ec32 tempest-CinderUnicodeTest-853941933 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:27:05 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-ee7f81c8-680b-4c3b-8d9e-95b39af9ec32 tempest-CinderUnicodeTest-853941933 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ee7f81c8-680b-4c3b-8d9e-95b39af9ec32 tempest-CinderUnicodeTest-853941933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-945eef4a-225c-418e-b92d-73d1ee41a66d tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93e7716c-ad57-4530-80ce-e520b616a9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86f6b6c9-b97e-4541-9b91-1007a0c96ceb', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:05 devstack sudo[105312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7 1073741824
Nov 05 19:27:05 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-945eef4a-225c-418e-b92d-73d1ee41a66d tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc6d7926-ad5c-4655-9bd0-2642065406a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:06 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-945eef4a-225c-418e-b92d-73d1ee41a66d tempest-CreateVolumesFromSnapshotTest-1238074279 None] Volume volume-86f6b6c9-b97e-4541-9b91-1007a0c96ceb (86f6b6c9-b97e-4541-9b91-1007a0c96ceb): created successfully
Nov 05 19:27:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-945eef4a-225c-418e-b92d-73d1ee41a66d tempest-CreateVolumesFromSnapshotTest-1238074279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc6d7926-ad5c-4655-9bd0-2642065406a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-945eef4a-225c-418e-b92d-73d1ee41a66d tempest-CreateVolumesFromSnapshotTest-1238074279 None] Flow 'volume_create_manager' (3f6c0b8e-9bf0-4f78-8b77-f996320be32a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:27:06 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-945eef4a-225c-418e-b92d-73d1ee41a66d tempest-CreateVolumesFromSnapshotTest-1238074279 None] Created volume successfully.
Nov 05 19:27:06 devstack sudo[105309]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-6220154e-bd55-492f-8985-ed5c5d9c76a2 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446.4f360af5-b5de-4c9f-950d-7eae9757b455" returned: 0 in 0.278s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6220154e-bd55-492f-8985-ed5c5d9c76a2 tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-4f360af5-b5de-4c9f-950d-7eae9757b455" released by "_delete_snapshot" :: held 1.599s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6220154e-bd55-492f-8985-ed5c5d9c76a2 tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-6faa54d9-5f9d-41bb-b9e0-0f09536f2446" released by "delete_snapshot" :: held 1.634s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:06 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-6220154e-bd55-492f-8985-ed5c5d9c76a2 tempest-ProjectMemberTests-1640873908 None] Created reservations ['0dcb4179-1a07-4ceb-85e2-417e01c6a1cc', '38391bb3-fbb0-4cdc-9299-ead368a90a92', 'd8a8f9fe-79cc-4f06-89b4-30e14bbbdeb5', 'a9389746-1398-4ae4-aa79-6e9ab8f20db1'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:27:06 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-6220154e-bd55-492f-8985-ed5c5d9c76a2 tempest-ProjectMemberTests-1640873908 None] Delete snapshot completed successfully.
Nov 05 19:27:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-6220154e-bd55-492f-8985-ed5c5d9c76a2 tempest-ProjectMemberTests-1640873908 None] Lock "cinder-4f360af5-b5de-4c9f-950d-7eae9757b455-delete_snapshot" released by "delete_snapshot" :: held 1.784s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:06 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ee7f81c8-680b-4c3b-8d9e-95b39af9ec32 tempest-CinderUnicodeTest-853941933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7 1073741824" returned: 0 in 0.431s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ee7f81c8-680b-4c3b-8d9e-95b39af9ec32 tempest-CinderUnicodeTest-853941933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:06 devstack sudo[105319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7
Nov 05 19:27:06 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:06 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ee7f81c8-680b-4c3b-8d9e-95b39af9ec32 tempest-CinderUnicodeTest-853941933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7" returned: 0 in 0.257s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ee7f81c8-680b-4c3b-8d9e-95b39af9ec32 tempest-CinderUnicodeTest-853941933 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:27:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ee7f81c8-680b-4c3b-8d9e-95b39af9ec32 tempest-CinderUnicodeTest-853941933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-45596ad0-d0b0-4328-a556-f739481792ca tempest-ProjectReaderTests-329876153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.905s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-45596ad0-d0b0-4328-a556-f739481792ca tempest-ProjectReaderTests-329876153 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1497808786',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91dee85d-4720-48d2-86ee-0ccdb8e7b2d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bbc2c4029f146e685644b03e00966bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:27:05Z,use_quota=True,user_id='b5aa2d370b9d459e80cb4a5d3a29e22d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:27:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-45596ad0-d0b0-4328-a556-f739481792ca tempest-ProjectReaderTests-329876153 None] Creating volume 91dee85d-4720-48d2-86ee-0ccdb8e7b2d3 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:27:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-45596ad0-d0b0-4328-a556-f739481792ca tempest-ProjectReaderTests-329876153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-45596ad0-d0b0-4328-a556-f739481792ca tempest-ProjectReaderTests-329876153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-45596ad0-d0b0-4328-a556-f739481792ca tempest-ProjectReaderTests-329876153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:27:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-45596ad0-d0b0-4328-a556-f739481792ca tempest-ProjectReaderTests-329876153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:27:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-45596ad0-d0b0-4328-a556-f739481792ca tempest-ProjectReaderTests-329876153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:06 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-45596ad0-d0b0-4328-a556-f739481792ca tempest-ProjectReaderTests-329876153 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:27:06 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-45596ad0-d0b0-4328-a556-f739481792ca tempest-ProjectReaderTests-329876153 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:27:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45596ad0-d0b0-4328-a556-f739481792ca tempest-ProjectReaderTests-329876153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91dee85d-4720-48d2-86ee-0ccdb8e7b2d3 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d6a9ccf3-eeed-4c10-ae7b-fad93de634ae tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-6faa54d9-5f9d-41bb-b9e0-0f09536f2446-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:06 devstack sudo[105322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91dee85d-4720-48d2-86ee-0ccdb8e7b2d3 1073741824
Nov 05 19:27:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ee7f81c8-680b-4c3b-8d9e-95b39af9ec32 tempest-CinderUnicodeTest-853941933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cc2d68f-d037-43ae-846f-480d85f831ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90866496-aafb-4fa5-b554-0b873853bee7', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:06 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ee7f81c8-680b-4c3b-8d9e-95b39af9ec32 tempest-CinderUnicodeTest-853941933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bbd440a-bf6c-483b-ab2b-2085b2cfed30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d6a9ccf3-eeed-4c10-ae7b-fad93de634ae tempest-ProjectMemberTests-1640873908 None] Lock "cinder-6faa54d9-5f9d-41bb-b9e0-0f09536f2446-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:06 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-ee7f81c8-680b-4c3b-8d9e-95b39af9ec32 tempest-CinderUnicodeTest-853941933 None] Volume volume-90866496-aafb-4fa5-b554-0b873853bee7 (90866496-aafb-4fa5-b554-0b873853bee7): created successfully
Nov 05 19:27:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ee7f81c8-680b-4c3b-8d9e-95b39af9ec32 tempest-CinderUnicodeTest-853941933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bbd440a-bf6c-483b-ab2b-2085b2cfed30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:06 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ee7f81c8-680b-4c3b-8d9e-95b39af9ec32 tempest-CinderUnicodeTest-853941933 None] Flow 'volume_create_manager' (872c8519-1842-4cb8-8961-f48a7c892597) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:27:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d6a9ccf3-eeed-4c10-ae7b-fad93de634ae tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-quobyte-6faa54d9-5f9d-41bb-b9e0-0f09536f2446" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:06 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-ee7f81c8-680b-4c3b-8d9e-95b39af9ec32 tempest-CinderUnicodeTest-853941933 None] Created volume successfully.
Nov 05 19:27:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d6a9ccf3-eeed-4c10-ae7b-fad93de634ae tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-6faa54d9-5f9d-41bb-b9e0-0f09536f2446" acquired by "delete_volume" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:06 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8934fa4-7f64-4f86-8f31-cc86e6082664]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:06 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d6a9ccf3-eeed-4c10-ae7b-fad93de634ae tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c5eff39e-37dc-4f64-a32c-45ee61893019 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Acquiring lock "cinder-86f6b6c9-b97e-4541-9b91-1007a0c96ceb-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:06 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c5eff39e-37dc-4f64-a32c-45ee61893019 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "cinder-86f6b6c9-b97e-4541-9b91-1007a0c96ceb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:07 devstack sudo[105324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446
Nov 05 19:27:07 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c5eff39e-37dc-4f64-a32c-45ee61893019 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Acquiring lock "cinder-quobyte-86f6b6c9-b97e-4541-9b91-1007a0c96ceb" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c5eff39e-37dc-4f64-a32c-45ee61893019 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "cinder-quobyte-86f6b6c9-b97e-4541-9b91-1007a0c96ceb" acquired by "delete_volume" :: waited 0.023s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:07 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c598a4b2-ddd6-4967-a00c-d9279adcf028]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c5eff39e-37dc-4f64-a32c-45ee61893019 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-86f6b6c9-b97e-4541-9b91-1007a0c96ceb {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:07 devstack sudo[105329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-86f6b6c9-b97e-4541-9b91-1007a0c96ceb
Nov 05 19:27:07 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:07 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45596ad0-d0b0-4328-a556-f739481792ca tempest-ProjectReaderTests-329876153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91dee85d-4720-48d2-86ee-0ccdb8e7b2d3 1073741824" returned: 0 in 0.564s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45596ad0-d0b0-4328-a556-f739481792ca tempest-ProjectReaderTests-329876153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91dee85d-4720-48d2-86ee-0ccdb8e7b2d3 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:07 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d6a9ccf3-eeed-4c10-ae7b-fad93de634ae tempest-ProjectMemberTests-1640873908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446" returned: 0 in 0.472s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d6a9ccf3-eeed-4c10-ae7b-fad93de634ae tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:07 devstack sudo[105335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91dee85d-4720-48d2-86ee-0ccdb8e7b2d3
Nov 05 19:27:07 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:07 devstack sudo[105337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446
Nov 05 19:27:07 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-84283cf5-c55b-4d58-83ca-060863ffea65 tempest-CinderUnicodeTest-853941933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:07 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c5eff39e-37dc-4f64-a32c-45ee61893019 tempest-CreateVolumesFromSnapshotTest-1238074279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-86f6b6c9-b97e-4541-9b91-1007a0c96ceb" returned: 0 in 0.507s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c5eff39e-37dc-4f64-a32c-45ee61893019 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-86f6b6c9-b97e-4541-9b91-1007a0c96ceb {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:07 devstack sudo[105344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-86f6b6c9-b97e-4541-9b91-1007a0c96ceb
Nov 05 19:27:07 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:07 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-45596ad0-d0b0-4328-a556-f739481792ca tempest-ProjectReaderTests-329876153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91dee85d-4720-48d2-86ee-0ccdb8e7b2d3" returned: 0 in 0.322s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-45596ad0-d0b0-4328-a556-f739481792ca tempest-ProjectReaderTests-329876153 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:27:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-45596ad0-d0b0-4328-a556-f739481792ca tempest-ProjectReaderTests-329876153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-84283cf5-c55b-4d58-83ca-060863ffea65 tempest-CinderUnicodeTest-853941933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.102s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-84283cf5-c55b-4d58-83ca-060863ffea65 tempest-CinderUnicodeTest-853941933 None] Creating offline snapshot 847414c4-addf-4b65-a7ea-9fe78c06d825 of volume 90866496-aafb-4fa5-b554-0b873853bee7 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:27:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-45596ad0-d0b0-4328-a556-f739481792ca tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6490210-75cb-4a23-a595-9141bd87ec16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91dee85d-4720-48d2-86ee-0ccdb8e7b2d3', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-45596ad0-d0b0-4328-a556-f739481792ca tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a6eae89-b340-418f-9e3c-dabee21399ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:07 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d9a1a7-bf8f-4e44-adce-cab3ac064d27]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:07 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-84283cf5-c55b-4d58-83ca-060863ffea65 tempest-CinderUnicodeTest-853941933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d6a9ccf3-eeed-4c10-ae7b-fad93de634ae tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6faa54d9-5f9d-41bb-b9e0-0f09536f2446" returned: 0 in 0.350s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:07 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-45596ad0-d0b0-4328-a556-f739481792ca tempest-ProjectReaderTests-329876153 None] Volume volume-91dee85d-4720-48d2-86ee-0ccdb8e7b2d3 (91dee85d-4720-48d2-86ee-0ccdb8e7b2d3): created successfully
Nov 05 19:27:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-45596ad0-d0b0-4328-a556-f739481792ca tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a6eae89-b340-418f-9e3c-dabee21399ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-45596ad0-d0b0-4328-a556-f739481792ca tempest-ProjectReaderTests-329876153 None] Flow 'volume_create_manager' (6d59f7fd-3037-4bf7-8f9c-80f0fac1dd43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:27:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d6a9ccf3-eeed-4c10-ae7b-fad93de634ae tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-6faa54d9-5f9d-41bb-b9e0-0f09536f2446" released by "delete_volume" :: held 0.924s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:07 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-45596ad0-d0b0-4328-a556-f739481792ca tempest-ProjectReaderTests-329876153 None] Created volume successfully.
Nov 05 19:27:07 devstack sudo[105347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7
Nov 05 19:27:07 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-d6a9ccf3-eeed-4c10-ae7b-fad93de634ae tempest-ProjectMemberTests-1640873908 None] Created reservations ['68b5a60c-7687-4153-a6bc-03e240e78eb1', '1ff61205-74d5-4776-ac61-857e684a01f8', 'f01b140e-3f30-4ed2-b8e8-a1f87ef7117f', 'e4268b9d-344f-4eaa-84cf-c3a0bb345ec7'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:27:07 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d6a9ccf3-eeed-4c10-ae7b-fad93de634ae tempest-ProjectMemberTests-1640873908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d6a9ccf3-eeed-4c10-ae7b-fad93de634ae tempest-ProjectMemberTests-1640873908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d6a9ccf3-eeed-4c10-ae7b-fad93de634ae tempest-ProjectMemberTests-1640873908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:27:07 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-d6a9ccf3-eeed-4c10-ae7b-fad93de634ae tempest-ProjectMemberTests-1640873908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:27:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-d6a9ccf3-eeed-4c10-ae7b-fad93de634ae tempest-ProjectMemberTests-1640873908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d6a9ccf3-eeed-4c10-ae7b-fad93de634ae tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c5eff39e-37dc-4f64-a32c-45ee61893019 tempest-CreateVolumesFromSnapshotTest-1238074279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-86f6b6c9-b97e-4541-9b91-1007a0c96ceb" returned: 0 in 0.334s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c5eff39e-37dc-4f64-a32c-45ee61893019 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "cinder-quobyte-86f6b6c9-b97e-4541-9b91-1007a0c96ceb" released by "delete_volume" :: held 0.887s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:07 devstack sudo[105350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:27:07 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:07 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-c5eff39e-37dc-4f64-a32c-45ee61893019 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Created reservations ['99ce4e0d-fe6b-43d3-a573-25ba0b0f1c33', '5e86430d-8f8b-490a-b6f9-546e13a5ab4a', 'df981568-da12-4ac4-b811-66586f9ee47f', 'ad3e084e-2436-4c83-b3f8-0bf3763dd26e'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:27:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c5eff39e-37dc-4f64-a32c-45ee61893019 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c5eff39e-37dc-4f64-a32c-45ee61893019 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c5eff39e-37dc-4f64-a32c-45ee61893019 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:27:08 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c5eff39e-37dc-4f64-a32c-45ee61893019 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:27:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c5eff39e-37dc-4f64-a32c-45ee61893019 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c5eff39e-37dc-4f64-a32c-45ee61893019 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:08 devstack sudo[105355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:27:08 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:08 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-84283cf5-c55b-4d58-83ca-060863ffea65 tempest-CinderUnicodeTest-853941933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7" returned: 0 in 0.477s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-84283cf5-c55b-4d58-83ca-060863ffea65 tempest-CinderUnicodeTest-853941933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7.847414c4-addf-4b65-a7ea-9fe78c06d825 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:08 devstack sudo[105357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7.847414c4-addf-4b65-a7ea-9fe78c06d825 1G
Nov 05 19:27:08 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9e4351ab-386e-429d-bcd6-ec6aa3acc3af tempest-CreateVolumesFromSnapshotTest-1238074279 None] Acquiring lock "cinder-8baed7bd-e000-42ce-bb9b-9303d42b359e-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5d0127e9-f80a-4329-b0ac-793440b458ae tempest-ProjectReaderTests-329876153 None] Acquiring lock "cinder-91dee85d-4720-48d2-86ee-0ccdb8e7b2d3-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:08 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9e4351ab-386e-429d-bcd6-ec6aa3acc3af tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "cinder-8baed7bd-e000-42ce-bb9b-9303d42b359e-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5d0127e9-f80a-4329-b0ac-793440b458ae tempest-ProjectReaderTests-329876153 None] Lock "cinder-91dee85d-4720-48d2-86ee-0ccdb8e7b2d3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d6a9ccf3-eeed-4c10-ae7b-fad93de634ae tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.418s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:08 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-d6a9ccf3-eeed-4c10-ae7b-fad93de634ae tempest-ProjectMemberTests-1640873908 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:27:08 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-d6a9ccf3-eeed-4c10-ae7b-fad93de634ae tempest-ProjectMemberTests-1640873908 None] Deleted volume successfully.
Nov 05 19:27:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9e4351ab-386e-429d-bcd6-ec6aa3acc3af tempest-CreateVolumesFromSnapshotTest-1238074279 None] Acquiring lock "cinder-quobyte-8baed7bd-e000-42ce-bb9b-9303d42b359e" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5d0127e9-f80a-4329-b0ac-793440b458ae tempest-ProjectReaderTests-329876153 None] Acquiring lock "cinder-quobyte-91dee85d-4720-48d2-86ee-0ccdb8e7b2d3" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d6a9ccf3-eeed-4c10-ae7b-fad93de634ae tempest-ProjectMemberTests-1640873908 None] Lock "cinder-6faa54d9-5f9d-41bb-b9e0-0f09536f2446-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9e4351ab-386e-429d-bcd6-ec6aa3acc3af tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "cinder-quobyte-8baed7bd-e000-42ce-bb9b-9303d42b359e" acquired by "delete_volume" :: waited 0.032s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5d0127e9-f80a-4329-b0ac-793440b458ae tempest-ProjectReaderTests-329876153 None] Lock "cinder-quobyte-91dee85d-4720-48d2-86ee-0ccdb8e7b2d3" acquired by "delete_volume" :: waited 0.032s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:08 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad72101-7c07-48d1-b140-852a9863f0ee]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9e4351ab-386e-429d-bcd6-ec6aa3acc3af tempest-CreateVolumesFromSnapshotTest-1238074279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8baed7bd-e000-42ce-bb9b-9303d42b359e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:08 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c5eff39e-37dc-4f64-a32c-45ee61893019 tempest-CreateVolumesFromSnapshotTest-1238074279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.353s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:08 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-c5eff39e-37dc-4f64-a32c-45ee61893019 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:27:08 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1651c9f-c375-473d-b442-9836b586b6b3]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5d0127e9-f80a-4329-b0ac-793440b458ae tempest-ProjectReaderTests-329876153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91dee85d-4720-48d2-86ee-0ccdb8e7b2d3 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:08 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-c5eff39e-37dc-4f64-a32c-45ee61893019 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Deleted volume successfully.
Nov 05 19:27:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c5eff39e-37dc-4f64-a32c-45ee61893019 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "cinder-86f6b6c9-b97e-4541-9b91-1007a0c96ceb-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:08 devstack sudo[105361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8baed7bd-e000-42ce-bb9b-9303d42b359e
Nov 05 19:27:08 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:08 devstack sudo[105362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91dee85d-4720-48d2-86ee-0ccdb8e7b2d3
Nov 05 19:27:08 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:08 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-84283cf5-c55b-4d58-83ca-060863ffea65 tempest-CinderUnicodeTest-853941933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7.847414c4-addf-4b65-a7ea-9fe78c06d825 1G" returned: 0 in 0.548s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-84283cf5-c55b-4d58-83ca-060863ffea65 tempest-CinderUnicodeTest-853941933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90866496-aafb-4fa5-b554-0b873853bee7 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7.847414c4-addf-4b65-a7ea-9fe78c06d825 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:08 devstack sudo[105369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90866496-aafb-4fa5-b554-0b873853bee7 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7.847414c4-addf-4b65-a7ea-9fe78c06d825
Nov 05 19:27:08 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:08 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9e4351ab-386e-429d-bcd6-ec6aa3acc3af tempest-CreateVolumesFromSnapshotTest-1238074279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8baed7bd-e000-42ce-bb9b-9303d42b359e" returned: 0 in 0.420s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9e4351ab-386e-429d-bcd6-ec6aa3acc3af tempest-CreateVolumesFromSnapshotTest-1238074279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8baed7bd-e000-42ce-bb9b-9303d42b359e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:08 devstack sudo[105377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8baed7bd-e000-42ce-bb9b-9303d42b359e
Nov 05 19:27:08 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:08 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5d0127e9-f80a-4329-b0ac-793440b458ae tempest-ProjectReaderTests-329876153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91dee85d-4720-48d2-86ee-0ccdb8e7b2d3" returned: 0 in 0.457s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5d0127e9-f80a-4329-b0ac-793440b458ae tempest-ProjectReaderTests-329876153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91dee85d-4720-48d2-86ee-0ccdb8e7b2d3 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:08 devstack sudo[105379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91dee85d-4720-48d2-86ee-0ccdb8e7b2d3
Nov 05 19:27:08 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:09 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-84283cf5-c55b-4d58-83ca-060863ffea65 tempest-CinderUnicodeTest-853941933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90866496-aafb-4fa5-b554-0b873853bee7 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7.847414c4-addf-4b65-a7ea-9fe78c06d825" returned: 0 in 0.340s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:09 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-84283cf5-c55b-4d58-83ca-060863ffea65 tempest-CinderUnicodeTest-853941933 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7.847414c4-addf-4b65-a7ea-9fe78c06d825 is being set with open permissions: ugo+rw
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-84283cf5-c55b-4d58-83ca-060863ffea65 tempest-CinderUnicodeTest-853941933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7.847414c4-addf-4b65-a7ea-9fe78c06d825 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:09 devstack sudo[105386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7.847414c4-addf-4b65-a7ea-9fe78c06d825
Nov 05 19:27:09 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:09 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9e4351ab-386e-429d-bcd6-ec6aa3acc3af tempest-CreateVolumesFromSnapshotTest-1238074279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8baed7bd-e000-42ce-bb9b-9303d42b359e" returned: 0 in 0.275s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9e4351ab-386e-429d-bcd6-ec6aa3acc3af tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "cinder-quobyte-8baed7bd-e000-42ce-bb9b-9303d42b359e" released by "delete_volume" :: held 0.748s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-9e4351ab-386e-429d-bcd6-ec6aa3acc3af tempest-CreateVolumesFromSnapshotTest-1238074279 None] Created reservations ['7ee5220b-4a07-4866-bc01-eac8bac56bba', '109a097e-b4e4-4aaa-b927-e38411803beb', 'c3e3d419-360f-4a40-8caa-1f5e7cf5bedf', '266f5f5f-48f1-44da-b04e-e46fd45409e8'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:27:09 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5d0127e9-f80a-4329-b0ac-793440b458ae tempest-ProjectReaderTests-329876153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-91dee85d-4720-48d2-86ee-0ccdb8e7b2d3" returned: 0 in 0.315s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5d0127e9-f80a-4329-b0ac-793440b458ae tempest-ProjectReaderTests-329876153 None] Lock "cinder-quobyte-91dee85d-4720-48d2-86ee-0ccdb8e7b2d3" released by "delete_volume" :: held 0.838s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-5d0127e9-f80a-4329-b0ac-793440b458ae tempest-ProjectReaderTests-329876153 None] Created reservations ['ec3e46b5-25c8-41bb-8baf-812d394a1b6f', '08dac87e-3e1f-45f8-99c9-f8c87ba1fd12', 'e1af328f-66bc-4c8c-bd7c-a205545abb36', '7394d0fb-5fac-4f15-988b-588d745455e8'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:27:09 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-84283cf5-c55b-4d58-83ca-060863ffea65 tempest-CinderUnicodeTest-853941933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7.847414c4-addf-4b65-a7ea-9fe78c06d825" returned: 0 in 0.326s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-591564e4-5a6d-4e83-821a-682d93f2dfb7 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Acquiring lock "cinder-fb6a1821-b70e-41d0-ab52-6ad47e433922-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9e4351ab-386e-429d-bcd6-ec6aa3acc3af tempest-CreateVolumesFromSnapshotTest-1238074279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9e4351ab-386e-429d-bcd6-ec6aa3acc3af tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9e4351ab-386e-429d-bcd6-ec6aa3acc3af tempest-CreateVolumesFromSnapshotTest-1238074279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9e4351ab-386e-429d-bcd6-ec6aa3acc3af tempest-CreateVolumesFromSnapshotTest-1238074279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9e4351ab-386e-429d-bcd6-ec6aa3acc3af tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9e4351ab-386e-429d-bcd6-ec6aa3acc3af tempest-CreateVolumesFromSnapshotTest-1238074279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-591564e4-5a6d-4e83-821a-682d93f2dfb7 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "cinder-fb6a1821-b70e-41d0-ab52-6ad47e433922-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-84283cf5-c55b-4d58-83ca-060863ffea65 tempest-CinderUnicodeTest-853941933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:09 devstack sudo[105391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:27:09 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:09 devstack sudo[105392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7.info
Nov 05 19:27:09 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-591564e4-5a6d-4e83-821a-682d93f2dfb7 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Acquiring lock "cinder-quobyte-fb6a1821-b70e-41d0-ab52-6ad47e433922" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5d0127e9-f80a-4329-b0ac-793440b458ae tempest-ProjectReaderTests-329876153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5d0127e9-f80a-4329-b0ac-793440b458ae tempest-ProjectReaderTests-329876153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5d0127e9-f80a-4329-b0ac-793440b458ae tempest-ProjectReaderTests-329876153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5d0127e9-f80a-4329-b0ac-793440b458ae tempest-ProjectReaderTests-329876153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5d0127e9-f80a-4329-b0ac-793440b458ae tempest-ProjectReaderTests-329876153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5d0127e9-f80a-4329-b0ac-793440b458ae tempest-ProjectReaderTests-329876153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-591564e4-5a6d-4e83-821a-682d93f2dfb7 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "cinder-quobyte-fb6a1821-b70e-41d0-ab52-6ad47e433922" acquired by "delete_volume" :: waited 0.067s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:09 devstack sudo[105395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:27:09 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8da06f9-a52e-42df-a455-0d946a3f6820 tempest-ProjectMemberTests-1640873908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b8da06f9-a52e-42df-a455-0d946a3f6820 tempest-ProjectMemberTests-1640873908 None] Flow 'volume_create_manager' (08165649-75d0-4726-96ff-c8664c03f800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b8da06f9-a52e-42df-a455-0d946a3f6820 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cd9d248-42a4-4a4d-bc5f-f073c5bcb338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2202325-e249-4e35-bf9f-4f23f1385ebd]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-591564e4-5a6d-4e83-821a-682d93f2dfb7 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fb6a1821-b70e-41d0-ab52-6ad47e433922 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b8da06f9-a52e-42df-a455-0d946a3f6820 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cd9d248-42a4-4a4d-bc5f-f073c5bcb338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1120746642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62614177-aeea-4770-87bd-99104ba47095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d5b238d03346c2b35a48086a4ecc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:27:10Z,use_quota=True,user_id='9c94d9844c6446c58716ae4b34ced8c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b8da06f9-a52e-42df-a455-0d946a3f6820 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1cf1cb7-1457-4d57-969d-14911fd946b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b8da06f9-a52e-42df-a455-0d946a3f6820 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1cf1cb7-1457-4d57-969d-14911fd946b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b8da06f9-a52e-42df-a455-0d946a3f6820 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ecd29a-2acf-48a5-a9bc-30cf0876109d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b8da06f9-a52e-42df-a455-0d946a3f6820 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ecd29a-2acf-48a5-a9bc-30cf0876109d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62614177-aeea-4770-87bd-99104ba47095', 'volume_name': 'volume-62614177-aeea-4770-87bd-99104ba47095', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b8da06f9-a52e-42df-a455-0d946a3f6820 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05d21016-8ac1-4dea-8459-6f60e869c026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b8da06f9-a52e-42df-a455-0d946a3f6820 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05d21016-8ac1-4dea-8459-6f60e869c026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b8da06f9-a52e-42df-a455-0d946a3f6820 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be1456ce-b748-4d54-8b56-a43e534e0cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:09 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-b8da06f9-a52e-42df-a455-0d946a3f6820 tempest-ProjectMemberTests-1640873908 None] Volume 62614177-aeea-4770-87bd-99104ba47095: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62614177-aeea-4770-87bd-99104ba47095', 'volume_size': 1}
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b8da06f9-a52e-42df-a455-0d946a3f6820 tempest-ProjectMemberTests-1640873908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:09 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9e4351ab-386e-429d-bcd6-ec6aa3acc3af tempest-CreateVolumesFromSnapshotTest-1238074279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.393s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-9e4351ab-386e-429d-bcd6-ec6aa3acc3af tempest-CreateVolumesFromSnapshotTest-1238074279 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:27:09 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-9e4351ab-386e-429d-bcd6-ec6aa3acc3af tempest-CreateVolumesFromSnapshotTest-1238074279 None] Deleted volume successfully.
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9e4351ab-386e-429d-bcd6-ec6aa3acc3af tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "cinder-8baed7bd-e000-42ce-bb9b-9303d42b359e-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:09 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:09 devstack sudo[105397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fb6a1821-b70e-41d0-ab52-6ad47e433922
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-84283cf5-c55b-4d58-83ca-060863ffea65 tempest-CinderUnicodeTest-853941933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7.info" returned: 0 in 0.456s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:09 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-84283cf5-c55b-4d58-83ca-060863ffea65 tempest-CinderUnicodeTest-853941933 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7.info is being set with open permissions: ugo+rw
Nov 05 19:27:09 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-84283cf5-c55b-4d58-83ca-060863ffea65 tempest-CinderUnicodeTest-853941933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:09 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5d0127e9-f80a-4329-b0ac-793440b458ae tempest-ProjectReaderTests-329876153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.357s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:09 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-5d0127e9-f80a-4329-b0ac-793440b458ae tempest-ProjectReaderTests-329876153 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:27:09 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-5d0127e9-f80a-4329-b0ac-793440b458ae tempest-ProjectReaderTests-329876153 None] Deleted volume successfully.
Nov 05 19:27:10 devstack sudo[105402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7.info
Nov 05 19:27:10 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5d0127e9-f80a-4329-b0ac-793440b458ae tempest-ProjectReaderTests-329876153 None] Lock "cinder-91dee85d-4720-48d2-86ee-0ccdb8e7b2d3-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd07e4dd-4dac-4ef1-8b69-7f35e4b0bad8 tempest-ProjectReaderTests-329876153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bd07e4dd-4dac-4ef1-8b69-7f35e4b0bad8 tempest-ProjectReaderTests-329876153 None] Flow 'volume_create_manager' (c1b8dddf-a069-4e1d-b694-59e108f906f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bd07e4dd-4dac-4ef1-8b69-7f35e4b0bad8 tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef89c29c-accd-477a-83d1-087a347979c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:10 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-84283cf5-c55b-4d58-83ca-060863ffea65 tempest-CinderUnicodeTest-853941933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7.info" returned: 0 in 0.304s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:10 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-84283cf5-c55b-4d58-83ca-060863ffea65 tempest-CinderUnicodeTest-853941933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.640s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b8da06f9-a52e-42df-a455-0d946a3f6820 tempest-ProjectMemberTests-1640873908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.453s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b8da06f9-a52e-42df-a455-0d946a3f6820 tempest-ProjectMemberTests-1640873908 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1120746642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62614177-aeea-4770-87bd-99104ba47095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d5b238d03346c2b35a48086a4ecc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:27:10Z,use_quota=True,user_id='9c94d9844c6446c58716ae4b34ced8c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-b8da06f9-a52e-42df-a455-0d946a3f6820 tempest-ProjectMemberTests-1640873908 None] Creating volume 62614177-aeea-4770-87bd-99104ba47095 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b8da06f9-a52e-42df-a455-0d946a3f6820 tempest-ProjectMemberTests-1640873908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b8da06f9-a52e-42df-a455-0d946a3f6820 tempest-ProjectMemberTests-1640873908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b8da06f9-a52e-42df-a455-0d946a3f6820 tempest-ProjectMemberTests-1640873908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b8da06f9-a52e-42df-a455-0d946a3f6820 tempest-ProjectMemberTests-1640873908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b8da06f9-a52e-42df-a455-0d946a3f6820 tempest-ProjectMemberTests-1640873908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b8da06f9-a52e-42df-a455-0d946a3f6820 tempest-ProjectMemberTests-1640873908 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:27:10 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-b8da06f9-a52e-42df-a455-0d946a3f6820 tempest-ProjectMemberTests-1640873908 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b8da06f9-a52e-42df-a455-0d946a3f6820 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bd07e4dd-4dac-4ef1-8b69-7f35e4b0bad8 tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef89c29c-accd-477a-83d1-087a347979c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1457409157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2214d4c-49e0-4eab-bbb3-03388e03f436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bbc2c4029f146e685644b03e00966bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:27:10Z,use_quota=True,user_id='b5aa2d370b9d459e80cb4a5d3a29e22d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bd07e4dd-4dac-4ef1-8b69-7f35e4b0bad8 tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b1ae99c-80e6-4e6c-b9a1-a1b9eb98be5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:10 devstack sudo[105409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095 1073741824
Nov 05 19:27:10 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bd07e4dd-4dac-4ef1-8b69-7f35e4b0bad8 tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b1ae99c-80e6-4e6c-b9a1-a1b9eb98be5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bd07e4dd-4dac-4ef1-8b69-7f35e4b0bad8 tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6b76cae-e927-4a17-83ed-49504083ba75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bd07e4dd-4dac-4ef1-8b69-7f35e4b0bad8 tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6b76cae-e927-4a17-83ed-49504083ba75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2214d4c-49e0-4eab-bbb3-03388e03f436', 'volume_name': 'volume-b2214d4c-49e0-4eab-bbb3-03388e03f436', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bd07e4dd-4dac-4ef1-8b69-7f35e4b0bad8 tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6470de0d-3364-4543-980c-be88c61026dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bd07e4dd-4dac-4ef1-8b69-7f35e4b0bad8 tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6470de0d-3364-4543-980c-be88c61026dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bd07e4dd-4dac-4ef1-8b69-7f35e4b0bad8 tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc222019-d0e7-406a-86e0-d50a4795c923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:10 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-bd07e4dd-4dac-4ef1-8b69-7f35e4b0bad8 tempest-ProjectReaderTests-329876153 None] Volume b2214d4c-49e0-4eab-bbb3-03388e03f436: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2214d4c-49e0-4eab-bbb3-03388e03f436', 'volume_size': 1}
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bd07e4dd-4dac-4ef1-8b69-7f35e4b0bad8 tempest-ProjectReaderTests-329876153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-591564e4-5a6d-4e83-821a-682d93f2dfb7 tempest-CreateVolumesFromSnapshotTest-1238074279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fb6a1821-b70e-41d0-ab52-6ad47e433922" returned: 0 in 0.619s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-591564e4-5a6d-4e83-821a-682d93f2dfb7 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fb6a1821-b70e-41d0-ab52-6ad47e433922 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:10 devstack sudo[105411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fb6a1821-b70e-41d0-ab52-6ad47e433922
Nov 05 19:27:10 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:10 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-84283cf5-c55b-4d58-83ca-060863ffea65 tempest-CinderUnicodeTest-853941933 None] Create snapshot completed successfully
Nov 05 19:27:10 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-591564e4-5a6d-4e83-821a-682d93f2dfb7 tempest-CreateVolumesFromSnapshotTest-1238074279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-fb6a1821-b70e-41d0-ab52-6ad47e433922" returned: 0 in 0.254s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-591564e4-5a6d-4e83-821a-682d93f2dfb7 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "cinder-quobyte-fb6a1821-b70e-41d0-ab52-6ad47e433922" released by "delete_volume" :: held 0.959s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-591564e4-5a6d-4e83-821a-682d93f2dfb7 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Created reservations ['2832b2cc-bc0a-403c-b2b3-73277d4183fc', 'c74dd975-6c14-4a2c-ab76-c0975dd71f42', '009c6556-448d-4f5f-bac8-19fc140e9730', '239fe3c5-bc16-43ae-b4b3-6f4b5e4f1498'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-591564e4-5a6d-4e83-821a-682d93f2dfb7 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-591564e4-5a6d-4e83-821a-682d93f2dfb7 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-591564e4-5a6d-4e83-821a-682d93f2dfb7 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-591564e4-5a6d-4e83-821a-682d93f2dfb7 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-591564e4-5a6d-4e83-821a-682d93f2dfb7 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-591564e4-5a6d-4e83-821a-682d93f2dfb7 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d7cdd15f-d680-4284-9097-c4ec9af9eaed tempest-CinderUnicodeTest-853941933 None] Acquiring lock "cinder-847414c4-addf-4b65-a7ea-9fe78c06d825-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:10 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b8da06f9-a52e-42df-a455-0d946a3f6820 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095 1073741824" returned: 0 in 0.486s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:10 devstack sudo[105418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:27:10 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d7cdd15f-d680-4284-9097-c4ec9af9eaed tempest-CinderUnicodeTest-853941933 None] Lock "cinder-847414c4-addf-4b65-a7ea-9fe78c06d825-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d7cdd15f-d680-4284-9097-c4ec9af9eaed tempest-CinderUnicodeTest-853941933 None] Acquiring lock "cinder-quobyte-90866496-aafb-4fa5-b554-0b873853bee7" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d7cdd15f-d680-4284-9097-c4ec9af9eaed tempest-CinderUnicodeTest-853941933 None] Lock "cinder-quobyte-90866496-aafb-4fa5-b554-0b873853bee7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d7cdd15f-d680-4284-9097-c4ec9af9eaed tempest-CinderUnicodeTest-853941933 None] Acquiring lock "cinder-quobyte-847414c4-addf-4b65-a7ea-9fe78c06d825" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b8da06f9-a52e-42df-a455-0d946a3f6820 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d7cdd15f-d680-4284-9097-c4ec9af9eaed tempest-CinderUnicodeTest-853941933 None] Lock "cinder-quobyte-847414c4-addf-4b65-a7ea-9fe78c06d825" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-d7cdd15f-d680-4284-9097-c4ec9af9eaed tempest-CinderUnicodeTest-853941933 None] Deleting offline snapshot 847414c4-addf-4b65-a7ea-9fe78c06d825 of volume 90866496-aafb-4fa5-b554-0b873853bee7 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:27:10 devstack sudo[105420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095
Nov 05 19:27:10 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-d7cdd15f-d680-4284-9097-c4ec9af9eaed tempest-CinderUnicodeTest-853941933 None] snapshot_file for this snap is: volume-90866496-aafb-4fa5-b554-0b873853bee7.847414c4-addf-4b65-a7ea-9fe78c06d825 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1047d364-42f9-4682-8f28-4bb6c4d7175b]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d7cdd15f-d680-4284-9097-c4ec9af9eaed tempest-CinderUnicodeTest-853941933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7.847414c4-addf-4b65-a7ea-9fe78c06d825 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:11 devstack sudo[105422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7.847414c4-addf-4b65-a7ea-9fe78c06d825
Nov 05 19:27:11 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:11 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-591564e4-5a6d-4e83-821a-682d93f2dfb7 tempest-CreateVolumesFromSnapshotTest-1238074279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.273s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-591564e4-5a6d-4e83-821a-682d93f2dfb7 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:27:11 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-591564e4-5a6d-4e83-821a-682d93f2dfb7 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Deleted volume successfully.
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-591564e4-5a6d-4e83-821a-682d93f2dfb7 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "cinder-fb6a1821-b70e-41d0-ab52-6ad47e433922-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:11 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b8da06f9-a52e-42df-a455-0d946a3f6820 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095" returned: 0 in 0.268s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b8da06f9-a52e-42df-a455-0d946a3f6820 tempest-ProjectMemberTests-1640873908 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b8da06f9-a52e-42df-a455-0d946a3f6820 tempest-ProjectMemberTests-1640873908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bd07e4dd-4dac-4ef1-8b69-7f35e4b0bad8 tempest-ProjectReaderTests-329876153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.761s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bd07e4dd-4dac-4ef1-8b69-7f35e4b0bad8 tempest-ProjectReaderTests-329876153 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1457409157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2214d4c-49e0-4eab-bbb3-03388e03f436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bbc2c4029f146e685644b03e00966bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:27:10Z,use_quota=True,user_id='b5aa2d370b9d459e80cb4a5d3a29e22d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-bd07e4dd-4dac-4ef1-8b69-7f35e4b0bad8 tempest-ProjectReaderTests-329876153 None] Creating volume b2214d4c-49e0-4eab-bbb3-03388e03f436 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bd07e4dd-4dac-4ef1-8b69-7f35e4b0bad8 tempest-ProjectReaderTests-329876153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bd07e4dd-4dac-4ef1-8b69-7f35e4b0bad8 tempest-ProjectReaderTests-329876153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bd07e4dd-4dac-4ef1-8b69-7f35e4b0bad8 tempest-ProjectReaderTests-329876153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bd07e4dd-4dac-4ef1-8b69-7f35e4b0bad8 tempest-ProjectReaderTests-329876153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bd07e4dd-4dac-4ef1-8b69-7f35e4b0bad8 tempest-ProjectReaderTests-329876153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bd07e4dd-4dac-4ef1-8b69-7f35e4b0bad8 tempest-ProjectReaderTests-329876153 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:27:11 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-bd07e4dd-4dac-4ef1-8b69-7f35e4b0bad8 tempest-ProjectReaderTests-329876153 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bd07e4dd-4dac-4ef1-8b69-7f35e4b0bad8 tempest-ProjectReaderTests-329876153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b2214d4c-49e0-4eab-bbb3-03388e03f436 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:11 devstack sudo[105426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b2214d4c-49e0-4eab-bbb3-03388e03f436 1073741824
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b8da06f9-a52e-42df-a455-0d946a3f6820 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be1456ce-b748-4d54-8b56-a43e534e0cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62614177-aeea-4770-87bd-99104ba47095', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:11 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b8da06f9-a52e-42df-a455-0d946a3f6820 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0569c58e-5404-4d06-8d92-ed9b975f3265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:11 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-b8da06f9-a52e-42df-a455-0d946a3f6820 tempest-ProjectMemberTests-1640873908 None] Volume volume-62614177-aeea-4770-87bd-99104ba47095 (62614177-aeea-4770-87bd-99104ba47095): created successfully
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b8da06f9-a52e-42df-a455-0d946a3f6820 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0569c58e-5404-4d06-8d92-ed9b975f3265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-b8da06f9-a52e-42df-a455-0d946a3f6820 tempest-ProjectMemberTests-1640873908 None] Flow 'volume_create_manager' (08165649-75d0-4726-96ff-c8664c03f800) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:27:11 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b8da06f9-a52e-42df-a455-0d946a3f6820 tempest-ProjectMemberTests-1640873908 None] Created volume successfully.
Nov 05 19:27:11 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d7cdd15f-d680-4284-9097-c4ec9af9eaed tempest-CinderUnicodeTest-853941933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7.847414c4-addf-4b65-a7ea-9fe78c06d825" returned: 0 in 0.378s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-d7cdd15f-d680-4284-9097-c4ec9af9eaed tempest-CinderUnicodeTest-853941933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90866496-aafb-4fa5-b554-0b873853bee7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1edc183-b36c-4600-b43f-da523cfb1880]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d7cdd15f-d680-4284-9097-c4ec9af9eaed tempest-CinderUnicodeTest-853941933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:11 devstack sudo[105431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7
Nov 05 19:27:11 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:11 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bd07e4dd-4dac-4ef1-8b69-7f35e4b0bad8 tempest-ProjectReaderTests-329876153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b2214d4c-49e0-4eab-bbb3-03388e03f436 1073741824" returned: 0 in 0.444s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bd07e4dd-4dac-4ef1-8b69-7f35e4b0bad8 tempest-ProjectReaderTests-329876153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b2214d4c-49e0-4eab-bbb3-03388e03f436 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:11 devstack sudo[105439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b2214d4c-49e0-4eab-bbb3-03388e03f436
Nov 05 19:27:11 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-acb179c8-1879-49d1-ac01-493973a42eac tempest-CreateVolumesFromSnapshotTest-1238074279 None] Acquiring lock "cinder-56bbdfcf-6d48-469c-8ea0-00d13f8bdd85-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-acb179c8-1879-49d1-ac01-493973a42eac tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "cinder-56bbdfcf-6d48-469c-8ea0-00d13f8bdd85-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:11 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d7cdd15f-d680-4284-9097-c4ec9af9eaed tempest-CinderUnicodeTest-853941933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7" returned: 0 in 0.434s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d7cdd15f-d680-4284-9097-c4ec9af9eaed tempest-CinderUnicodeTest-853941933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7.847414c4-addf-4b65-a7ea-9fe78c06d825 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:11 devstack sudo[105442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7.847414c4-addf-4b65-a7ea-9fe78c06d825
Nov 05 19:27:11 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-acb179c8-1879-49d1-ac01-493973a42eac tempest-CreateVolumesFromSnapshotTest-1238074279 None] Acquiring lock "cinder-quobyte-56bbdfcf-6d48-469c-8ea0-00d13f8bdd85" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-acb179c8-1879-49d1-ac01-493973a42eac tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "cinder-quobyte-56bbdfcf-6d48-469c-8ea0-00d13f8bdd85" acquired by "delete_volume" :: waited 0.027s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7545b14-48dd-48f7-be1d-74a258be483e]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-acb179c8-1879-49d1-ac01-493973a42eac tempest-CreateVolumesFromSnapshotTest-1238074279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-56bbdfcf-6d48-469c-8ea0-00d13f8bdd85 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-edadacc7-be7d-4131-8921-75f5e3886a29 tempest-ProjectMemberTests-1640873908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:11 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-bd07e4dd-4dac-4ef1-8b69-7f35e4b0bad8 tempest-ProjectReaderTests-329876153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b2214d4c-49e0-4eab-bbb3-03388e03f436" returned: 0 in 0.317s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-bd07e4dd-4dac-4ef1-8b69-7f35e4b0bad8 tempest-ProjectReaderTests-329876153 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-bd07e4dd-4dac-4ef1-8b69-7f35e4b0bad8 tempest-ProjectReaderTests-329876153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-edadacc7-be7d-4131-8921-75f5e3886a29 tempest-ProjectMemberTests-1640873908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.041s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bd07e4dd-4dac-4ef1-8b69-7f35e4b0bad8 tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc222019-d0e7-406a-86e0-d50a4795c923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2214d4c-49e0-4eab-bbb3-03388e03f436', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bd07e4dd-4dac-4ef1-8b69-7f35e4b0bad8 tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2686fb2-f67d-4f56-b30c-87b32b7ba2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-edadacc7-be7d-4131-8921-75f5e3886a29 tempest-ProjectMemberTests-1640873908 None] Creating offline snapshot ac40356b-a7e4-4a4e-8358-abce6b3d2b02 of volume 62614177-aeea-4770-87bd-99104ba47095 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:27:11 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-bd07e4dd-4dac-4ef1-8b69-7f35e4b0bad8 tempest-ProjectReaderTests-329876153 None] Volume volume-b2214d4c-49e0-4eab-bbb3-03388e03f436 (b2214d4c-49e0-4eab-bbb3-03388e03f436): created successfully
Nov 05 19:27:11 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bd07e4dd-4dac-4ef1-8b69-7f35e4b0bad8 tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2686fb2-f67d-4f56-b30c-87b32b7ba2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:11 devstack sudo[105444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-56bbdfcf-6d48-469c-8ea0-00d13f8bdd85
Nov 05 19:27:11 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:12 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-bd07e4dd-4dac-4ef1-8b69-7f35e4b0bad8 tempest-ProjectReaderTests-329876153 None] Flow 'volume_create_manager' (c1b8dddf-a069-4e1d-b694-59e108f906f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:27:12 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[88beec22-d038-4d77-a0f8-9a5c77fede10]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:12 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-bd07e4dd-4dac-4ef1-8b69-7f35e4b0bad8 tempest-ProjectReaderTests-329876153 None] Created volume successfully.
Nov 05 19:27:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-edadacc7-be7d-4131-8921-75f5e3886a29 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:12 devstack sudo[105449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095
Nov 05 19:27:12 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:12 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d7cdd15f-d680-4284-9097-c4ec9af9eaed tempest-CinderUnicodeTest-853941933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7.847414c4-addf-4b65-a7ea-9fe78c06d825" returned: 0 in 0.413s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d7cdd15f-d680-4284-9097-c4ec9af9eaed tempest-CinderUnicodeTest-853941933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7.847414c4-addf-4b65-a7ea-9fe78c06d825 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:12 devstack sudo[105453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7.847414c4-addf-4b65-a7ea-9fe78c06d825
Nov 05 19:27:12 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:12 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-acb179c8-1879-49d1-ac01-493973a42eac tempest-CreateVolumesFromSnapshotTest-1238074279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-56bbdfcf-6d48-469c-8ea0-00d13f8bdd85" returned: 0 in 0.440s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-acb179c8-1879-49d1-ac01-493973a42eac tempest-CreateVolumesFromSnapshotTest-1238074279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-56bbdfcf-6d48-469c-8ea0-00d13f8bdd85 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:12 devstack sudo[105459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-56bbdfcf-6d48-469c-8ea0-00d13f8bdd85
Nov 05 19:27:12 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c6a9358f-c9d4-49c1-9a0d-07282366ecc6 tempest-ProjectReaderTests-329876153 None] Acquiring lock "cinder-b2214d4c-49e0-4eab-bbb3-03388e03f436-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c6a9358f-c9d4-49c1-9a0d-07282366ecc6 tempest-ProjectReaderTests-329876153 None] Lock "cinder-b2214d4c-49e0-4eab-bbb3-03388e03f436-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:12 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-d7cdd15f-d680-4284-9097-c4ec9af9eaed tempest-CinderUnicodeTest-853941933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7.847414c4-addf-4b65-a7ea-9fe78c06d825" returned: 0 in 0.275s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:12 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-edadacc7-be7d-4131-8921-75f5e3886a29 tempest-ProjectMemberTests-1640873908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095" returned: 0 in 0.471s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-edadacc7-be7d-4131-8921-75f5e3886a29 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095.ac40356b-a7e4-4a4e-8358-abce6b3d2b02 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d7cdd15f-d680-4284-9097-c4ec9af9eaed tempest-CinderUnicodeTest-853941933 None] Lock "cinder-quobyte-847414c4-addf-4b65-a7ea-9fe78c06d825" released by "_delete_snapshot" :: held 1.659s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c6a9358f-c9d4-49c1-9a0d-07282366ecc6 tempest-ProjectReaderTests-329876153 None] Acquiring lock "cinder-quobyte-b2214d4c-49e0-4eab-bbb3-03388e03f436" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d7cdd15f-d680-4284-9097-c4ec9af9eaed tempest-CinderUnicodeTest-853941933 None] Lock "cinder-quobyte-90866496-aafb-4fa5-b554-0b873853bee7" released by "delete_snapshot" :: held 1.702s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:12 devstack sudo[105465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095.ac40356b-a7e4-4a4e-8358-abce6b3d2b02 1G
Nov 05 19:27:12 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c6a9358f-c9d4-49c1-9a0d-07282366ecc6 tempest-ProjectReaderTests-329876153 None] Lock "cinder-quobyte-b2214d4c-49e0-4eab-bbb3-03388e03f436" acquired by "delete_volume" :: waited 0.023s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:12 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc031fc-0007-4cbe-88fb-3ecd73e023b3]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c6a9358f-c9d4-49c1-9a0d-07282366ecc6 tempest-ProjectReaderTests-329876153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b2214d4c-49e0-4eab-bbb3-03388e03f436 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:12 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-d7cdd15f-d680-4284-9097-c4ec9af9eaed tempest-CinderUnicodeTest-853941933 None] Created reservations ['8348baa7-47cd-4122-929e-fc00ef3802b3', '735ece96-10e3-4024-82dd-a10c38f2d49e', '0fccdbbc-a186-4963-a08f-29b0d9fe3f51', 'fe30ed4d-11d3-492f-a951-ab467ab82b3e'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:27:12 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-acb179c8-1879-49d1-ac01-493973a42eac tempest-CreateVolumesFromSnapshotTest-1238074279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-56bbdfcf-6d48-469c-8ea0-00d13f8bdd85" returned: 0 in 0.340s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-acb179c8-1879-49d1-ac01-493973a42eac tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "cinder-quobyte-56bbdfcf-6d48-469c-8ea0-00d13f8bdd85" released by "delete_volume" :: held 0.843s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:12 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-d7cdd15f-d680-4284-9097-c4ec9af9eaed tempest-CinderUnicodeTest-853941933 None] Delete snapshot completed successfully.
Nov 05 19:27:12 devstack sudo[105467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b2214d4c-49e0-4eab-bbb3-03388e03f436
Nov 05 19:27:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-d7cdd15f-d680-4284-9097-c4ec9af9eaed tempest-CinderUnicodeTest-853941933 None] Lock "cinder-847414c4-addf-4b65-a7ea-9fe78c06d825-delete_snapshot" released by "delete_snapshot" :: held 1.914s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:12 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:12 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-acb179c8-1879-49d1-ac01-493973a42eac tempest-CreateVolumesFromSnapshotTest-1238074279 None] Created reservations ['37ee4fee-d8c3-4912-a6fc-950260318d33', '313fcc64-2af1-498c-bceb-46d18afecd77', '2ba61ab6-893c-4ef7-b776-7452ff4af0f0', '0714254f-320c-4632-8ed8-cb0cc29c1c6c'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:27:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-acb179c8-1879-49d1-ac01-493973a42eac tempest-CreateVolumesFromSnapshotTest-1238074279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-acb179c8-1879-49d1-ac01-493973a42eac tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-acb179c8-1879-49d1-ac01-493973a42eac tempest-CreateVolumesFromSnapshotTest-1238074279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:27:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-acb179c8-1879-49d1-ac01-493973a42eac tempest-CreateVolumesFromSnapshotTest-1238074279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:27:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-acb179c8-1879-49d1-ac01-493973a42eac tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-acb179c8-1879-49d1-ac01-493973a42eac tempest-CreateVolumesFromSnapshotTest-1238074279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:12 devstack sudo[105474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:27:12 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5d779c08-4591-45e4-bcba-60a7a543f9aa tempest-CreateVolumesFromSnapshotTest-1238074279 None] Acquiring lock "cinder-e00c9e54-8531-4b97-97c5-d856b958aeb2-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5d779c08-4591-45e4-bcba-60a7a543f9aa tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "cinder-e00c9e54-8531-4b97-97c5-d856b958aeb2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:13 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5d779c08-4591-45e4-bcba-60a7a543f9aa tempest-CreateVolumesFromSnapshotTest-1238074279 None] Acquiring lock "cinder-quobyte-e00c9e54-8531-4b97-97c5-d856b958aeb2" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-edadacc7-be7d-4131-8921-75f5e3886a29 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095.ac40356b-a7e4-4a4e-8358-abce6b3d2b02 1G" returned: 0 in 0.553s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-edadacc7-be7d-4131-8921-75f5e3886a29 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62614177-aeea-4770-87bd-99104ba47095 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095.ac40356b-a7e4-4a4e-8358-abce6b3d2b02 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:13 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c014ee62-49ad-4800-9d91-004b34162e32 tempest-CinderUnicodeTest-853941933 None] Acquiring lock "cinder-90866496-aafb-4fa5-b554-0b873853bee7-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:13 devstack sudo[105480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62614177-aeea-4770-87bd-99104ba47095 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095.ac40356b-a7e4-4a4e-8358-abce6b3d2b02
Nov 05 19:27:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c6a9358f-c9d4-49c1-9a0d-07282366ecc6 tempest-ProjectReaderTests-329876153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b2214d4c-49e0-4eab-bbb3-03388e03f436" returned: 0 in 0.525s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c6a9358f-c9d4-49c1-9a0d-07282366ecc6 tempest-ProjectReaderTests-329876153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b2214d4c-49e0-4eab-bbb3-03388e03f436 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:13 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5d779c08-4591-45e4-bcba-60a7a543f9aa tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "cinder-quobyte-e00c9e54-8531-4b97-97c5-d856b958aeb2" acquired by "delete_volume" :: waited 0.086s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:13 devstack sudo[105482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b2214d4c-49e0-4eab-bbb3-03388e03f436
Nov 05 19:27:13 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c014ee62-49ad-4800-9d91-004b34162e32 tempest-CinderUnicodeTest-853941933 None] Lock "cinder-90866496-aafb-4fa5-b554-0b873853bee7-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:13 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a9cf9c-13b2-4b23-a686-238153033955]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5d779c08-4591-45e4-bcba-60a7a543f9aa tempest-CreateVolumesFromSnapshotTest-1238074279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e00c9e54-8531-4b97-97c5-d856b958aeb2 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:13 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-acb179c8-1879-49d1-ac01-493973a42eac tempest-CreateVolumesFromSnapshotTest-1238074279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.379s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:13 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-acb179c8-1879-49d1-ac01-493973a42eac tempest-CreateVolumesFromSnapshotTest-1238074279 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:27:13 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-acb179c8-1879-49d1-ac01-493973a42eac tempest-CreateVolumesFromSnapshotTest-1238074279 None] Deleted volume successfully.
Nov 05 19:27:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-acb179c8-1879-49d1-ac01-493973a42eac tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "cinder-56bbdfcf-6d48-469c-8ea0-00d13f8bdd85-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c014ee62-49ad-4800-9d91-004b34162e32 tempest-CinderUnicodeTest-853941933 None] Acquiring lock "cinder-quobyte-90866496-aafb-4fa5-b554-0b873853bee7" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c014ee62-49ad-4800-9d91-004b34162e32 tempest-CinderUnicodeTest-853941933 None] Lock "cinder-quobyte-90866496-aafb-4fa5-b554-0b873853bee7" acquired by "delete_volume" :: waited 0.014s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:13 devstack sudo[105485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e00c9e54-8531-4b97-97c5-d856b958aeb2
Nov 05 19:27:13 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:13 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c96d9c4-b2c5-47ff-997f-8748252eb674]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c014ee62-49ad-4800-9d91-004b34162e32 tempest-CinderUnicodeTest-853941933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:13 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:13 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-edadacc7-be7d-4131-8921-75f5e3886a29 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62614177-aeea-4770-87bd-99104ba47095 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095.ac40356b-a7e4-4a4e-8358-abce6b3d2b02" returned: 0 in 0.371s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:13 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-edadacc7-be7d-4131-8921-75f5e3886a29 tempest-ProjectMemberTests-1640873908 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095.ac40356b-a7e4-4a4e-8358-abce6b3d2b02 is being set with open permissions: ugo+rw
Nov 05 19:27:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-edadacc7-be7d-4131-8921-75f5e3886a29 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095.ac40356b-a7e4-4a4e-8358-abce6b3d2b02 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c6a9358f-c9d4-49c1-9a0d-07282366ecc6 tempest-ProjectReaderTests-329876153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-b2214d4c-49e0-4eab-bbb3-03388e03f436" returned: 0 in 0.341s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:13 devstack sudo[105488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7
Nov 05 19:27:13 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c6a9358f-c9d4-49c1-9a0d-07282366ecc6 tempest-ProjectReaderTests-329876153 None] Lock "cinder-quobyte-b2214d4c-49e0-4eab-bbb3-03388e03f436" released by "delete_volume" :: held 0.923s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:13 devstack sudo[105493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095.ac40356b-a7e4-4a4e-8358-abce6b3d2b02
Nov 05 19:27:13 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:13 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-c6a9358f-c9d4-49c1-9a0d-07282366ecc6 tempest-ProjectReaderTests-329876153 None] Created reservations ['d3b9e0e2-7e05-4d93-95df-2d00fdc87652', 'eeef6866-6481-449c-8602-b591e67dc045', '225d7432-6d2b-49cd-bf2c-f3300774b139', '9a7ff360-dbb7-45f4-9549-5bb1b7850cce'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:27:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c6a9358f-c9d4-49c1-9a0d-07282366ecc6 tempest-ProjectReaderTests-329876153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c6a9358f-c9d4-49c1-9a0d-07282366ecc6 tempest-ProjectReaderTests-329876153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c6a9358f-c9d4-49c1-9a0d-07282366ecc6 tempest-ProjectReaderTests-329876153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:27:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c6a9358f-c9d4-49c1-9a0d-07282366ecc6 tempest-ProjectReaderTests-329876153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:27:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c6a9358f-c9d4-49c1-9a0d-07282366ecc6 tempest-ProjectReaderTests-329876153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c6a9358f-c9d4-49c1-9a0d-07282366ecc6 tempest-ProjectReaderTests-329876153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:13 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5d779c08-4591-45e4-bcba-60a7a543f9aa tempest-CreateVolumesFromSnapshotTest-1238074279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e00c9e54-8531-4b97-97c5-d856b958aeb2" returned: 0 in 0.482s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5d779c08-4591-45e4-bcba-60a7a543f9aa tempest-CreateVolumesFromSnapshotTest-1238074279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e00c9e54-8531-4b97-97c5-d856b958aeb2 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:13 devstack sudo[105499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:27:13 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:13 devstack sudo[105500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e00c9e54-8531-4b97-97c5-d856b958aeb2
Nov 05 19:27:13 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:13 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-edadacc7-be7d-4131-8921-75f5e3886a29 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095.ac40356b-a7e4-4a4e-8358-abce6b3d2b02" returned: 0 in 0.327s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:13 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-edadacc7-be7d-4131-8921-75f5e3886a29 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c014ee62-49ad-4800-9d91-004b34162e32 tempest-CinderUnicodeTest-853941933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7" returned: 0 in 0.467s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c014ee62-49ad-4800-9d91-004b34162e32 tempest-CinderUnicodeTest-853941933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:13 devstack sudo[105507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095.info
Nov 05 19:27:13 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:13 devstack sudo[105508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7
Nov 05 19:27:13 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:13 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c6a9358f-c9d4-49c1-9a0d-07282366ecc6 tempest-ProjectReaderTests-329876153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.294s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:13 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-c6a9358f-c9d4-49c1-9a0d-07282366ecc6 tempest-ProjectReaderTests-329876153 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:27:13 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-c6a9358f-c9d4-49c1-9a0d-07282366ecc6 tempest-ProjectReaderTests-329876153 None] Deleted volume successfully.
Nov 05 19:27:13 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5d779c08-4591-45e4-bcba-60a7a543f9aa tempest-CreateVolumesFromSnapshotTest-1238074279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-e00c9e54-8531-4b97-97c5-d856b958aeb2" returned: 0 in 0.312s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c6a9358f-c9d4-49c1-9a0d-07282366ecc6 tempest-ProjectReaderTests-329876153 None] Lock "cinder-b2214d4c-49e0-4eab-bbb3-03388e03f436-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5d779c08-4591-45e4-bcba-60a7a543f9aa tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "cinder-quobyte-e00c9e54-8531-4b97-97c5-d856b958aeb2" released by "delete_volume" :: held 0.882s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:14 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-edadacc7-be7d-4131-8921-75f5e3886a29 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095.info" returned: 0 in 0.265s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:14 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-edadacc7-be7d-4131-8921-75f5e3886a29 tempest-ProjectMemberTests-1640873908 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095.info is being set with open permissions: ugo+rw
Nov 05 19:27:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-edadacc7-be7d-4131-8921-75f5e3886a29 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:14 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:14 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-5d779c08-4591-45e4-bcba-60a7a543f9aa tempest-CreateVolumesFromSnapshotTest-1238074279 None] Created reservations ['f9584a7e-a115-4953-8431-f8ac63125708', '8082f2eb-f090-4947-b916-19d195ffd4fa', 'ff1efcfa-cc8d-4783-814a-59350eaf0f74', 'a25859e1-342c-4e47-a7a2-290fca4d82ca'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:27:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c014ee62-49ad-4800-9d91-004b34162e32 tempest-CinderUnicodeTest-853941933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-90866496-aafb-4fa5-b554-0b873853bee7" returned: 0 in 0.275s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:14 devstack sudo[105515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095.info
Nov 05 19:27:14 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c014ee62-49ad-4800-9d91-004b34162e32 tempest-CinderUnicodeTest-853941933 None] Lock "cinder-quobyte-90866496-aafb-4fa5-b554-0b873853bee7" released by "delete_volume" :: held 0.847s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5d779c08-4591-45e4-bcba-60a7a543f9aa tempest-CreateVolumesFromSnapshotTest-1238074279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5d779c08-4591-45e4-bcba-60a7a543f9aa tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5d779c08-4591-45e4-bcba-60a7a543f9aa tempest-CreateVolumesFromSnapshotTest-1238074279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:27:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-5d779c08-4591-45e4-bcba-60a7a543f9aa tempest-CreateVolumesFromSnapshotTest-1238074279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:27:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-5d779c08-4591-45e4-bcba-60a7a543f9aa tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5d779c08-4591-45e4-bcba-60a7a543f9aa tempest-CreateVolumesFromSnapshotTest-1238074279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:14 devstack sudo[105517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:27:14 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:14 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-c014ee62-49ad-4800-9d91-004b34162e32 tempest-CinderUnicodeTest-853941933 None] Created reservations ['070b4c9b-cdbb-46a7-b071-fb702df62531', '967ddd66-9649-4b2d-9bb2-dac777a6c343', '4418a1aa-faa0-4177-a5a8-bdaad1b99ec6', '8cabf4fe-c981-479e-ad21-e67fd899042d'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:27:14 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-edadacc7-be7d-4131-8921-75f5e3886a29 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095.info" returned: 0 in 0.291s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-edadacc7-be7d-4131-8921-75f5e3886a29 tempest-ProjectMemberTests-1640873908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.418s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c014ee62-49ad-4800-9d91-004b34162e32 tempest-CinderUnicodeTest-853941933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c014ee62-49ad-4800-9d91-004b34162e32 tempest-CinderUnicodeTest-853941933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c014ee62-49ad-4800-9d91-004b34162e32 tempest-CinderUnicodeTest-853941933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:27:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c014ee62-49ad-4800-9d91-004b34162e32 tempest-CinderUnicodeTest-853941933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:27:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c014ee62-49ad-4800-9d91-004b34162e32 tempest-CinderUnicodeTest-853941933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c014ee62-49ad-4800-9d91-004b34162e32 tempest-CinderUnicodeTest-853941933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:14 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-edadacc7-be7d-4131-8921-75f5e3886a29 tempest-ProjectMemberTests-1640873908 None] Create snapshot completed successfully
Nov 05 19:27:14 devstack sudo[105520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:27:14 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:14 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5d779c08-4591-45e4-bcba-60a7a543f9aa tempest-CreateVolumesFromSnapshotTest-1238074279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.279s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:14 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-5d779c08-4591-45e4-bcba-60a7a543f9aa tempest-CreateVolumesFromSnapshotTest-1238074279 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:27:14 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-5d779c08-4591-45e4-bcba-60a7a543f9aa tempest-CreateVolumesFromSnapshotTest-1238074279 None] Deleted volume successfully.
Nov 05 19:27:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5d779c08-4591-45e4-bcba-60a7a543f9aa tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "cinder-e00c9e54-8531-4b97-97c5-d856b958aeb2-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:14 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c014ee62-49ad-4800-9d91-004b34162e32 tempest-CinderUnicodeTest-853941933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.273s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:14 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-c014ee62-49ad-4800-9d91-004b34162e32 tempest-CinderUnicodeTest-853941933 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:27:14 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-c014ee62-49ad-4800-9d91-004b34162e32 tempest-CinderUnicodeTest-853941933 None] Deleted volume successfully.
Nov 05 19:27:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c014ee62-49ad-4800-9d91-004b34162e32 tempest-CinderUnicodeTest-853941933 None] Lock "cinder-90866496-aafb-4fa5-b554-0b873853bee7-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-79ea1e6b-ac1b-4b9a-ab44-c585f5492e9e tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-ac40356b-a7e4-4a4e-8358-abce6b3d2b02-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-79ea1e6b-ac1b-4b9a-ab44-c585f5492e9e tempest-ProjectMemberTests-1640873908 None] Lock "cinder-ac40356b-a7e4-4a4e-8358-abce6b3d2b02-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-79ea1e6b-ac1b-4b9a-ab44-c585f5492e9e tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-quobyte-62614177-aeea-4770-87bd-99104ba47095" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-79ea1e6b-ac1b-4b9a-ab44-c585f5492e9e tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-62614177-aeea-4770-87bd-99104ba47095" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-79ea1e6b-ac1b-4b9a-ab44-c585f5492e9e tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-quobyte-ac40356b-a7e4-4a4e-8358-abce6b3d2b02" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-79ea1e6b-ac1b-4b9a-ab44-c585f5492e9e tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-ac40356b-a7e4-4a4e-8358-abce6b3d2b02" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-79ea1e6b-ac1b-4b9a-ab44-c585f5492e9e tempest-ProjectMemberTests-1640873908 None] Deleting offline snapshot ac40356b-a7e4-4a4e-8358-abce6b3d2b02 of volume 62614177-aeea-4770-87bd-99104ba47095 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-79ea1e6b-ac1b-4b9a-ab44-c585f5492e9e tempest-ProjectMemberTests-1640873908 None] snapshot_file for this snap is: volume-62614177-aeea-4770-87bd-99104ba47095.ac40356b-a7e4-4a4e-8358-abce6b3d2b02 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2ad1d4-12d8-475b-b752-ec93394f7a2a]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-79ea1e6b-ac1b-4b9a-ab44-c585f5492e9e tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095.ac40356b-a7e4-4a4e-8358-abce6b3d2b02 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab789b08-5e3b-491b-b4ff-9098cdd3abd7 tempest-ProjectReaderTests-329876153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ab789b08-5e3b-491b-b4ff-9098cdd3abd7 tempest-ProjectReaderTests-329876153 None] Flow 'volume_create_manager' (a1be0306-1f1a-43f0-9c48-f67848b4abb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ab789b08-5e3b-491b-b4ff-9098cdd3abd7 tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3da5563a-3b27-4e3c-9739-17da3b02caa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ab789b08-5e3b-491b-b4ff-9098cdd3abd7 tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3da5563a-3b27-4e3c-9739-17da3b02caa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2090848561',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c6fe32f-8648-4c02-a0b1-b3ebc58ac8a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bbc2c4029f146e685644b03e00966bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:27:15Z,use_quota=True,user_id='b5aa2d370b9d459e80cb4a5d3a29e22d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ab789b08-5e3b-491b-b4ff-9098cdd3abd7 tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a7ab5a0-d7f3-496f-bffd-3fc4c1379c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ab789b08-5e3b-491b-b4ff-9098cdd3abd7 tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a7ab5a0-d7f3-496f-bffd-3fc4c1379c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ab789b08-5e3b-491b-b4ff-9098cdd3abd7 tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e6be453-f1b3-428f-8322-1c93416963f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ab789b08-5e3b-491b-b4ff-9098cdd3abd7 tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e6be453-f1b3-428f-8322-1c93416963f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c6fe32f-8648-4c02-a0b1-b3ebc58ac8a4', 'volume_name': 'volume-3c6fe32f-8648-4c02-a0b1-b3ebc58ac8a4', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ab789b08-5e3b-491b-b4ff-9098cdd3abd7 tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46760b14-c283-4d3c-a9c5-ad044215f2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ab789b08-5e3b-491b-b4ff-9098cdd3abd7 tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46760b14-c283-4d3c-a9c5-ad044215f2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:15 devstack sudo[105524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095.ac40356b-a7e4-4a4e-8358-abce6b3d2b02
Nov 05 19:27:15 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ab789b08-5e3b-491b-b4ff-9098cdd3abd7 tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (522a1998-47a8-4330-bb1e-2d64ed3f12be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:15 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-ab789b08-5e3b-491b-b4ff-9098cdd3abd7 tempest-ProjectReaderTests-329876153 None] Volume 3c6fe32f-8648-4c02-a0b1-b3ebc58ac8a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c6fe32f-8648-4c02-a0b1-b3ebc58ac8a4', 'volume_size': 1}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ab789b08-5e3b-491b-b4ff-9098cdd3abd7 tempest-ProjectReaderTests-329876153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ab789b08-5e3b-491b-b4ff-9098cdd3abd7 tempest-ProjectReaderTests-329876153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ab789b08-5e3b-491b-b4ff-9098cdd3abd7 tempest-ProjectReaderTests-329876153 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2090848561',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c6fe32f-8648-4c02-a0b1-b3ebc58ac8a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bbc2c4029f146e685644b03e00966bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:27:15Z,use_quota=True,user_id='b5aa2d370b9d459e80cb4a5d3a29e22d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-ab789b08-5e3b-491b-b4ff-9098cdd3abd7 tempest-ProjectReaderTests-329876153 None] Creating volume 3c6fe32f-8648-4c02-a0b1-b3ebc58ac8a4 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ab789b08-5e3b-491b-b4ff-9098cdd3abd7 tempest-ProjectReaderTests-329876153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ab789b08-5e3b-491b-b4ff-9098cdd3abd7 tempest-ProjectReaderTests-329876153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ab789b08-5e3b-491b-b4ff-9098cdd3abd7 tempest-ProjectReaderTests-329876153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ab789b08-5e3b-491b-b4ff-9098cdd3abd7 tempest-ProjectReaderTests-329876153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ab789b08-5e3b-491b-b4ff-9098cdd3abd7 tempest-ProjectReaderTests-329876153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ab789b08-5e3b-491b-b4ff-9098cdd3abd7 tempest-ProjectReaderTests-329876153 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:27:15 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-ab789b08-5e3b-491b-b4ff-9098cdd3abd7 tempest-ProjectReaderTests-329876153 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ab789b08-5e3b-491b-b4ff-9098cdd3abd7 tempest-ProjectReaderTests-329876153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3c6fe32f-8648-4c02-a0b1-b3ebc58ac8a4 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c7bf3d11-7d60-4152-9b09-cc9235102696 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Acquiring lock "cinder-db0ce854-dd54-433a-b610-1d60517124af-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:15 devstack sudo[105526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3c6fe32f-8648-4c02-a0b1-b3ebc58ac8a4 1073741824
Nov 05 19:27:15 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c7bf3d11-7d60-4152-9b09-cc9235102696 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "cinder-db0ce854-dd54-433a-b610-1d60517124af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c7bf3d11-7d60-4152-9b09-cc9235102696 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Acquiring lock "cinder-quobyte-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c7bf3d11-7d60-4152-9b09-cc9235102696 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "cinder-quobyte-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c7bf3d11-7d60-4152-9b09-cc9235102696 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Acquiring lock "cinder-quobyte-db0ce854-dd54-433a-b610-1d60517124af" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b484ccdc-5289-438e-9953-d61241467073 tempest-CinderUnicodeTest-853941933 None] Acquiring lock "cinder-2f2a4277-50ac-4ed8-88fb-f1b16556bf3d-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c7bf3d11-7d60-4152-9b09-cc9235102696 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "cinder-quobyte-db0ce854-dd54-433a-b610-1d60517124af" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-c7bf3d11-7d60-4152-9b09-cc9235102696 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Deleting offline snapshot db0ce854-dd54-433a-b610-1d60517124af of volume 7a6a20b9-9ebb-4359-9b3b-3a8d2681df87 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-c7bf3d11-7d60-4152-9b09-cc9235102696 tempest-CreateVolumesFromSnapshotTest-1238074279 None] snapshot_file for this snap is: volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87.db0ce854-dd54-433a-b610-1d60517124af {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b484ccdc-5289-438e-9953-d61241467073 tempest-CinderUnicodeTest-853941933 None] Lock "cinder-2f2a4277-50ac-4ed8-88fb-f1b16556bf3d-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ab3214-333f-431a-b5b3-3acd83510ff7]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c7bf3d11-7d60-4152-9b09-cc9235102696 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87.db0ce854-dd54-433a-b610-1d60517124af {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b484ccdc-5289-438e-9953-d61241467073 tempest-CinderUnicodeTest-853941933 None] Acquiring lock "cinder-quobyte-2f2a4277-50ac-4ed8-88fb-f1b16556bf3d" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b484ccdc-5289-438e-9953-d61241467073 tempest-CinderUnicodeTest-853941933 None] Lock "cinder-quobyte-2f2a4277-50ac-4ed8-88fb-f1b16556bf3d" acquired by "delete_volume" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f862d2-6e66-4c05-970a-83038edb2dda]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b484ccdc-5289-438e-9953-d61241467073 tempest-CinderUnicodeTest-853941933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-2f2a4277-50ac-4ed8-88fb-f1b16556bf3d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:15 devstack sudo[105528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87.db0ce854-dd54-433a-b610-1d60517124af
Nov 05 19:27:15 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:15 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-79ea1e6b-ac1b-4b9a-ab44-c585f5492e9e tempest-ProjectMemberTests-1640873908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095.ac40356b-a7e4-4a4e-8358-abce6b3d2b02" returned: 0 in 0.449s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-79ea1e6b-ac1b-4b9a-ab44-c585f5492e9e tempest-ProjectMemberTests-1640873908 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62614177-aeea-4770-87bd-99104ba47095(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a93ef27-6a25-4f7e-85ae-93c36106a349]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-79ea1e6b-ac1b-4b9a-ab44-c585f5492e9e tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:15 devstack sudo[105533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-2f2a4277-50ac-4ed8-88fb-f1b16556bf3d
Nov 05 19:27:15 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:15 devstack sudo[105538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095
Nov 05 19:27:15 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:15 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ab789b08-5e3b-491b-b4ff-9098cdd3abd7 tempest-ProjectReaderTests-329876153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3c6fe32f-8648-4c02-a0b1-b3ebc58ac8a4 1073741824" returned: 0 in 0.520s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:15 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c7bf3d11-7d60-4152-9b09-cc9235102696 tempest-CreateVolumesFromSnapshotTest-1238074279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87.db0ce854-dd54-433a-b610-1d60517124af" returned: 0 in 0.403s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-c7bf3d11-7d60-4152-9b09-cc9235102696 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ab789b08-5e3b-491b-b4ff-9098cdd3abd7 tempest-ProjectReaderTests-329876153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3c6fe32f-8648-4c02-a0b1-b3ebc58ac8a4 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1afe288-c084-46ce-a724-cc0cb354db40]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c7bf3d11-7d60-4152-9b09-cc9235102696 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:15 devstack sudo[105546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3c6fe32f-8648-4c02-a0b1-b3ebc58ac8a4
Nov 05 19:27:15 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:15 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b484ccdc-5289-438e-9953-d61241467073 tempest-CinderUnicodeTest-853941933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-2f2a4277-50ac-4ed8-88fb-f1b16556bf3d" returned: 0 in 0.466s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b484ccdc-5289-438e-9953-d61241467073 tempest-CinderUnicodeTest-853941933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-2f2a4277-50ac-4ed8-88fb-f1b16556bf3d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:16 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-79ea1e6b-ac1b-4b9a-ab44-c585f5492e9e tempest-ProjectMemberTests-1640873908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095" returned: 0 in 0.399s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-79ea1e6b-ac1b-4b9a-ab44-c585f5492e9e tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095.ac40356b-a7e4-4a4e-8358-abce6b3d2b02 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:16 devstack sudo[105547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87
Nov 05 19:27:16 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:16 devstack sudo[105556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-2f2a4277-50ac-4ed8-88fb-f1b16556bf3d
Nov 05 19:27:16 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:16 devstack sudo[105559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095.ac40356b-a7e4-4a4e-8358-abce6b3d2b02
Nov 05 19:27:16 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:16 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ab789b08-5e3b-491b-b4ff-9098cdd3abd7 tempest-ProjectReaderTests-329876153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3c6fe32f-8648-4c02-a0b1-b3ebc58ac8a4" returned: 0 in 0.316s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ab789b08-5e3b-491b-b4ff-9098cdd3abd7 tempest-ProjectReaderTests-329876153 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:27:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ab789b08-5e3b-491b-b4ff-9098cdd3abd7 tempest-ProjectReaderTests-329876153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ab789b08-5e3b-491b-b4ff-9098cdd3abd7 tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (522a1998-47a8-4330-bb1e-2d64ed3f12be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c6fe32f-8648-4c02-a0b1-b3ebc58ac8a4', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ab789b08-5e3b-491b-b4ff-9098cdd3abd7 tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b661d7b-25be-4c2a-ab49-cd7c8ef1914b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:16 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-ab789b08-5e3b-491b-b4ff-9098cdd3abd7 tempest-ProjectReaderTests-329876153 None] Volume volume-3c6fe32f-8648-4c02-a0b1-b3ebc58ac8a4 (3c6fe32f-8648-4c02-a0b1-b3ebc58ac8a4): created successfully
Nov 05 19:27:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ab789b08-5e3b-491b-b4ff-9098cdd3abd7 tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b661d7b-25be-4c2a-ab49-cd7c8ef1914b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:16 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-ab789b08-5e3b-491b-b4ff-9098cdd3abd7 tempest-ProjectReaderTests-329876153 None] Flow 'volume_create_manager' (a1be0306-1f1a-43f0-9c48-f67848b4abb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:27:16 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-ab789b08-5e3b-491b-b4ff-9098cdd3abd7 tempest-ProjectReaderTests-329876153 None] Created volume successfully.
Nov 05 19:27:16 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b484ccdc-5289-438e-9953-d61241467073 tempest-CinderUnicodeTest-853941933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-2f2a4277-50ac-4ed8-88fb-f1b16556bf3d" returned: 0 in 0.317s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b484ccdc-5289-438e-9953-d61241467073 tempest-CinderUnicodeTest-853941933 None] Lock "cinder-quobyte-2f2a4277-50ac-4ed8-88fb-f1b16556bf3d" released by "delete_volume" :: held 0.831s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:16 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c7bf3d11-7d60-4152-9b09-cc9235102696 tempest-CreateVolumesFromSnapshotTest-1238074279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87" returned: 0 in 0.475s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c7bf3d11-7d60-4152-9b09-cc9235102696 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87.db0ce854-dd54-433a-b610-1d60517124af {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:16 devstack sudo[105570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87.db0ce854-dd54-433a-b610-1d60517124af
Nov 05 19:27:16 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:16 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-b484ccdc-5289-438e-9953-d61241467073 tempest-CinderUnicodeTest-853941933 None] Created reservations ['ff1b776e-caad-4e15-a771-7f662c5b5adf', 'cda2c5f8-ccb2-4bd6-b37e-262710706b5b', 'aaaf3772-dc62-4a1e-99e7-c6ef3f54950b', '3eab45a2-342f-412a-9d21-16c10f054ea6'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:27:16 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-79ea1e6b-ac1b-4b9a-ab44-c585f5492e9e tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095.ac40356b-a7e4-4a4e-8358-abce6b3d2b02" returned: 0 in 0.440s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-79ea1e6b-ac1b-4b9a-ab44-c585f5492e9e tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095.ac40356b-a7e4-4a4e-8358-abce6b3d2b02 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b484ccdc-5289-438e-9953-d61241467073 tempest-CinderUnicodeTest-853941933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b484ccdc-5289-438e-9953-d61241467073 tempest-CinderUnicodeTest-853941933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b484ccdc-5289-438e-9953-d61241467073 tempest-CinderUnicodeTest-853941933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:27:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b484ccdc-5289-438e-9953-d61241467073 tempest-CinderUnicodeTest-853941933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:27:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b484ccdc-5289-438e-9953-d61241467073 tempest-CinderUnicodeTest-853941933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b484ccdc-5289-438e-9953-d61241467073 tempest-CinderUnicodeTest-853941933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:16 devstack sudo[105572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095.ac40356b-a7e4-4a4e-8358-abce6b3d2b02
Nov 05 19:27:16 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:16 devstack sudo[105574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:27:16 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:16 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c7bf3d11-7d60-4152-9b09-cc9235102696 tempest-CreateVolumesFromSnapshotTest-1238074279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87.db0ce854-dd54-433a-b610-1d60517124af" returned: 0 in 0.393s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c7bf3d11-7d60-4152-9b09-cc9235102696 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87.db0ce854-dd54-433a-b610-1d60517124af {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:16 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-79ea1e6b-ac1b-4b9a-ab44-c585f5492e9e tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095.ac40356b-a7e4-4a4e-8358-abce6b3d2b02" returned: 0 in 0.293s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:16 devstack sudo[105581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87.db0ce854-dd54-433a-b610-1d60517124af
Nov 05 19:27:16 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:16 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b484ccdc-5289-438e-9953-d61241467073 tempest-CinderUnicodeTest-853941933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.322s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:16 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-b484ccdc-5289-438e-9953-d61241467073 tempest-CinderUnicodeTest-853941933 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:27:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-79ea1e6b-ac1b-4b9a-ab44-c585f5492e9e tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-ac40356b-a7e4-4a4e-8358-abce6b3d2b02" released by "_delete_snapshot" :: held 1.731s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:16 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b484ccdc-5289-438e-9953-d61241467073 tempest-CinderUnicodeTest-853941933 None] Deleted volume successfully.
Nov 05 19:27:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-79ea1e6b-ac1b-4b9a-ab44-c585f5492e9e tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-62614177-aeea-4770-87bd-99104ba47095" released by "delete_snapshot" :: held 1.759s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b484ccdc-5289-438e-9953-d61241467073 tempest-CinderUnicodeTest-853941933 None] Lock "cinder-2f2a4277-50ac-4ed8-88fb-f1b16556bf3d-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:16 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-79ea1e6b-ac1b-4b9a-ab44-c585f5492e9e tempest-ProjectMemberTests-1640873908 None] Created reservations ['e623e4a9-696c-44f0-930c-f4a2869953c6', '39d40b89-6740-4c90-acd0-60bdbd5f2fec', '0abdca61-3f13-4f62-9b5b-0550247ec3e6', 'ad6c3037-53c3-40ba-a77a-b8f9efc55ce8'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:27:16 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-79ea1e6b-ac1b-4b9a-ab44-c585f5492e9e tempest-ProjectMemberTests-1640873908 None] Delete snapshot completed successfully.
Nov 05 19:27:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-79ea1e6b-ac1b-4b9a-ab44-c585f5492e9e tempest-ProjectMemberTests-1640873908 None] Lock "cinder-ac40356b-a7e4-4a4e-8358-abce6b3d2b02-delete_snapshot" released by "delete_snapshot" :: held 1.921s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:17 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c7bf3d11-7d60-4152-9b09-cc9235102696 tempest-CreateVolumesFromSnapshotTest-1238074279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87.db0ce854-dd54-433a-b610-1d60517124af" returned: 0 in 0.289s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c7bf3d11-7d60-4152-9b09-cc9235102696 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "cinder-quobyte-db0ce854-dd54-433a-b610-1d60517124af" released by "_delete_snapshot" :: held 1.718s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c7bf3d11-7d60-4152-9b09-cc9235102696 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "cinder-quobyte-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87" released by "delete_snapshot" :: held 1.749s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:17 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-c7bf3d11-7d60-4152-9b09-cc9235102696 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Created reservations ['9bd43cfc-66bf-477c-8947-b048c2a8f434', 'bc2fb25e-e8e6-4960-97b0-9f19387cd22c', '9e0e4824-505e-443c-92b2-e11c71b52581', '09dbf12f-4199-400b-be4f-a8f40d7ee60a'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:27:17 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-c7bf3d11-7d60-4152-9b09-cc9235102696 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Delete snapshot completed successfully.
Nov 05 19:27:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c7bf3d11-7d60-4152-9b09-cc9235102696 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "cinder-db0ce854-dd54-433a-b610-1d60517124af-delete_snapshot" released by "delete_snapshot" :: held 1.930s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4f1d3104-54e2-49ad-8239-28730b5ca055 tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-62614177-aeea-4770-87bd-99104ba47095-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4f1d3104-54e2-49ad-8239-28730b5ca055 tempest-ProjectMemberTests-1640873908 None] Lock "cinder-62614177-aeea-4770-87bd-99104ba47095-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a13cf515-7fdd-4e6a-b783-94619635085c tempest-ProjectReaderTests-329876153 None] Acquiring lock "cinder-3c6fe32f-8648-4c02-a0b1-b3ebc58ac8a4-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a13cf515-7fdd-4e6a-b783-94619635085c tempest-ProjectReaderTests-329876153 None] Lock "cinder-3c6fe32f-8648-4c02-a0b1-b3ebc58ac8a4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4f1d3104-54e2-49ad-8239-28730b5ca055 tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-quobyte-62614177-aeea-4770-87bd-99104ba47095" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4f1d3104-54e2-49ad-8239-28730b5ca055 tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-62614177-aeea-4770-87bd-99104ba47095" acquired by "delete_volume" :: waited 0.030s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4d43a9b7-80d4-4467-8b4b-edebecabecf7 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Acquiring lock "cinder-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:17 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[67200159-0f3d-415a-983a-89c4688a055a]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4f1d3104-54e2-49ad-8239-28730b5ca055 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4d43a9b7-80d4-4467-8b4b-edebecabecf7 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "cinder-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a13cf515-7fdd-4e6a-b783-94619635085c tempest-ProjectReaderTests-329876153 None] Acquiring lock "cinder-quobyte-3c6fe32f-8648-4c02-a0b1-b3ebc58ac8a4" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a13cf515-7fdd-4e6a-b783-94619635085c tempest-ProjectReaderTests-329876153 None] Lock "cinder-quobyte-3c6fe32f-8648-4c02-a0b1-b3ebc58ac8a4" acquired by "delete_volume" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:17 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[902627fe-9002-4312-8e12-38224db81556]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a13cf515-7fdd-4e6a-b783-94619635085c tempest-ProjectReaderTests-329876153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3c6fe32f-8648-4c02-a0b1-b3ebc58ac8a4 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4d43a9b7-80d4-4467-8b4b-edebecabecf7 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Acquiring lock "cinder-quobyte-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:17 devstack sudo[105585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095
Nov 05 19:27:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4d43a9b7-80d4-4467-8b4b-edebecabecf7 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "cinder-quobyte-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87" acquired by "delete_volume" :: waited 0.027s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:17 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:17 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fa052f-71a1-4fe7-ac35-36a3bfbd0d07]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4d43a9b7-80d4-4467-8b4b-edebecabecf7 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:17 devstack sudo[105586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3c6fe32f-8648-4c02-a0b1-b3ebc58ac8a4
Nov 05 19:27:17 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:17 devstack sudo[105588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87
Nov 05 19:27:17 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:17 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4f1d3104-54e2-49ad-8239-28730b5ca055 tempest-ProjectMemberTests-1640873908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095" returned: 0 in 0.425s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4f1d3104-54e2-49ad-8239-28730b5ca055 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:17 devstack sudo[105594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095
Nov 05 19:27:17 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:18 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a13cf515-7fdd-4e6a-b783-94619635085c tempest-ProjectReaderTests-329876153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3c6fe32f-8648-4c02-a0b1-b3ebc58ac8a4" returned: 0 in 0.495s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a13cf515-7fdd-4e6a-b783-94619635085c tempest-ProjectReaderTests-329876153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3c6fe32f-8648-4c02-a0b1-b3ebc58ac8a4 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:18 devstack sudo[105601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3c6fe32f-8648-4c02-a0b1-b3ebc58ac8a4
Nov 05 19:27:18 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:18 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4d43a9b7-80d4-4467-8b4b-edebecabecf7 tempest-CreateVolumesFromSnapshotTest-1238074279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87" returned: 0 in 0.482s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4d43a9b7-80d4-4467-8b4b-edebecabecf7 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:18 devstack sudo[105605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87
Nov 05 19:27:18 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:18 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4f1d3104-54e2-49ad-8239-28730b5ca055 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-62614177-aeea-4770-87bd-99104ba47095" returned: 0 in 0.349s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4f1d3104-54e2-49ad-8239-28730b5ca055 tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-62614177-aeea-4770-87bd-99104ba47095" released by "delete_volume" :: held 0.883s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:18 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-4f1d3104-54e2-49ad-8239-28730b5ca055 tempest-ProjectMemberTests-1640873908 None] Created reservations ['015c90cf-9c8f-43e0-a26f-dfc3fa12a6e7', 'b610c7ae-1c83-4adc-8b9c-408ccaf2c9e9', '1010fdb5-03c4-4e9d-a3f4-8846bef396d8', '000c07f5-b32d-46aa-af42-0795fe39373c'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:27:18 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a13cf515-7fdd-4e6a-b783-94619635085c tempest-ProjectReaderTests-329876153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3c6fe32f-8648-4c02-a0b1-b3ebc58ac8a4" returned: 0 in 0.311s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a13cf515-7fdd-4e6a-b783-94619635085c tempest-ProjectReaderTests-329876153 None] Lock "cinder-quobyte-3c6fe32f-8648-4c02-a0b1-b3ebc58ac8a4" released by "delete_volume" :: held 0.857s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4f1d3104-54e2-49ad-8239-28730b5ca055 tempest-ProjectMemberTests-1640873908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4f1d3104-54e2-49ad-8239-28730b5ca055 tempest-ProjectMemberTests-1640873908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4f1d3104-54e2-49ad-8239-28730b5ca055 tempest-ProjectMemberTests-1640873908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:27:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4f1d3104-54e2-49ad-8239-28730b5ca055 tempest-ProjectMemberTests-1640873908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:27:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4f1d3104-54e2-49ad-8239-28730b5ca055 tempest-ProjectMemberTests-1640873908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4f1d3104-54e2-49ad-8239-28730b5ca055 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:18 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4d43a9b7-80d4-4467-8b4b-edebecabecf7 tempest-CreateVolumesFromSnapshotTest-1238074279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87" returned: 0 in 0.332s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:18 devstack sudo[105610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:27:18 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4d43a9b7-80d4-4467-8b4b-edebecabecf7 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "cinder-quobyte-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87" released by "delete_volume" :: held 0.909s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:18 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-a13cf515-7fdd-4e6a-b783-94619635085c tempest-ProjectReaderTests-329876153 None] Created reservations ['b10ee7a7-40be-4fbd-9ad6-3ede4abfb5c1', 'f7dac85f-f976-424b-a26c-b43e6aed883f', 'b2f2b15b-ccb0-45f4-8c44-2a6da1635e14', '5a2ddcee-d5c7-4f42-87cb-247435a66259'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:27:18 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-4d43a9b7-80d4-4467-8b4b-edebecabecf7 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Created reservations ['d1158b24-7456-46ba-af5e-ec4e9cdca5bf', 'a4f4b471-334c-4fcf-b20f-2458a4702cff', '8ff66d86-869a-495f-a359-4a8b3034c270', '78092540-1509-4b70-bbc4-ac37daba038d'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:27:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a13cf515-7fdd-4e6a-b783-94619635085c tempest-ProjectReaderTests-329876153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a13cf515-7fdd-4e6a-b783-94619635085c tempest-ProjectReaderTests-329876153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a13cf515-7fdd-4e6a-b783-94619635085c tempest-ProjectReaderTests-329876153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:27:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a13cf515-7fdd-4e6a-b783-94619635085c tempest-ProjectReaderTests-329876153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:27:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a13cf515-7fdd-4e6a-b783-94619635085c tempest-ProjectReaderTests-329876153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a13cf515-7fdd-4e6a-b783-94619635085c tempest-ProjectReaderTests-329876153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:18 devstack sudo[105612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:27:18 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4d43a9b7-80d4-4467-8b4b-edebecabecf7 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4d43a9b7-80d4-4467-8b4b-edebecabecf7 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4d43a9b7-80d4-4467-8b4b-edebecabecf7 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:27:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4d43a9b7-80d4-4467-8b4b-edebecabecf7 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:27:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4d43a9b7-80d4-4467-8b4b-edebecabecf7 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4d43a9b7-80d4-4467-8b4b-edebecabecf7 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:18 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4f1d3104-54e2-49ad-8239-28730b5ca055 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.404s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:18 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-4f1d3104-54e2-49ad-8239-28730b5ca055 tempest-ProjectMemberTests-1640873908 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:27:18 devstack sudo[105615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:27:18 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:18 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-4f1d3104-54e2-49ad-8239-28730b5ca055 tempest-ProjectMemberTests-1640873908 None] Deleted volume successfully.
Nov 05 19:27:18 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4f1d3104-54e2-49ad-8239-28730b5ca055 tempest-ProjectMemberTests-1640873908 None] Lock "cinder-62614177-aeea-4770-87bd-99104ba47095-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:19 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a13cf515-7fdd-4e6a-b783-94619635085c tempest-ProjectReaderTests-329876153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.434s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:19 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-a13cf515-7fdd-4e6a-b783-94619635085c tempest-ProjectReaderTests-329876153 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:27:19 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-a13cf515-7fdd-4e6a-b783-94619635085c tempest-ProjectReaderTests-329876153 None] Deleted volume successfully.
Nov 05 19:27:19 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:19 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-c42a20f6-9389-41b8-bb4a-dd457eed9b10 tempest-ProjectMemberTests-1640873908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:27:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c42a20f6-9389-41b8-bb4a-dd457eed9b10 tempest-ProjectMemberTests-1640873908 None] Flow 'volume_create_manager' (c077b8c6-2cf9-4a64-b0c7-733b9a31785a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:27:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c42a20f6-9389-41b8-bb4a-dd457eed9b10 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0bf19cf-972b-4dd5-810c-9399ef74eed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a13cf515-7fdd-4e6a-b783-94619635085c tempest-ProjectReaderTests-329876153 None] Lock "cinder-3c6fe32f-8648-4c02-a0b1-b3ebc58ac8a4-delete_volume" released by "delete_volume" :: held 1.885s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4d43a9b7-80d4-4467-8b4b-edebecabecf7 tempest-CreateVolumesFromSnapshotTest-1238074279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.434s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:19 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-4d43a9b7-80d4-4467-8b4b-edebecabecf7 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:27:19 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-4d43a9b7-80d4-4467-8b4b-edebecabecf7 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Deleted volume successfully.
Nov 05 19:27:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c42a20f6-9389-41b8-bb4a-dd457eed9b10 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0bf19cf-972b-4dd5-810c-9399ef74eed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1039140334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9617559-9f3e-41ff-bc88-704ed22a3132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d5b238d03346c2b35a48086a4ecc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:27:19Z,use_quota=True,user_id='9c94d9844c6446c58716ae4b34ced8c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c42a20f6-9389-41b8-bb4a-dd457eed9b10 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af7d832f-bba3-4542-8049-9a3d7fb8066c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c42a20f6-9389-41b8-bb4a-dd457eed9b10 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af7d832f-bba3-4542-8049-9a3d7fb8066c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c42a20f6-9389-41b8-bb4a-dd457eed9b10 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73291546-62f5-4d74-ad4f-ed6d4b22260e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c42a20f6-9389-41b8-bb4a-dd457eed9b10 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73291546-62f5-4d74-ad4f-ed6d4b22260e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9617559-9f3e-41ff-bc88-704ed22a3132', 'volume_name': 'volume-a9617559-9f3e-41ff-bc88-704ed22a3132', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c42a20f6-9389-41b8-bb4a-dd457eed9b10 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (714c50d7-84bf-4362-a2c8-0f49769b63e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c42a20f6-9389-41b8-bb4a-dd457eed9b10 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (714c50d7-84bf-4362-a2c8-0f49769b63e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c42a20f6-9389-41b8-bb4a-dd457eed9b10 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (780e66e0-573f-4262-87ab-e34bb58fbf3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:19 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-c42a20f6-9389-41b8-bb4a-dd457eed9b10 tempest-ProjectMemberTests-1640873908 None] Volume a9617559-9f3e-41ff-bc88-704ed22a3132: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9617559-9f3e-41ff-bc88-704ed22a3132', 'volume_size': 1}
Nov 05 19:27:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c42a20f6-9389-41b8-bb4a-dd457eed9b10 tempest-ProjectMemberTests-1640873908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c42a20f6-9389-41b8-bb4a-dd457eed9b10 tempest-ProjectMemberTests-1640873908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c42a20f6-9389-41b8-bb4a-dd457eed9b10 tempest-ProjectMemberTests-1640873908 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1039140334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9617559-9f3e-41ff-bc88-704ed22a3132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d5b238d03346c2b35a48086a4ecc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:27:19Z,use_quota=True,user_id='9c94d9844c6446c58716ae4b34ced8c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:27:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-c42a20f6-9389-41b8-bb4a-dd457eed9b10 tempest-ProjectMemberTests-1640873908 None] Creating volume a9617559-9f3e-41ff-bc88-704ed22a3132 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:27:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c42a20f6-9389-41b8-bb4a-dd457eed9b10 tempest-ProjectMemberTests-1640873908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c42a20f6-9389-41b8-bb4a-dd457eed9b10 tempest-ProjectMemberTests-1640873908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c42a20f6-9389-41b8-bb4a-dd457eed9b10 tempest-ProjectMemberTests-1640873908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:27:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c42a20f6-9389-41b8-bb4a-dd457eed9b10 tempest-ProjectMemberTests-1640873908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:27:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c42a20f6-9389-41b8-bb4a-dd457eed9b10 tempest-ProjectMemberTests-1640873908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c42a20f6-9389-41b8-bb4a-dd457eed9b10 tempest-ProjectMemberTests-1640873908 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:27:19 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-c42a20f6-9389-41b8-bb4a-dd457eed9b10 tempest-ProjectMemberTests-1640873908 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:27:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c42a20f6-9389-41b8-bb4a-dd457eed9b10 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:19 devstack sudo[105619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132 1073741824
Nov 05 19:27:19 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4d43a9b7-80d4-4467-8b4b-edebecabecf7 tempest-CreateVolumesFromSnapshotTest-1238074279 None] Lock "cinder-7a6a20b9-9ebb-4359-9b3b-3a8d2681df87-delete_volume" released by "delete_volume" :: held 1.854s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:19 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c42a20f6-9389-41b8-bb4a-dd457eed9b10 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132 1073741824" returned: 0 in 0.500s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c42a20f6-9389-41b8-bb4a-dd457eed9b10 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:19 devstack sudo[105625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132
Nov 05 19:27:19 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:20 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c42a20f6-9389-41b8-bb4a-dd457eed9b10 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132" returned: 0 in 0.319s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c42a20f6-9389-41b8-bb4a-dd457eed9b10 tempest-ProjectMemberTests-1640873908 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:27:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c42a20f6-9389-41b8-bb4a-dd457eed9b10 tempest-ProjectMemberTests-1640873908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c42a20f6-9389-41b8-bb4a-dd457eed9b10 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (780e66e0-573f-4262-87ab-e34bb58fbf3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9617559-9f3e-41ff-bc88-704ed22a3132', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c42a20f6-9389-41b8-bb4a-dd457eed9b10 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b453f14f-b98d-40cc-a02f-c50e78761e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:20 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-c42a20f6-9389-41b8-bb4a-dd457eed9b10 tempest-ProjectMemberTests-1640873908 None] Volume volume-a9617559-9f3e-41ff-bc88-704ed22a3132 (a9617559-9f3e-41ff-bc88-704ed22a3132): created successfully
Nov 05 19:27:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c42a20f6-9389-41b8-bb4a-dd457eed9b10 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b453f14f-b98d-40cc-a02f-c50e78761e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c42a20f6-9389-41b8-bb4a-dd457eed9b10 tempest-ProjectMemberTests-1640873908 None] Flow 'volume_create_manager' (c077b8c6-2cf9-4a64-b0c7-733b9a31785a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:27:20 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-c42a20f6-9389-41b8-bb4a-dd457eed9b10 tempest-ProjectMemberTests-1640873908 None] Created volume successfully.
Nov 05 19:27:20 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e4702f6-3448-4a70-8ddf-7314829b6feb tempest-ProjectReaderTests-329876153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:27:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7e4702f6-3448-4a70-8ddf-7314829b6feb tempest-ProjectReaderTests-329876153 None] Flow 'volume_create_manager' (c28cd0e4-d2cd-4f52-9166-6730506414f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:27:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7e4702f6-3448-4a70-8ddf-7314829b6feb tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b74f8303-3e11-4c90-b5a5-a17273a34b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7e4702f6-3448-4a70-8ddf-7314829b6feb tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b74f8303-3e11-4c90-b5a5-a17273a34b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-581137350',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1578b350-9d6e-4e22-a752-db97506f8432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bbc2c4029f146e685644b03e00966bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:27:20Z,use_quota=True,user_id='b5aa2d370b9d459e80cb4a5d3a29e22d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7e4702f6-3448-4a70-8ddf-7314829b6feb tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea0f8f84-1b71-4a76-8146-350c7103db21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7e4702f6-3448-4a70-8ddf-7314829b6feb tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea0f8f84-1b71-4a76-8146-350c7103db21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7e4702f6-3448-4a70-8ddf-7314829b6feb tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78b21725-62d8-4338-b660-78f0be414636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7e4702f6-3448-4a70-8ddf-7314829b6feb tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78b21725-62d8-4338-b660-78f0be414636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1578b350-9d6e-4e22-a752-db97506f8432', 'volume_name': 'volume-1578b350-9d6e-4e22-a752-db97506f8432', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7e4702f6-3448-4a70-8ddf-7314829b6feb tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b457e5f-98d5-4816-a33d-7bc9b999489d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7e4702f6-3448-4a70-8ddf-7314829b6feb tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b457e5f-98d5-4816-a33d-7bc9b999489d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:20 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7e4702f6-3448-4a70-8ddf-7314829b6feb tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f5f61cd-772f-4ee3-b38a-112f944c3ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:20 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-7e4702f6-3448-4a70-8ddf-7314829b6feb tempest-ProjectReaderTests-329876153 None] Volume 1578b350-9d6e-4e22-a752-db97506f8432: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1578b350-9d6e-4e22-a752-db97506f8432', 'volume_size': 1}
Nov 05 19:27:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7e4702f6-3448-4a70-8ddf-7314829b6feb tempest-ProjectReaderTests-329876153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7e4702f6-3448-4a70-8ddf-7314829b6feb tempest-ProjectReaderTests-329876153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7e4702f6-3448-4a70-8ddf-7314829b6feb tempest-ProjectReaderTests-329876153 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-581137350',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1578b350-9d6e-4e22-a752-db97506f8432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bbc2c4029f146e685644b03e00966bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:27:20Z,use_quota=True,user_id='b5aa2d370b9d459e80cb4a5d3a29e22d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:27:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-7e4702f6-3448-4a70-8ddf-7314829b6feb tempest-ProjectReaderTests-329876153 None] Creating volume 1578b350-9d6e-4e22-a752-db97506f8432 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:27:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7e4702f6-3448-4a70-8ddf-7314829b6feb tempest-ProjectReaderTests-329876153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7e4702f6-3448-4a70-8ddf-7314829b6feb tempest-ProjectReaderTests-329876153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7e4702f6-3448-4a70-8ddf-7314829b6feb tempest-ProjectReaderTests-329876153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:27:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7e4702f6-3448-4a70-8ddf-7314829b6feb tempest-ProjectReaderTests-329876153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:27:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7e4702f6-3448-4a70-8ddf-7314829b6feb tempest-ProjectReaderTests-329876153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7e4702f6-3448-4a70-8ddf-7314829b6feb tempest-ProjectReaderTests-329876153 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:27:20 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-7e4702f6-3448-4a70-8ddf-7314829b6feb tempest-ProjectReaderTests-329876153 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:27:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7e4702f6-3448-4a70-8ddf-7314829b6feb tempest-ProjectReaderTests-329876153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-1578b350-9d6e-4e22-a752-db97506f8432 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:20 devstack sudo[105628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-1578b350-9d6e-4e22-a752-db97506f8432 1073741824
Nov 05 19:27:20 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:20 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7e4702f6-3448-4a70-8ddf-7314829b6feb tempest-ProjectReaderTests-329876153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-1578b350-9d6e-4e22-a752-db97506f8432 1073741824" returned: 0 in 0.546s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7e4702f6-3448-4a70-8ddf-7314829b6feb tempest-ProjectReaderTests-329876153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-1578b350-9d6e-4e22-a752-db97506f8432 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:21 devstack sudo[105634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-1578b350-9d6e-4e22-a752-db97506f8432
Nov 05 19:27:21 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:21 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7e4702f6-3448-4a70-8ddf-7314829b6feb tempest-ProjectReaderTests-329876153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-1578b350-9d6e-4e22-a752-db97506f8432" returned: 0 in 0.306s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7e4702f6-3448-4a70-8ddf-7314829b6feb tempest-ProjectReaderTests-329876153 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:27:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7e4702f6-3448-4a70-8ddf-7314829b6feb tempest-ProjectReaderTests-329876153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7e4702f6-3448-4a70-8ddf-7314829b6feb tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f5f61cd-772f-4ee3-b38a-112f944c3ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1578b350-9d6e-4e22-a752-db97506f8432', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7e4702f6-3448-4a70-8ddf-7314829b6feb tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad66ba35-652e-477b-a041-9666e722e802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:21 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-7e4702f6-3448-4a70-8ddf-7314829b6feb tempest-ProjectReaderTests-329876153 None] Volume volume-1578b350-9d6e-4e22-a752-db97506f8432 (1578b350-9d6e-4e22-a752-db97506f8432): created successfully
Nov 05 19:27:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7e4702f6-3448-4a70-8ddf-7314829b6feb tempest-ProjectReaderTests-329876153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad66ba35-652e-477b-a041-9666e722e802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:21 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-7e4702f6-3448-4a70-8ddf-7314829b6feb tempest-ProjectReaderTests-329876153 None] Flow 'volume_create_manager' (c28cd0e4-d2cd-4f52-9166-6730506414f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:27:21 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-7e4702f6-3448-4a70-8ddf-7314829b6feb tempest-ProjectReaderTests-329876153 None] Created volume successfully.
Nov 05 19:27:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-25f797b9-2fac-4ddf-ac6c-b89016b42739 tempest-ProjectMemberTests-1640873908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-25f797b9-2fac-4ddf-ac6c-b89016b42739 tempest-ProjectMemberTests-1640873908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:21 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-25f797b9-2fac-4ddf-ac6c-b89016b42739 tempest-ProjectMemberTests-1640873908 None] Creating offline snapshot 5a877d62-66fc-4c76-884f-c048dd1a1399 of volume a9617559-9f3e-41ff-bc88-704ed22a3132 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:27:21 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[27187811-0f3f-4f64-9303-a2884ac5ca78]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-25f797b9-2fac-4ddf-ac6c-b89016b42739 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:21 devstack sudo[105637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132
Nov 05 19:27:21 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:21 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-25f797b9-2fac-4ddf-ac6c-b89016b42739 tempest-ProjectMemberTests-1640873908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132" returned: 0 in 0.379s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-25f797b9-2fac-4ddf-ac6c-b89016b42739 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132.5a877d62-66fc-4c76-884f-c048dd1a1399 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:21 devstack sudo[105642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132.5a877d62-66fc-4c76-884f-c048dd1a1399 1G
Nov 05 19:27:21 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:22 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-25f797b9-2fac-4ddf-ac6c-b89016b42739 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132.5a877d62-66fc-4c76-884f-c048dd1a1399 1G" returned: 0 in 0.496s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-25f797b9-2fac-4ddf-ac6c-b89016b42739 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9617559-9f3e-41ff-bc88-704ed22a3132 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132.5a877d62-66fc-4c76-884f-c048dd1a1399 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:22 devstack sudo[105648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9617559-9f3e-41ff-bc88-704ed22a3132 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132.5a877d62-66fc-4c76-884f-c048dd1a1399
Nov 05 19:27:22 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:22 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9563cfe5-a29d-421c-a505-ac3b37fbaa3e tempest-ProjectReaderTests-329876153 None] Acquiring lock "cinder-1578b350-9d6e-4e22-a752-db97506f8432-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:22 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9563cfe5-a29d-421c-a505-ac3b37fbaa3e tempest-ProjectReaderTests-329876153 None] Lock "cinder-1578b350-9d6e-4e22-a752-db97506f8432-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:22 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=253,cinder:UPDATE=355,cinder:DELETE=33,cinder:INSERT=86 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:27:22 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9563cfe5-a29d-421c-a505-ac3b37fbaa3e tempest-ProjectReaderTests-329876153 None] Acquiring lock "cinder-quobyte-1578b350-9d6e-4e22-a752-db97506f8432" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:22 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9563cfe5-a29d-421c-a505-ac3b37fbaa3e tempest-ProjectReaderTests-329876153 None] Lock "cinder-quobyte-1578b350-9d6e-4e22-a752-db97506f8432" acquired by "delete_volume" :: waited 0.037s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:22 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[560bf4b8-91f5-469e-90dc-febb75d41510]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9563cfe5-a29d-421c-a505-ac3b37fbaa3e tempest-ProjectReaderTests-329876153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-1578b350-9d6e-4e22-a752-db97506f8432 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:22 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-25f797b9-2fac-4ddf-ac6c-b89016b42739 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9617559-9f3e-41ff-bc88-704ed22a3132 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132.5a877d62-66fc-4c76-884f-c048dd1a1399" returned: 0 in 0.363s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:22 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-25f797b9-2fac-4ddf-ac6c-b89016b42739 tempest-ProjectMemberTests-1640873908 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132.5a877d62-66fc-4c76-884f-c048dd1a1399 is being set with open permissions: ugo+rw
Nov 05 19:27:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-25f797b9-2fac-4ddf-ac6c-b89016b42739 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132.5a877d62-66fc-4c76-884f-c048dd1a1399 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:22 devstack sudo[105650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-1578b350-9d6e-4e22-a752-db97506f8432
Nov 05 19:27:22 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:22 devstack sudo[105656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132.5a877d62-66fc-4c76-884f-c048dd1a1399
Nov 05 19:27:22 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:23 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-25f797b9-2fac-4ddf-ac6c-b89016b42739 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132.5a877d62-66fc-4c76-884f-c048dd1a1399" returned: 0 in 0.253s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:23 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:UPDATE=327,cinder:SELECT=240,cinder:INSERT=86,cinder:DELETE=28 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:27:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-25f797b9-2fac-4ddf-ac6c-b89016b42739 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:23 devstack sudo[105663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132.info
Nov 05 19:27:23 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:23 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9563cfe5-a29d-421c-a505-ac3b37fbaa3e tempest-ProjectReaderTests-329876153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-1578b350-9d6e-4e22-a752-db97506f8432" returned: 0 in 0.475s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9563cfe5-a29d-421c-a505-ac3b37fbaa3e tempest-ProjectReaderTests-329876153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-1578b350-9d6e-4e22-a752-db97506f8432 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:23 devstack sudo[105665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-1578b350-9d6e-4e22-a752-db97506f8432
Nov 05 19:27:23 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:23 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-25f797b9-2fac-4ddf-ac6c-b89016b42739 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132.info" returned: 0 in 0.358s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:23 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-25f797b9-2fac-4ddf-ac6c-b89016b42739 tempest-ProjectMemberTests-1640873908 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132.info is being set with open permissions: ugo+rw
Nov 05 19:27:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-25f797b9-2fac-4ddf-ac6c-b89016b42739 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:23 devstack sudo[105668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132.info
Nov 05 19:27:23 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:23 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9563cfe5-a29d-421c-a505-ac3b37fbaa3e tempest-ProjectReaderTests-329876153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-1578b350-9d6e-4e22-a752-db97506f8432" returned: 0 in 0.396s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:23 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9563cfe5-a29d-421c-a505-ac3b37fbaa3e tempest-ProjectReaderTests-329876153 None] Lock "cinder-quobyte-1578b350-9d6e-4e22-a752-db97506f8432" released by "delete_volume" :: held 0.936s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:23 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-9563cfe5-a29d-421c-a505-ac3b37fbaa3e tempest-ProjectReaderTests-329876153 None] Created reservations ['c778bcd7-96be-4a77-8a24-a21e449c1f7a', 'd4f48b66-5f3d-4b7d-a922-7c26d72e2ac6', '3924141c-0913-4fe2-abbf-f17145f272c0', '7fa76987-9092-4bb9-8c0e-6f516fe43151'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:27:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9563cfe5-a29d-421c-a505-ac3b37fbaa3e tempest-ProjectReaderTests-329876153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9563cfe5-a29d-421c-a505-ac3b37fbaa3e tempest-ProjectReaderTests-329876153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9563cfe5-a29d-421c-a505-ac3b37fbaa3e tempest-ProjectReaderTests-329876153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:27:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-9563cfe5-a29d-421c-a505-ac3b37fbaa3e tempest-ProjectReaderTests-329876153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:27:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-9563cfe5-a29d-421c-a505-ac3b37fbaa3e tempest-ProjectReaderTests-329876153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9563cfe5-a29d-421c-a505-ac3b37fbaa3e tempest-ProjectReaderTests-329876153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:23 devstack sudo[105672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:27:23 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:23 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-25f797b9-2fac-4ddf-ac6c-b89016b42739 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132.info" returned: 0 in 0.353s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-25f797b9-2fac-4ddf-ac6c-b89016b42739 tempest-ProjectMemberTests-1640873908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.314s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:23 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-25f797b9-2fac-4ddf-ac6c-b89016b42739 tempest-ProjectMemberTests-1640873908 None] Create snapshot completed successfully
Nov 05 19:27:23 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9563cfe5-a29d-421c-a505-ac3b37fbaa3e tempest-ProjectReaderTests-329876153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.285s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:23 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-9563cfe5-a29d-421c-a505-ac3b37fbaa3e tempest-ProjectReaderTests-329876153 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:27:23 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-9563cfe5-a29d-421c-a505-ac3b37fbaa3e tempest-ProjectReaderTests-329876153 None] Deleted volume successfully.
Nov 05 19:27:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9563cfe5-a29d-421c-a505-ac3b37fbaa3e tempest-ProjectReaderTests-329876153 None] Lock "cinder-1578b350-9d6e-4e22-a752-db97506f8432-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4ccafa1c-c413-41b2-bbd9-45dc1a05c6ed tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-5a877d62-66fc-4c76-884f-c048dd1a1399-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4ccafa1c-c413-41b2-bbd9-45dc1a05c6ed tempest-ProjectMemberTests-1640873908 None] Lock "cinder-5a877d62-66fc-4c76-884f-c048dd1a1399-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4ccafa1c-c413-41b2-bbd9-45dc1a05c6ed tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-quobyte-a9617559-9f3e-41ff-bc88-704ed22a3132" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4ccafa1c-c413-41b2-bbd9-45dc1a05c6ed tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-a9617559-9f3e-41ff-bc88-704ed22a3132" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4ccafa1c-c413-41b2-bbd9-45dc1a05c6ed tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-quobyte-5a877d62-66fc-4c76-884f-c048dd1a1399" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:24 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4ccafa1c-c413-41b2-bbd9-45dc1a05c6ed tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-5a877d62-66fc-4c76-884f-c048dd1a1399" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-4ccafa1c-c413-41b2-bbd9-45dc1a05c6ed tempest-ProjectMemberTests-1640873908 None] Deleting offline snapshot 5a877d62-66fc-4c76-884f-c048dd1a1399 of volume a9617559-9f3e-41ff-bc88-704ed22a3132 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:27:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-4ccafa1c-c413-41b2-bbd9-45dc1a05c6ed tempest-ProjectMemberTests-1640873908 None] snapshot_file for this snap is: volume-a9617559-9f3e-41ff-bc88-704ed22a3132.5a877d62-66fc-4c76-884f-c048dd1a1399 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:27:24 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc31c7f-1da9-4404-a4d2-07e98fd4c05d]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4ccafa1c-c413-41b2-bbd9-45dc1a05c6ed tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132.5a877d62-66fc-4c76-884f-c048dd1a1399 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:25 devstack sudo[105675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132.5a877d62-66fc-4c76-884f-c048dd1a1399
Nov 05 19:27:25 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:25 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4ccafa1c-c413-41b2-bbd9-45dc1a05c6ed tempest-ProjectMemberTests-1640873908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132.5a877d62-66fc-4c76-884f-c048dd1a1399" returned: 0 in 0.428s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-4ccafa1c-c413-41b2-bbd9-45dc1a05c6ed tempest-ProjectMemberTests-1640873908 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9617559-9f3e-41ff-bc88-704ed22a3132(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:27:25 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e35863-64a7-4917-88c5-7aa8f2f61602]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4ccafa1c-c413-41b2-bbd9-45dc1a05c6ed tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:25 devstack sudo[105684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132
Nov 05 19:27:25 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:25 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4ccafa1c-c413-41b2-bbd9-45dc1a05c6ed tempest-ProjectMemberTests-1640873908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132" returned: 0 in 0.505s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4ccafa1c-c413-41b2-bbd9-45dc1a05c6ed tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132.5a877d62-66fc-4c76-884f-c048dd1a1399 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:25 devstack sudo[105689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132.5a877d62-66fc-4c76-884f-c048dd1a1399
Nov 05 19:27:25 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:26 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4ccafa1c-c413-41b2-bbd9-45dc1a05c6ed tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132.5a877d62-66fc-4c76-884f-c048dd1a1399" returned: 0 in 0.383s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4ccafa1c-c413-41b2-bbd9-45dc1a05c6ed tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132.5a877d62-66fc-4c76-884f-c048dd1a1399 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:26 devstack sudo[105695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132.5a877d62-66fc-4c76-884f-c048dd1a1399
Nov 05 19:27:26 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:26 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4ccafa1c-c413-41b2-bbd9-45dc1a05c6ed tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132.5a877d62-66fc-4c76-884f-c048dd1a1399" returned: 0 in 0.304s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4ccafa1c-c413-41b2-bbd9-45dc1a05c6ed tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-5a877d62-66fc-4c76-884f-c048dd1a1399" released by "_delete_snapshot" :: held 1.793s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4ccafa1c-c413-41b2-bbd9-45dc1a05c6ed tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-a9617559-9f3e-41ff-bc88-704ed22a3132" released by "delete_snapshot" :: held 1.831s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:26 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:27:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Flow 'volume_create_manager' (a45ebfa0-5a6e-4932-86fe-a0055e6b573a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:27:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f61ecfa6-a93b-4906-a766-467584884667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f61ecfa6-a93b-4906-a766-467584884667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8bbb2f3-d185-4fbe-b347-24ca19e4329a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fba48c61ec14d6da48f13b84202588c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:27:27Z,use_quota=True,user_id='56d4d6af74234eca8330a4d8cfd4aec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (950e2636-a003-4c6b-a6c8-cc6154c8bc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (950e2636-a003-4c6b-a6c8-cc6154c8bc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:26 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8949dc3-6490-4b24-aa9d-a12004679fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:26 devstack cinder-volume[87184]: DEBUG cinder.image.glance [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Creating Keystone auth plugin from conf {{(pid=87184) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 19:27:26 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-4ccafa1c-c413-41b2-bbd9-45dc1a05c6ed tempest-ProjectMemberTests-1640873908 None] Created reservations ['1b50542b-158b-44f8-9e43-815c2e7eb41a', '45289458-d42f-482c-be8e-1c5a1ba98d33', '3a40b426-e37d-4053-8478-cb324d9d3be4', 'df92ef29-867a-45aa-b192-e5afda7194c6'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:27:26 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-4ccafa1c-c413-41b2-bbd9-45dc1a05c6ed tempest-ProjectMemberTests-1640873908 None] Delete snapshot completed successfully.
Nov 05 19:27:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4ccafa1c-c413-41b2-bbd9-45dc1a05c6ed tempest-ProjectMemberTests-1640873908 None] Lock "cinder-5a877d62-66fc-4c76-884f-c048dd1a1399-delete_snapshot" released by "delete_snapshot" :: held 2.085s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cb9cee9b-9157-4c87-8a90-2eb485a5d6e0 tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-a9617559-9f3e-41ff-bc88-704ed22a3132-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cb9cee9b-9157-4c87-8a90-2eb485a5d6e0 tempest-ProjectMemberTests-1640873908 None] Lock "cinder-a9617559-9f3e-41ff-bc88-704ed22a3132-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cb9cee9b-9157-4c87-8a90-2eb485a5d6e0 tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-quobyte-a9617559-9f3e-41ff-bc88-704ed22a3132" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cb9cee9b-9157-4c87-8a90-2eb485a5d6e0 tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-a9617559-9f3e-41ff-bc88-704ed22a3132" acquired by "delete_volume" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:27 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42c494e-d41e-4f4f-bf30-d728af8b705e]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cb9cee9b-9157-4c87-8a90-2eb485a5d6e0 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8949dc3-6490-4b24-aa9d-a12004679fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a8bbb2f3-d185-4fbe-b347-24ca19e4329a', 'volume_name': 'volume-a8bbb2f3-d185-4fbe-b347-24ca19e4329a', 'volume_size': 1, 'image_id': 'f63697c4-a84b-47e1-8ef2-0f592700b2f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f63697c4-a84b-47e1-8ef2-0f592700b2f9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2b04e157d388418ae1b840f2d2e95628', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6fba48c61ec14d6da48f13b84202588c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ca9fe347be56e99d0eebcc644baa56192352d535c6cbe20f99bb89fbe175467dc551b0cd744429b274511ec4030d7600bf80af7d80d68e4aef7e60035832e9aa', 'id': 'f63697c4-a84b-47e1-8ef2-0f592700b2f9', 'created_at': datetime.datetime(2026, 11, 5, 18, 27, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 18, 27, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f63697c4-a84b-47e1-8ef2-0f592700b2f9/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x736631d07f50>}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3e593a7-26fc-4d18-b032-9fb2e1bf8aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3e593a7-26fc-4d18-b032-9fb2e1bf8aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35f85787-1766-4a80-8ef9-1b0e56d92d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:27 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Volume a8bbb2f3-d185-4fbe-b347-24ca19e4329a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a8bbb2f3-d185-4fbe-b347-24ca19e4329a', 'volume_size': 1, 'image_id': 'f63697c4-a84b-47e1-8ef2-0f592700b2f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f63697c4-a84b-47e1-8ef2-0f592700b2f9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2b04e157d388418ae1b840f2d2e95628', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6fba48c61ec14d6da48f13b84202588c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ca9fe347be56e99d0eebcc644baa56192352d535c6cbe20f99bb89fbe175467dc551b0cd744429b274511ec4030d7600bf80af7d80d68e4aef7e60035832e9aa', 'id': 'f63697c4-a84b-47e1-8ef2-0f592700b2f9', 'created_at': datetime.datetime(2026, 11, 5, 18, 27, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 18, 27, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f63697c4-a84b-47e1-8ef2-0f592700b2f9/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x736631d07f50>}
Nov 05 19:27:27 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Trying to clone a8bbb2f3-d185-4fbe-b347-24ca19e4329a from image f63697c4-a84b-47e1-8ef2-0f592700b2f9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f63697c4-a84b-47e1-8ef2-0f592700b2f9', 'metadata': {}}]). {{(pid=87184) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 19:27:27 devstack sudo[105698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132
Nov 05 19:27:27 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:27 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f63697c4-a84b-47e1-8ef2-0f592700b2f9__3l9wbdmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 19:27:27 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Image download 0.00 MB at 0.00 MB/s
Nov 05 19:27:27 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08360df-c15d-47c4-b05e-1205d1d070be]: (4, 'raw') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f63697c4-a84b-47e1-8ef2-0f592700b2f9__3l9wbdmdevstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:27 devstack sudo[105701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f63697c4-a84b-47e1-8ef2-0f592700b2f9__3l9wbdmdevstack@QuobyteHD
Nov 05 19:27:27 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:27 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cb9cee9b-9157-4c87-8a90-2eb485a5d6e0 tempest-ProjectMemberTests-1640873908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132" returned: 0 in 0.613s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cb9cee9b-9157-4c87-8a90-2eb485a5d6e0 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:27 devstack sudo[105706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132
Nov 05 19:27:27 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:27 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f63697c4-a84b-47e1-8ef2-0f592700b2f9__3l9wbdmdevstack@QuobyteHD" returned: 0 in 0.421s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f63697c4-a84b-47e1-8ef2-0f592700b2f9__3l9wbdmdevstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:28 devstack sudo[105710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f63697c4-a84b-47e1-8ef2-0f592700b2f9__3l9wbdmdevstack@QuobyteHD
Nov 05 19:27:28 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:28 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cb9cee9b-9157-4c87-8a90-2eb485a5d6e0 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a9617559-9f3e-41ff-bc88-704ed22a3132" returned: 0 in 0.296s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:28 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cb9cee9b-9157-4c87-8a90-2eb485a5d6e0 tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-a9617559-9f3e-41ff-bc88-704ed22a3132" released by "delete_volume" :: held 1.018s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:28 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-cb9cee9b-9157-4c87-8a90-2eb485a5d6e0 tempest-ProjectMemberTests-1640873908 None] Created reservations ['a12b37a7-6588-46f7-b2df-c349cf6fbec6', 'c450f960-3e15-4da4-9e0d-9ba32fcc6f7f', 'e81bd523-037e-4043-be41-eb3fc4ec5262', '1d78d0d0-b290-483b-b37b-8ea8c93ea354'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:27:28 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f63697c4-a84b-47e1-8ef2-0f592700b2f9__3l9wbdmdevstack@QuobyteHD" returned: 1 in 0.421s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f63697c4-a84b-47e1-8ef2-0f592700b2f9__3l9wbdmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 19:27:28 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Temporary image f63697c4-a84b-47e1-8ef2-0f592700b2f9 is fetched for user 56d4d6af74234eca8330a4d8cfd4aec0. {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 19:27:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cb9cee9b-9157-4c87-8a90-2eb485a5d6e0 tempest-ProjectMemberTests-1640873908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cb9cee9b-9157-4c87-8a90-2eb485a5d6e0 tempest-ProjectMemberTests-1640873908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-cb9cee9b-9157-4c87-8a90-2eb485a5d6e0 tempest-ProjectMemberTests-1640873908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:27:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-cb9cee9b-9157-4c87-8a90-2eb485a5d6e0 tempest-ProjectMemberTests-1640873908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:27:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cb9cee9b-9157-4c87-8a90-2eb485a5d6e0 tempest-ProjectMemberTests-1640873908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cb9cee9b-9157-4c87-8a90-2eb485a5d6e0 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:28 devstack sudo[105716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:27:28 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:28 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af2239d-b98b-4f3e-b28a-869717e8a2bc]: (4, 'raw') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f63697c4-a84b-47e1-8ef2-0f592700b2f9__3l9wbdmdevstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:28 devstack sudo[105718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f63697c4-a84b-47e1-8ef2-0f592700b2f9__3l9wbdmdevstack@QuobyteHD
Nov 05 19:27:28 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:28 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cb9cee9b-9157-4c87-8a90-2eb485a5d6e0 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.346s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:28 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-cb9cee9b-9157-4c87-8a90-2eb485a5d6e0 tempest-ProjectMemberTests-1640873908 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:27:28 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-cb9cee9b-9157-4c87-8a90-2eb485a5d6e0 tempest-ProjectMemberTests-1640873908 None] Deleted volume successfully.
Nov 05 19:27:28 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cb9cee9b-9157-4c87-8a90-2eb485a5d6e0 tempest-ProjectMemberTests-1640873908 None] Lock "cinder-a9617559-9f3e-41ff-bc88-704ed22a3132-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:28 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f63697c4-a84b-47e1-8ef2-0f592700b2f9__3l9wbdmdevstack@QuobyteHD" returned: 0 in 0.435s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f63697c4-a84b-47e1-8ef2-0f592700b2f9__3l9wbdmdevstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:29 devstack sudo[105723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f63697c4-a84b-47e1-8ef2-0f592700b2f9__3l9wbdmdevstack@QuobyteHD
Nov 05 19:27:29 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:29 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f63697c4-a84b-47e1-8ef2-0f592700b2f9__3l9wbdmdevstack@QuobyteHD" returned: 1 in 0.353s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f63697c4-a84b-47e1-8ef2-0f592700b2f9__3l9wbdmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 19:27:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:29 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8bbb2f3-d185-4fbe-b347-24ca19e4329a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fba48c61ec14d6da48f13b84202588c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:27:27Z,use_quota=True,user_id='56d4d6af74234eca8330a4d8cfd4aec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:27:29 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Creating volume a8bbb2f3-d185-4fbe-b347-24ca19e4329a {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:27:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:29 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:27:29 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:27:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:29 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:27:29 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:27:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a8bbb2f3-d185-4fbe-b347-24ca19e4329a 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:29 devstack sudo[105728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a8bbb2f3-d185-4fbe-b347-24ca19e4329a 1073741824
Nov 05 19:27:29 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:29 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3d2700d-4896-4949-9052-b4cf60f1da26 tempest-ProjectMemberTests-1640873908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:27:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f3d2700d-4896-4949-9052-b4cf60f1da26 tempest-ProjectMemberTests-1640873908 None] Flow 'volume_create_manager' (b16ae9f3-db1c-492a-95a4-e7016a8fae35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:27:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f3d2700d-4896-4949-9052-b4cf60f1da26 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f6967f4-c2c0-41bf-8ad1-c2cbbe5d458d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f3d2700d-4896-4949-9052-b4cf60f1da26 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f6967f4-c2c0-41bf-8ad1-c2cbbe5d458d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-547395807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1fabf44-f04d-40e4-8f84-279eb8539e5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d5b238d03346c2b35a48086a4ecc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:27:30Z,use_quota=True,user_id='9c94d9844c6446c58716ae4b34ced8c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f3d2700d-4896-4949-9052-b4cf60f1da26 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d69cc2fb-a71f-4f28-b806-b555db3faec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:29 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f3d2700d-4896-4949-9052-b4cf60f1da26 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d69cc2fb-a71f-4f28-b806-b555db3faec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f3d2700d-4896-4949-9052-b4cf60f1da26 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9ffdcd8-2b37-44f1-a717-4c0492333f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f3d2700d-4896-4949-9052-b4cf60f1da26 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9ffdcd8-2b37-44f1-a717-4c0492333f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1fabf44-f04d-40e4-8f84-279eb8539e5e', 'volume_name': 'volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f3d2700d-4896-4949-9052-b4cf60f1da26 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6491eda4-4c43-4fdb-96f5-ef1b327cbd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f3d2700d-4896-4949-9052-b4cf60f1da26 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6491eda4-4c43-4fdb-96f5-ef1b327cbd16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:29 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f3d2700d-4896-4949-9052-b4cf60f1da26 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7fde96e-0ae7-4e43-8d99-0a16c38663e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:29 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-f3d2700d-4896-4949-9052-b4cf60f1da26 tempest-ProjectMemberTests-1640873908 None] Volume f1fabf44-f04d-40e4-8f84-279eb8539e5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e', 'volume_size': 1}
Nov 05 19:27:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f3d2700d-4896-4949-9052-b4cf60f1da26 tempest-ProjectMemberTests-1640873908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a8bbb2f3-d185-4fbe-b347-24ca19e4329a 1073741824" returned: 0 in 0.680s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a8bbb2f3-d185-4fbe-b347-24ca19e4329a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:30 devstack sudo[105734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a8bbb2f3-d185-4fbe-b347-24ca19e4329a
Nov 05 19:27:30 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:30 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a8bbb2f3-d185-4fbe-b347-24ca19e4329a" returned: 0 in 0.284s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:30 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:27:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f3d2700d-4896-4949-9052-b4cf60f1da26 tempest-ProjectMemberTests-1640873908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.327s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:30 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f3d2700d-4896-4949-9052-b4cf60f1da26 tempest-ProjectMemberTests-1640873908 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-547395807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1fabf44-f04d-40e4-8f84-279eb8539e5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d5b238d03346c2b35a48086a4ecc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:27:30Z,use_quota=True,user_id='9c94d9844c6446c58716ae4b34ced8c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:27:30 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-f3d2700d-4896-4949-9052-b4cf60f1da26 tempest-ProjectMemberTests-1640873908 None] Creating volume f1fabf44-f04d-40e4-8f84-279eb8539e5e {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:27:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f3d2700d-4896-4949-9052-b4cf60f1da26 tempest-ProjectMemberTests-1640873908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f3d2700d-4896-4949-9052-b4cf60f1da26 tempest-ProjectMemberTests-1640873908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:30 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f3d2700d-4896-4949-9052-b4cf60f1da26 tempest-ProjectMemberTests-1640873908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:27:30 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f3d2700d-4896-4949-9052-b4cf60f1da26 tempest-ProjectMemberTests-1640873908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:27:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f3d2700d-4896-4949-9052-b4cf60f1da26 tempest-ProjectMemberTests-1640873908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:30 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f3d2700d-4896-4949-9052-b4cf60f1da26 tempest-ProjectMemberTests-1640873908 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:27:30 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-f3d2700d-4896-4949-9052-b4cf60f1da26 tempest-ProjectMemberTests-1640873908 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:27:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f3d2700d-4896-4949-9052-b4cf60f1da26 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:30 devstack sudo[105737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e 1073741824
Nov 05 19:27:30 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:30 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Attempting download of f63697c4-a84b-47e1-8ef2-0f592700b2f9 ((None, [{'url': 'file:///opt/stack/data/glance/images/f63697c4-a84b-47e1-8ef2-0f592700b2f9', 'metadata': {}}])) to volume a8bbb2f3-d185-4fbe-b347-24ca19e4329a. {{(pid=87184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 19:27:30 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[64414de8-92a3-4fca-afb5-e8468aaf3453]: (4, 'raw') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f63697c4-a84b-47e1-8ef2-0f592700b2f9_1i5sddtu {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:30 devstack sudo[105739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f63697c4-a84b-47e1-8ef2-0f592700b2f9_1i5sddtu
Nov 05 19:27:30 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:30 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f63697c4-a84b-47e1-8ef2-0f592700b2f9_1i5sddtu" returned: 0 in 0.417s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f63697c4-a84b-47e1-8ef2-0f592700b2f9_1i5sddtu {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:30 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f3d2700d-4896-4949-9052-b4cf60f1da26 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e 1073741824" returned: 0 in 0.626s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f3d2700d-4896-4949-9052-b4cf60f1da26 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:30 devstack sudo[105747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f63697c4-a84b-47e1-8ef2-0f592700b2f9_1i5sddtu
Nov 05 19:27:30 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:31 devstack sudo[105749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e
Nov 05 19:27:31 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:31 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f63697c4-a84b-47e1-8ef2-0f592700b2f9_1i5sddtu" returned: 1 in 0.378s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f63697c4-a84b-47e1-8ef2-0f592700b2f9_1i5sddtu' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 19:27:31 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e7aa5a-b82d-4899-8e11-5df222b95bf8]: (4, 'raw') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f63697c4-a84b-47e1-8ef2-0f592700b2f9__3l9wbdmdevstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:31 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f3d2700d-4896-4949-9052-b4cf60f1da26 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e" returned: 0 in 0.348s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f3d2700d-4896-4949-9052-b4cf60f1da26 tempest-ProjectMemberTests-1640873908 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:27:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f3d2700d-4896-4949-9052-b4cf60f1da26 tempest-ProjectMemberTests-1640873908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:31 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f3d2700d-4896-4949-9052-b4cf60f1da26 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7fde96e-0ae7-4e43-8d99-0a16c38663e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:31 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f3d2700d-4896-4949-9052-b4cf60f1da26 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f24c460-5feb-4b9b-8d20-520b0afe2ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:31 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-f3d2700d-4896-4949-9052-b4cf60f1da26 tempest-ProjectMemberTests-1640873908 None] Volume volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e (f1fabf44-f04d-40e4-8f84-279eb8539e5e): created successfully
Nov 05 19:27:31 devstack sudo[105753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f63697c4-a84b-47e1-8ef2-0f592700b2f9__3l9wbdmdevstack@QuobyteHD
Nov 05 19:27:31 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:31 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f3d2700d-4896-4949-9052-b4cf60f1da26 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f24c460-5feb-4b9b-8d20-520b0afe2ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:31 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f3d2700d-4896-4949-9052-b4cf60f1da26 tempest-ProjectMemberTests-1640873908 None] Flow 'volume_create_manager' (b16ae9f3-db1c-492a-95a4-e7016a8fae35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:27:31 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f3d2700d-4896-4949-9052-b4cf60f1da26 tempest-ProjectMemberTests-1640873908 None] Created volume successfully.
Nov 05 19:27:31 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f63697c4-a84b-47e1-8ef2-0f592700b2f9__3l9wbdmdevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f63697c4-a84b-47e1-8ef2-0f592700b2f9__3l9wbdmdevstack@QuobyteHD {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:31 devstack sudo[105758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f63697c4-a84b-47e1-8ef2-0f592700b2f9__3l9wbdmdevstack@QuobyteHD
Nov 05 19:27:31 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:32 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f63697c4-a84b-47e1-8ef2-0f592700b2f9__3l9wbdmdevstack@QuobyteHD" returned: 1 in 0.403s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f63697c4-a84b-47e1-8ef2-0f592700b2f9__3l9wbdmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 19:27:32 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] f63697c4-a84b-47e1-8ef2-0f592700b2f9 was raw, converting to qcow2 {{(pid=87184) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 19:27:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f63697c4-a84b-47e1-8ef2-0f592700b2f9__3l9wbdmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a8bbb2f3-d185-4fbe-b347-24ca19e4329a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:32 devstack sudo[105763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f63697c4-a84b-47e1-8ef2-0f592700b2f9__3l9wbdmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a8bbb2f3-d185-4fbe-b347-24ca19e4329a
Nov 05 19:27:32 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-85317fb6-b71c-4647-86db-0bb5fc633d7c tempest-ProjectMemberTests-1640873908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-85317fb6-b71c-4647-86db-0bb5fc633d7c tempest-ProjectMemberTests-1640873908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-85317fb6-b71c-4647-86db-0bb5fc633d7c tempest-ProjectMemberTests-1640873908 None] Creating offline snapshot b3e87285-39d3-4464-8aa0-0d56f73694ee of volume f1fabf44-f04d-40e4-8f84-279eb8539e5e {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:27:32 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d262344-8aaa-4d26-b5ff-e0e0fcaef7e4]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-85317fb6-b71c-4647-86db-0bb5fc633d7c tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:32 devstack sudo[105768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e
Nov 05 19:27:32 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:32 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f63697c4-a84b-47e1-8ef2-0f592700b2f9__3l9wbdmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a8bbb2f3-d185-4fbe-b347-24ca19e4329a" returned: 0 in 0.677s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:32 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f63697c4-a84b-47e1-8ef2-0f592700b2f9__3l9wbdmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a8bbb2f3-d185-4fbe-b347-24ca19e4329a {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 19:27:32 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Converted 0.00 MB image at 0.00 MB/s
Nov 05 19:27:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a8bbb2f3-d185-4fbe-b347-24ca19e4329a 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:32 devstack sudo[105770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a8bbb2f3-d185-4fbe-b347-24ca19e4329a 1G
Nov 05 19:27:32 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:32 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-85317fb6-b71c-4647-86db-0bb5fc633d7c tempest-ProjectMemberTests-1640873908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e" returned: 0 in 0.529s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-85317fb6-b71c-4647-86db-0bb5fc633d7c tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e.b3e87285-39d3-4464-8aa0-0d56f73694ee 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:32 devstack sudo[105776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e.b3e87285-39d3-4464-8aa0-0d56f73694ee 1G
Nov 05 19:27:32 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:33 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a8bbb2f3-d185-4fbe-b347-24ca19e4329a 1G" returned: 0 in 0.426s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:33 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Downloaded image f63697c4-a84b-47e1-8ef2-0f592700b2f9 ((None, [{'url': 'file:///opt/stack/data/glance/images/f63697c4-a84b-47e1-8ef2-0f592700b2f9', 'metadata': {}}])) to volume a8bbb2f3-d185-4fbe-b347-24ca19e4329a successfully. {{(pid=87184) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 19:27:33 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Temporary image f63697c4-a84b-47e1-8ef2-0f592700b2f9 for user 56d4d6af74234eca8330a4d8cfd4aec0 is deleted. {{(pid=87184) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 19:27:33 devstack cinder-volume[87184]: DEBUG cinder.volume.volume_utils [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Marking volume a8bbb2f3-d185-4fbe-b347-24ca19e4329a as bootable. {{(pid=87184) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 19:27:33 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Copying metadata from image f63697c4-a84b-47e1-8ef2-0f592700b2f9 to a8bbb2f3-d185-4fbe-b347-24ca19e4329a. {{(pid=87184) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 19:27:33 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Creating volume glance metadata for volume a8bbb2f3-d185-4fbe-b347-24ca19e4329a backed by image f63697c4-a84b-47e1-8ef2-0f592700b2f9 with: {'image_id': 'f63697c4-a84b-47e1-8ef2-0f592700b2f9', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '2b04e157d388418ae1b840f2d2e95628', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87184) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 19:27:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35f85787-1766-4a80-8ef9-1b0e56d92d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8bbb2f3-d185-4fbe-b347-24ca19e4329a', 'volume_size': 1, 'image_id': 'f63697c4-a84b-47e1-8ef2-0f592700b2f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f63697c4-a84b-47e1-8ef2-0f592700b2f9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2b04e157d388418ae1b840f2d2e95628', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6fba48c61ec14d6da48f13b84202588c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ca9fe347be56e99d0eebcc644baa56192352d535c6cbe20f99bb89fbe175467dc551b0cd744429b274511ec4030d7600bf80af7d80d68e4aef7e60035832e9aa', 'id': 'f63697c4-a84b-47e1-8ef2-0f592700b2f9', 'created_at': datetime.datetime(2026, 11, 5, 18, 27, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 18, 27, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f63697c4-a84b-47e1-8ef2-0f592700b2f9/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x736631d07f50>}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c46a893-ca85-434f-9ee9-10c5aa7e7baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:33 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Volume volume-a8bbb2f3-d185-4fbe-b347-24ca19e4329a (a8bbb2f3-d185-4fbe-b347-24ca19e4329a): created successfully
Nov 05 19:27:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c46a893-ca85-434f-9ee9-10c5aa7e7baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Flow 'volume_create_manager' (a45ebfa0-5a6e-4932-86fe-a0055e6b573a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:27:33 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-2815e968-87b6-4ddb-9bea-896b4048c9ca tempest-VolumeImageDependencyTests-978890797 None] Created volume successfully.
Nov 05 19:27:33 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-85317fb6-b71c-4647-86db-0bb5fc633d7c tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e.b3e87285-39d3-4464-8aa0-0d56f73694ee 1G" returned: 0 in 0.563s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-85317fb6-b71c-4647-86db-0bb5fc633d7c tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e.b3e87285-39d3-4464-8aa0-0d56f73694ee {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:33 devstack sudo[105785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e.b3e87285-39d3-4464-8aa0-0d56f73694ee
Nov 05 19:27:33 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:33 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-85317fb6-b71c-4647-86db-0bb5fc633d7c tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e.b3e87285-39d3-4464-8aa0-0d56f73694ee" returned: 0 in 0.331s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:33 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-85317fb6-b71c-4647-86db-0bb5fc633d7c tempest-ProjectMemberTests-1640873908 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e.b3e87285-39d3-4464-8aa0-0d56f73694ee is being set with open permissions: ugo+rw
Nov 05 19:27:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-85317fb6-b71c-4647-86db-0bb5fc633d7c tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e.b3e87285-39d3-4464-8aa0-0d56f73694ee {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:33 devstack sudo[105790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e.b3e87285-39d3-4464-8aa0-0d56f73694ee
Nov 05 19:27:33 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:34 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-85317fb6-b71c-4647-86db-0bb5fc633d7c tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e.b3e87285-39d3-4464-8aa0-0d56f73694ee" returned: 0 in 0.270s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-85317fb6-b71c-4647-86db-0bb5fc633d7c tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:34 devstack sudo[105793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e.info
Nov 05 19:27:34 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7748c738-c136-424a-91b5-226b25e14bc7 tempest-VolumeImageDependencyTests-978890797 None] Acquiring lock "cinder-a8bbb2f3-d185-4fbe-b347-24ca19e4329a-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7748c738-c136-424a-91b5-226b25e14bc7 tempest-VolumeImageDependencyTests-978890797 None] Lock "cinder-a8bbb2f3-d185-4fbe-b347-24ca19e4329a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7748c738-c136-424a-91b5-226b25e14bc7 tempest-VolumeImageDependencyTests-978890797 None] Acquiring lock "cinder-quobyte-a8bbb2f3-d185-4fbe-b347-24ca19e4329a" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7748c738-c136-424a-91b5-226b25e14bc7 tempest-VolumeImageDependencyTests-978890797 None] Lock "cinder-quobyte-a8bbb2f3-d185-4fbe-b347-24ca19e4329a" acquired by "delete_volume" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:34 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[36688a31-62cf-4123-a52d-ee9a0736906e]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7748c738-c136-424a-91b5-226b25e14bc7 tempest-VolumeImageDependencyTests-978890797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a8bbb2f3-d185-4fbe-b347-24ca19e4329a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:34 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-85317fb6-b71c-4647-86db-0bb5fc633d7c tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e.info" returned: 0 in 0.427s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:34 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-85317fb6-b71c-4647-86db-0bb5fc633d7c tempest-ProjectMemberTests-1640873908 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e.info is being set with open permissions: ugo+rw
Nov 05 19:27:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-85317fb6-b71c-4647-86db-0bb5fc633d7c tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:34 devstack sudo[105795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a8bbb2f3-d185-4fbe-b347-24ca19e4329a
Nov 05 19:27:34 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:34 devstack sudo[105797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e.info
Nov 05 19:27:34 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:34 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-85317fb6-b71c-4647-86db-0bb5fc633d7c tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e.info" returned: 0 in 0.282s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:34 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-85317fb6-b71c-4647-86db-0bb5fc633d7c tempest-ProjectMemberTests-1640873908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.560s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7748c738-c136-424a-91b5-226b25e14bc7 tempest-VolumeImageDependencyTests-978890797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a8bbb2f3-d185-4fbe-b347-24ca19e4329a" returned: 0 in 0.429s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7748c738-c136-424a-91b5-226b25e14bc7 tempest-VolumeImageDependencyTests-978890797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a8bbb2f3-d185-4fbe-b347-24ca19e4329a {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:34 devstack sudo[105804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a8bbb2f3-d185-4fbe-b347-24ca19e4329a
Nov 05 19:27:34 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:34 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-85317fb6-b71c-4647-86db-0bb5fc633d7c tempest-ProjectMemberTests-1640873908 None] Create snapshot completed successfully
Nov 05 19:27:35 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7748c738-c136-424a-91b5-226b25e14bc7 tempest-VolumeImageDependencyTests-978890797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-a8bbb2f3-d185-4fbe-b347-24ca19e4329a" returned: 0 in 0.284s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7748c738-c136-424a-91b5-226b25e14bc7 tempest-VolumeImageDependencyTests-978890797 None] Lock "cinder-quobyte-a8bbb2f3-d185-4fbe-b347-24ca19e4329a" released by "delete_volume" :: held 0.778s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:35 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-7748c738-c136-424a-91b5-226b25e14bc7 tempest-VolumeImageDependencyTests-978890797 None] Created reservations ['173bc8f2-e1eb-4c33-82eb-25683a8f9cb8', 'bff03809-8e9c-417d-a0b5-698fb51b0a5b', 'a2b9401d-5af3-4d17-9961-4f66abb7d428', '29557e38-655b-4fb0-b401-b57837d29782'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:27:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7748c738-c136-424a-91b5-226b25e14bc7 tempest-VolumeImageDependencyTests-978890797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7748c738-c136-424a-91b5-226b25e14bc7 tempest-VolumeImageDependencyTests-978890797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7748c738-c136-424a-91b5-226b25e14bc7 tempest-VolumeImageDependencyTests-978890797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:27:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-7748c738-c136-424a-91b5-226b25e14bc7 tempest-VolumeImageDependencyTests-978890797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:27:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7748c738-c136-424a-91b5-226b25e14bc7 tempest-VolumeImageDependencyTests-978890797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7748c738-c136-424a-91b5-226b25e14bc7 tempest-VolumeImageDependencyTests-978890797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:35 devstack sudo[105807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:27:35 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-653229b2-1fbf-49f4-a8f4-a2ddef1dd75f tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-b3e87285-39d3-4464-8aa0-0d56f73694ee-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-653229b2-1fbf-49f4-a8f4-a2ddef1dd75f tempest-ProjectMemberTests-1640873908 None] Lock "cinder-b3e87285-39d3-4464-8aa0-0d56f73694ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-653229b2-1fbf-49f4-a8f4-a2ddef1dd75f tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-quobyte-f1fabf44-f04d-40e4-8f84-279eb8539e5e" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-653229b2-1fbf-49f4-a8f4-a2ddef1dd75f tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-f1fabf44-f04d-40e4-8f84-279eb8539e5e" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-653229b2-1fbf-49f4-a8f4-a2ddef1dd75f tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-quobyte-b3e87285-39d3-4464-8aa0-0d56f73694ee" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-653229b2-1fbf-49f4-a8f4-a2ddef1dd75f tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-b3e87285-39d3-4464-8aa0-0d56f73694ee" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-653229b2-1fbf-49f4-a8f4-a2ddef1dd75f tempest-ProjectMemberTests-1640873908 None] Deleting offline snapshot b3e87285-39d3-4464-8aa0-0d56f73694ee of volume f1fabf44-f04d-40e4-8f84-279eb8539e5e {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:27:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-653229b2-1fbf-49f4-a8f4-a2ddef1dd75f tempest-ProjectMemberTests-1640873908 None] snapshot_file for this snap is: volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e.b3e87285-39d3-4464-8aa0-0d56f73694ee {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:27:35 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[598767f5-49f5-4bf1-8bfe-750a65666266]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-653229b2-1fbf-49f4-a8f4-a2ddef1dd75f tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e.b3e87285-39d3-4464-8aa0-0d56f73694ee {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:35 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7748c738-c136-424a-91b5-226b25e14bc7 tempest-VolumeImageDependencyTests-978890797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.413s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:35 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-7748c738-c136-424a-91b5-226b25e14bc7 tempest-VolumeImageDependencyTests-978890797 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:27:35 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-7748c738-c136-424a-91b5-226b25e14bc7 tempest-VolumeImageDependencyTests-978890797 None] Deleted volume successfully.
Nov 05 19:27:35 devstack sudo[105811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e.b3e87285-39d3-4464-8aa0-0d56f73694ee
Nov 05 19:27:35 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-7748c738-c136-424a-91b5-226b25e14bc7 tempest-VolumeImageDependencyTests-978890797 None] Lock "cinder-a8bbb2f3-d185-4fbe-b347-24ca19e4329a-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:36 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-653229b2-1fbf-49f4-a8f4-a2ddef1dd75f tempest-ProjectMemberTests-1640873908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e.b3e87285-39d3-4464-8aa0-0d56f73694ee" returned: 0 in 0.550s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:36 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-653229b2-1fbf-49f4-a8f4-a2ddef1dd75f tempest-ProjectMemberTests-1640873908 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:27:36 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47b4b68-a1b2-4306-8e3f-2fc4ba0e9511]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-653229b2-1fbf-49f4-a8f4-a2ddef1dd75f tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:36 devstack sudo[105817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e
Nov 05 19:27:36 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:36 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-653229b2-1fbf-49f4-a8f4-a2ddef1dd75f tempest-ProjectMemberTests-1640873908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e" returned: 0 in 0.429s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:36 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-653229b2-1fbf-49f4-a8f4-a2ddef1dd75f tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e.b3e87285-39d3-4464-8aa0-0d56f73694ee {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:36 devstack sudo[105822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e.b3e87285-39d3-4464-8aa0-0d56f73694ee
Nov 05 19:27:36 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:37 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-653229b2-1fbf-49f4-a8f4-a2ddef1dd75f tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e.b3e87285-39d3-4464-8aa0-0d56f73694ee" returned: 0 in 0.402s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-653229b2-1fbf-49f4-a8f4-a2ddef1dd75f tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e.b3e87285-39d3-4464-8aa0-0d56f73694ee {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:37 devstack sudo[105828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e.b3e87285-39d3-4464-8aa0-0d56f73694ee
Nov 05 19:27:37 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:37 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-653229b2-1fbf-49f4-a8f4-a2ddef1dd75f tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e.b3e87285-39d3-4464-8aa0-0d56f73694ee" returned: 0 in 0.321s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-653229b2-1fbf-49f4-a8f4-a2ddef1dd75f tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-b3e87285-39d3-4464-8aa0-0d56f73694ee" released by "_delete_snapshot" :: held 1.872s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-653229b2-1fbf-49f4-a8f4-a2ddef1dd75f tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-f1fabf44-f04d-40e4-8f84-279eb8539e5e" released by "delete_snapshot" :: held 1.911s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:37 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-653229b2-1fbf-49f4-a8f4-a2ddef1dd75f tempest-ProjectMemberTests-1640873908 None] Created reservations ['53ba7126-ce73-4d8e-ac67-2ba06a354dba', '2382d333-f7fc-475c-820f-9652c8f83004', '4bf9183d-e5d6-4d15-bd21-faa003c8e06e', 'cafaa588-5683-4b46-985d-a71af8ba5045'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:27:37 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-653229b2-1fbf-49f4-a8f4-a2ddef1dd75f tempest-ProjectMemberTests-1640873908 None] Delete snapshot completed successfully.
Nov 05 19:27:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-653229b2-1fbf-49f4-a8f4-a2ddef1dd75f tempest-ProjectMemberTests-1640873908 None] Lock "cinder-b3e87285-39d3-4464-8aa0-0d56f73694ee-delete_snapshot" released by "delete_snapshot" :: held 2.117s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-965f5071-d826-4292-97d0-d847edfc8dcd tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-f1fabf44-f04d-40e4-8f84-279eb8539e5e-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-965f5071-d826-4292-97d0-d847edfc8dcd tempest-ProjectMemberTests-1640873908 None] Lock "cinder-f1fabf44-f04d-40e4-8f84-279eb8539e5e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-965f5071-d826-4292-97d0-d847edfc8dcd tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-quobyte-f1fabf44-f04d-40e4-8f84-279eb8539e5e" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-965f5071-d826-4292-97d0-d847edfc8dcd tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-f1fabf44-f04d-40e4-8f84-279eb8539e5e" acquired by "delete_volume" :: waited 0.023s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:37 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a6a54e-cc5c-494c-806a-6e78c51936d1]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-965f5071-d826-4292-97d0-d847edfc8dcd tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:38 devstack sudo[105832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e
Nov 05 19:27:38 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:38 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-965f5071-d826-4292-97d0-d847edfc8dcd tempest-ProjectMemberTests-1640873908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e" returned: 0 in 0.397s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-965f5071-d826-4292-97d0-d847edfc8dcd tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:38 devstack sudo[105837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e
Nov 05 19:27:38 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:38 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-965f5071-d826-4292-97d0-d847edfc8dcd tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-f1fabf44-f04d-40e4-8f84-279eb8539e5e" returned: 0 in 0.272s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-965f5071-d826-4292-97d0-d847edfc8dcd tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-f1fabf44-f04d-40e4-8f84-279eb8539e5e" released by "delete_volume" :: held 0.777s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:38 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-965f5071-d826-4292-97d0-d847edfc8dcd tempest-ProjectMemberTests-1640873908 None] Created reservations ['357f04a0-0613-4b8d-a125-d3e0e4cbd53a', 'f113092d-95d6-483d-a459-41bbd15f9b12', '3b08de1f-52b9-467c-aeb0-d833da68e4bd', '87e91760-50ee-49d2-8b57-a022f0f218d7'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:27:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-965f5071-d826-4292-97d0-d847edfc8dcd tempest-ProjectMemberTests-1640873908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-965f5071-d826-4292-97d0-d847edfc8dcd tempest-ProjectMemberTests-1640873908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-965f5071-d826-4292-97d0-d847edfc8dcd tempest-ProjectMemberTests-1640873908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:27:38 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-965f5071-d826-4292-97d0-d847edfc8dcd tempest-ProjectMemberTests-1640873908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:27:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-965f5071-d826-4292-97d0-d847edfc8dcd tempest-ProjectMemberTests-1640873908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-965f5071-d826-4292-97d0-d847edfc8dcd tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:38 devstack sudo[105840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:27:38 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:39 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-965f5071-d826-4292-97d0-d847edfc8dcd tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.425s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:39 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-965f5071-d826-4292-97d0-d847edfc8dcd tempest-ProjectMemberTests-1640873908 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:27:39 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-965f5071-d826-4292-97d0-d847edfc8dcd tempest-ProjectMemberTests-1640873908 None] Deleted volume successfully.
Nov 05 19:27:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-965f5071-d826-4292-97d0-d847edfc8dcd tempest-ProjectMemberTests-1640873908 None] Lock "cinder-f1fabf44-f04d-40e4-8f84-279eb8539e5e-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:39 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8b5d135-e762-4380-baa1-f1a1738e4ead tempest-ProjectMemberTests-1640873908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:27:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e8b5d135-e762-4380-baa1-f1a1738e4ead tempest-ProjectMemberTests-1640873908 None] Flow 'volume_create_manager' (ca5f6e06-0e1b-4fb5-931f-1b2d340a33e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:27:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e8b5d135-e762-4380-baa1-f1a1738e4ead tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01a8aa20-939c-4137-aa80-e95d92cb9148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e8b5d135-e762-4380-baa1-f1a1738e4ead tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01a8aa20-939c-4137-aa80-e95d92cb9148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1218168937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6edd9508-5597-432f-95ac-7ce5bc9b8d53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d5b238d03346c2b35a48086a4ecc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:27:40Z,use_quota=True,user_id='9c94d9844c6446c58716ae4b34ced8c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e8b5d135-e762-4380-baa1-f1a1738e4ead tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc82c615-3274-4746-8f22-04c4e500251e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e8b5d135-e762-4380-baa1-f1a1738e4ead tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc82c615-3274-4746-8f22-04c4e500251e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e8b5d135-e762-4380-baa1-f1a1738e4ead tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e429e69e-662d-4929-87f9-abf41ae0b52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e8b5d135-e762-4380-baa1-f1a1738e4ead tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e429e69e-662d-4929-87f9-abf41ae0b52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6edd9508-5597-432f-95ac-7ce5bc9b8d53', 'volume_name': 'volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e8b5d135-e762-4380-baa1-f1a1738e4ead tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed715125-01d2-42f4-b99c-b0d374c91e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e8b5d135-e762-4380-baa1-f1a1738e4ead tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed715125-01d2-42f4-b99c-b0d374c91e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:39 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e8b5d135-e762-4380-baa1-f1a1738e4ead tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4920c20-2733-449a-8b40-8afca0caac3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:39 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-e8b5d135-e762-4380-baa1-f1a1738e4ead tempest-ProjectMemberTests-1640873908 None] Volume 6edd9508-5597-432f-95ac-7ce5bc9b8d53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53', 'volume_size': 1}
Nov 05 19:27:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e8b5d135-e762-4380-baa1-f1a1738e4ead tempest-ProjectMemberTests-1640873908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e8b5d135-e762-4380-baa1-f1a1738e4ead tempest-ProjectMemberTests-1640873908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e8b5d135-e762-4380-baa1-f1a1738e4ead tempest-ProjectMemberTests-1640873908 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1218168937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6edd9508-5597-432f-95ac-7ce5bc9b8d53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d5b238d03346c2b35a48086a4ecc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:27:40Z,use_quota=True,user_id='9c94d9844c6446c58716ae4b34ced8c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:27:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-e8b5d135-e762-4380-baa1-f1a1738e4ead tempest-ProjectMemberTests-1640873908 None] Creating volume 6edd9508-5597-432f-95ac-7ce5bc9b8d53 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:27:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e8b5d135-e762-4380-baa1-f1a1738e4ead tempest-ProjectMemberTests-1640873908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e8b5d135-e762-4380-baa1-f1a1738e4ead tempest-ProjectMemberTests-1640873908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e8b5d135-e762-4380-baa1-f1a1738e4ead tempest-ProjectMemberTests-1640873908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:27:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e8b5d135-e762-4380-baa1-f1a1738e4ead tempest-ProjectMemberTests-1640873908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:27:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e8b5d135-e762-4380-baa1-f1a1738e4ead tempest-ProjectMemberTests-1640873908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:39 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e8b5d135-e762-4380-baa1-f1a1738e4ead tempest-ProjectMemberTests-1640873908 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:27:39 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-e8b5d135-e762-4380-baa1-f1a1738e4ead tempest-ProjectMemberTests-1640873908 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:27:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e8b5d135-e762-4380-baa1-f1a1738e4ead tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:39 devstack sudo[105849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53 1073741824
Nov 05 19:27:39 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:40 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e8b5d135-e762-4380-baa1-f1a1738e4ead tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53 1073741824" returned: 0 in 0.518s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e8b5d135-e762-4380-baa1-f1a1738e4ead tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:40 devstack sudo[105854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53
Nov 05 19:27:40 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:40 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e8b5d135-e762-4380-baa1-f1a1738e4ead tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53" returned: 0 in 0.336s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-e8b5d135-e762-4380-baa1-f1a1738e4ead tempest-ProjectMemberTests-1640873908 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:27:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e8b5d135-e762-4380-baa1-f1a1738e4ead tempest-ProjectMemberTests-1640873908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e8b5d135-e762-4380-baa1-f1a1738e4ead tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4920c20-2733-449a-8b40-8afca0caac3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e8b5d135-e762-4380-baa1-f1a1738e4ead tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (156e9611-1bca-4ece-967b-02e1b23f9968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:40 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-e8b5d135-e762-4380-baa1-f1a1738e4ead tempest-ProjectMemberTests-1640873908 None] Volume volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53 (6edd9508-5597-432f-95ac-7ce5bc9b8d53): created successfully
Nov 05 19:27:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e8b5d135-e762-4380-baa1-f1a1738e4ead tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (156e9611-1bca-4ece-967b-02e1b23f9968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:40 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-e8b5d135-e762-4380-baa1-f1a1738e4ead tempest-ProjectMemberTests-1640873908 None] Flow 'volume_create_manager' (ca5f6e06-0e1b-4fb5-931f-1b2d340a33e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:27:40 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-e8b5d135-e762-4380-baa1-f1a1738e4ead tempest-ProjectMemberTests-1640873908 None] Created volume successfully.
Nov 05 19:27:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f0ca55ab-501a-4e17-948f-722ce13d9852 tempest-ProjectMemberTests-1640873908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f0ca55ab-501a-4e17-948f-722ce13d9852 tempest-ProjectMemberTests-1640873908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:42 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-f0ca55ab-501a-4e17-948f-722ce13d9852 tempest-ProjectMemberTests-1640873908 None] Creating offline snapshot d992b962-310b-43e0-8a3d-eea1483ff862 of volume 6edd9508-5597-432f-95ac-7ce5bc9b8d53 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:27:42 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7bdfaa-b397-4b1f-a4e1-52c3748dfc6e]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f0ca55ab-501a-4e17-948f-722ce13d9852 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:42 devstack sudo[105858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53
Nov 05 19:27:42 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:42 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f0ca55ab-501a-4e17-948f-722ce13d9852 tempest-ProjectMemberTests-1640873908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53" returned: 0 in 0.448s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:42 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f0ca55ab-501a-4e17-948f-722ce13d9852 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53.d992b962-310b-43e0-8a3d-eea1483ff862 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:42 devstack sudo[105863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53.d992b962-310b-43e0-8a3d-eea1483ff862 1G
Nov 05 19:27:42 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:43 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-00bcb5e9-e69d-411c-ac3a-2da819c4188e tempest-ProjectReaderTests-472750291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:27:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-00bcb5e9-e69d-411c-ac3a-2da819c4188e tempest-ProjectReaderTests-472750291 None] Flow 'volume_create_manager' (601acf59-68ed-4f10-b5f0-919c7e40fcea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:27:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-00bcb5e9-e69d-411c-ac3a-2da819c4188e tempest-ProjectReaderTests-472750291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a293dd5-35d2-4178-9ddc-c91fdd5f4d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-00bcb5e9-e69d-411c-ac3a-2da819c4188e tempest-ProjectReaderTests-472750291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a293dd5-35d2-4178-9ddc-c91fdd5f4d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-760401016',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7494561-6ca5-4c7d-b860-a8c3145fae96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b1ea86190bb4a68bea548f167dbb954',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:27:43Z,use_quota=True,user_id='f04bba7dbc4c4da58d5b21bd9d60ab93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-00bcb5e9-e69d-411c-ac3a-2da819c4188e tempest-ProjectReaderTests-472750291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3af2a1be-d32e-4eac-8bb0-1a3616d697bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-00bcb5e9-e69d-411c-ac3a-2da819c4188e tempest-ProjectReaderTests-472750291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3af2a1be-d32e-4eac-8bb0-1a3616d697bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-00bcb5e9-e69d-411c-ac3a-2da819c4188e tempest-ProjectReaderTests-472750291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f947742a-9b32-488d-bd2e-316531469c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-00bcb5e9-e69d-411c-ac3a-2da819c4188e tempest-ProjectReaderTests-472750291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f947742a-9b32-488d-bd2e-316531469c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7494561-6ca5-4c7d-b860-a8c3145fae96', 'volume_name': 'volume-d7494561-6ca5-4c7d-b860-a8c3145fae96', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-00bcb5e9-e69d-411c-ac3a-2da819c4188e tempest-ProjectReaderTests-472750291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (004c4d63-1a1a-47c3-962b-450c9116f63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-00bcb5e9-e69d-411c-ac3a-2da819c4188e tempest-ProjectReaderTests-472750291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (004c4d63-1a1a-47c3-962b-450c9116f63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:43 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-00bcb5e9-e69d-411c-ac3a-2da819c4188e tempest-ProjectReaderTests-472750291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d5c3797-2207-46fc-a6a4-d8ec9f18c0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:43 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-00bcb5e9-e69d-411c-ac3a-2da819c4188e tempest-ProjectReaderTests-472750291 None] Volume d7494561-6ca5-4c7d-b860-a8c3145fae96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7494561-6ca5-4c7d-b860-a8c3145fae96', 'volume_size': 1}
Nov 05 19:27:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-00bcb5e9-e69d-411c-ac3a-2da819c4188e tempest-ProjectReaderTests-472750291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:43 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f0ca55ab-501a-4e17-948f-722ce13d9852 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53.d992b962-310b-43e0-8a3d-eea1483ff862 1G" returned: 0 in 0.586s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f0ca55ab-501a-4e17-948f-722ce13d9852 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53.d992b962-310b-43e0-8a3d-eea1483ff862 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:43 devstack sudo[105868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53.d992b962-310b-43e0-8a3d-eea1483ff862
Nov 05 19:27:43 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:43 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f0ca55ab-501a-4e17-948f-722ce13d9852 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53.d992b962-310b-43e0-8a3d-eea1483ff862" returned: 0 in 0.339s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:43 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-f0ca55ab-501a-4e17-948f-722ce13d9852 tempest-ProjectMemberTests-1640873908 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53.d992b962-310b-43e0-8a3d-eea1483ff862 is being set with open permissions: ugo+rw
Nov 05 19:27:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f0ca55ab-501a-4e17-948f-722ce13d9852 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53.d992b962-310b-43e0-8a3d-eea1483ff862 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:43 devstack sudo[105874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53.d992b962-310b-43e0-8a3d-eea1483ff862
Nov 05 19:27:43 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:43 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f0ca55ab-501a-4e17-948f-722ce13d9852 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53.d992b962-310b-43e0-8a3d-eea1483ff862" returned: 0 in 0.280s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:43 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f0ca55ab-501a-4e17-948f-722ce13d9852 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:43 devstack sudo[105877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53.info
Nov 05 19:27:43 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:44 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f0ca55ab-501a-4e17-948f-722ce13d9852 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53.info" returned: 0 in 0.293s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:44 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-f0ca55ab-501a-4e17-948f-722ce13d9852 tempest-ProjectMemberTests-1640873908 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53.info is being set with open permissions: ugo+rw
Nov 05 19:27:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f0ca55ab-501a-4e17-948f-722ce13d9852 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:44 devstack sudo[105880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53.info
Nov 05 19:27:44 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:44 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f0ca55ab-501a-4e17-948f-722ce13d9852 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53.info" returned: 0 in 0.286s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f0ca55ab-501a-4e17-948f-722ce13d9852 tempest-ProjectMemberTests-1640873908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.362s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-00bcb5e9-e69d-411c-ac3a-2da819c4188e tempest-ProjectReaderTests-472750291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.450s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-00bcb5e9-e69d-411c-ac3a-2da819c4188e tempest-ProjectReaderTests-472750291 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-760401016',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7494561-6ca5-4c7d-b860-a8c3145fae96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b1ea86190bb4a68bea548f167dbb954',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:27:43Z,use_quota=True,user_id='f04bba7dbc4c4da58d5b21bd9d60ab93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:27:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-00bcb5e9-e69d-411c-ac3a-2da819c4188e tempest-ProjectReaderTests-472750291 None] Creating volume d7494561-6ca5-4c7d-b860-a8c3145fae96 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:27:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-00bcb5e9-e69d-411c-ac3a-2da819c4188e tempest-ProjectReaderTests-472750291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-00bcb5e9-e69d-411c-ac3a-2da819c4188e tempest-ProjectReaderTests-472750291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-00bcb5e9-e69d-411c-ac3a-2da819c4188e tempest-ProjectReaderTests-472750291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:27:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-00bcb5e9-e69d-411c-ac3a-2da819c4188e tempest-ProjectReaderTests-472750291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:27:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-00bcb5e9-e69d-411c-ac3a-2da819c4188e tempest-ProjectReaderTests-472750291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:44 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-00bcb5e9-e69d-411c-ac3a-2da819c4188e tempest-ProjectReaderTests-472750291 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:27:44 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-00bcb5e9-e69d-411c-ac3a-2da819c4188e tempest-ProjectReaderTests-472750291 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:27:44 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-00bcb5e9-e69d-411c-ac3a-2da819c4188e tempest-ProjectReaderTests-472750291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d7494561-6ca5-4c7d-b860-a8c3145fae96 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:44 devstack sudo[105883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d7494561-6ca5-4c7d-b860-a8c3145fae96 1073741824
Nov 05 19:27:44 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:44 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f0ca55ab-501a-4e17-948f-722ce13d9852 tempest-ProjectMemberTests-1640873908 None] Create snapshot completed successfully
Nov 05 19:27:45 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-00bcb5e9-e69d-411c-ac3a-2da819c4188e tempest-ProjectReaderTests-472750291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d7494561-6ca5-4c7d-b860-a8c3145fae96 1073741824" returned: 0 in 0.552s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-00bcb5e9-e69d-411c-ac3a-2da819c4188e tempest-ProjectReaderTests-472750291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d7494561-6ca5-4c7d-b860-a8c3145fae96 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:45 devstack sudo[105889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d7494561-6ca5-4c7d-b860-a8c3145fae96
Nov 05 19:27:45 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-920c330f-b6cc-4824-8935-fd19d69e495b tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-d992b962-310b-43e0-8a3d-eea1483ff862-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-920c330f-b6cc-4824-8935-fd19d69e495b tempest-ProjectMemberTests-1640873908 None] Lock "cinder-d992b962-310b-43e0-8a3d-eea1483ff862-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-920c330f-b6cc-4824-8935-fd19d69e495b tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-quobyte-6edd9508-5597-432f-95ac-7ce5bc9b8d53" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-920c330f-b6cc-4824-8935-fd19d69e495b tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-6edd9508-5597-432f-95ac-7ce5bc9b8d53" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-920c330f-b6cc-4824-8935-fd19d69e495b tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-quobyte-d992b962-310b-43e0-8a3d-eea1483ff862" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:45 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-920c330f-b6cc-4824-8935-fd19d69e495b tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-d992b962-310b-43e0-8a3d-eea1483ff862" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-920c330f-b6cc-4824-8935-fd19d69e495b tempest-ProjectMemberTests-1640873908 None] Deleting offline snapshot d992b962-310b-43e0-8a3d-eea1483ff862 of volume 6edd9508-5597-432f-95ac-7ce5bc9b8d53 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:27:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-920c330f-b6cc-4824-8935-fd19d69e495b tempest-ProjectMemberTests-1640873908 None] snapshot_file for this snap is: volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53.d992b962-310b-43e0-8a3d-eea1483ff862 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:27:45 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-00bcb5e9-e69d-411c-ac3a-2da819c4188e tempest-ProjectReaderTests-472750291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d7494561-6ca5-4c7d-b860-a8c3145fae96" returned: 0 in 0.328s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:45 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-00bcb5e9-e69d-411c-ac3a-2da819c4188e tempest-ProjectReaderTests-472750291 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:27:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-00bcb5e9-e69d-411c-ac3a-2da819c4188e tempest-ProjectReaderTests-472750291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:45 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4105e2a8-e967-45bc-8a98-47b3076116a2]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:45 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-920c330f-b6cc-4824-8935-fd19d69e495b tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53.d992b962-310b-43e0-8a3d-eea1483ff862 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-00bcb5e9-e69d-411c-ac3a-2da819c4188e tempest-ProjectReaderTests-472750291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d5c3797-2207-46fc-a6a4-d8ec9f18c0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7494561-6ca5-4c7d-b860-a8c3145fae96', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-00bcb5e9-e69d-411c-ac3a-2da819c4188e tempest-ProjectReaderTests-472750291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54fcd786-6f08-4f29-86f1-358d246cb274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:45 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-00bcb5e9-e69d-411c-ac3a-2da819c4188e tempest-ProjectReaderTests-472750291 None] Volume volume-d7494561-6ca5-4c7d-b860-a8c3145fae96 (d7494561-6ca5-4c7d-b860-a8c3145fae96): created successfully
Nov 05 19:27:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-00bcb5e9-e69d-411c-ac3a-2da819c4188e tempest-ProjectReaderTests-472750291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54fcd786-6f08-4f29-86f1-358d246cb274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:45 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-00bcb5e9-e69d-411c-ac3a-2da819c4188e tempest-ProjectReaderTests-472750291 None] Flow 'volume_create_manager' (601acf59-68ed-4f10-b5f0-919c7e40fcea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:27:45 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-00bcb5e9-e69d-411c-ac3a-2da819c4188e tempest-ProjectReaderTests-472750291 None] Created volume successfully.
Nov 05 19:27:45 devstack sudo[105892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53.d992b962-310b-43e0-8a3d-eea1483ff862
Nov 05 19:27:45 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:46 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-920c330f-b6cc-4824-8935-fd19d69e495b tempest-ProjectMemberTests-1640873908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53.d992b962-310b-43e0-8a3d-eea1483ff862" returned: 0 in 0.589s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:46 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-920c330f-b6cc-4824-8935-fd19d69e495b tempest-ProjectMemberTests-1640873908 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:27:46 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b663426-a22f-4da8-96d5-3b6abbd40a18]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-920c330f-b6cc-4824-8935-fd19d69e495b tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:46 devstack sudo[105897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53
Nov 05 19:27:46 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:46 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-243f9b85-22fe-4bef-b543-b506444d0503 tempest-ProjectReaderTests-472750291 None] Acquiring lock "cinder-d7494561-6ca5-4c7d-b860-a8c3145fae96-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:46 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-243f9b85-22fe-4bef-b543-b506444d0503 tempest-ProjectReaderTests-472750291 None] Lock "cinder-d7494561-6ca5-4c7d-b860-a8c3145fae96-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:46 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-243f9b85-22fe-4bef-b543-b506444d0503 tempest-ProjectReaderTests-472750291 None] Acquiring lock "cinder-quobyte-d7494561-6ca5-4c7d-b860-a8c3145fae96" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:46 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-243f9b85-22fe-4bef-b543-b506444d0503 tempest-ProjectReaderTests-472750291 None] Lock "cinder-quobyte-d7494561-6ca5-4c7d-b860-a8c3145fae96" acquired by "delete_volume" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:46 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[479a2d6e-0adf-4b9f-b3e4-feb77b470de0]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-243f9b85-22fe-4bef-b543-b506444d0503 tempest-ProjectReaderTests-472750291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d7494561-6ca5-4c7d-b860-a8c3145fae96 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:46 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-920c330f-b6cc-4824-8935-fd19d69e495b tempest-ProjectMemberTests-1640873908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53" returned: 0 in 0.623s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:46 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-920c330f-b6cc-4824-8935-fd19d69e495b tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53.d992b962-310b-43e0-8a3d-eea1483ff862 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:46 devstack sudo[105903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53.d992b962-310b-43e0-8a3d-eea1483ff862
Nov 05 19:27:46 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:46 devstack sudo[105902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d7494561-6ca5-4c7d-b860-a8c3145fae96
Nov 05 19:27:46 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:47 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-243f9b85-22fe-4bef-b543-b506444d0503 tempest-ProjectReaderTests-472750291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d7494561-6ca5-4c7d-b860-a8c3145fae96" returned: 0 in 0.498s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-243f9b85-22fe-4bef-b543-b506444d0503 tempest-ProjectReaderTests-472750291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d7494561-6ca5-4c7d-b860-a8c3145fae96 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:47 devstack sudo[105912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d7494561-6ca5-4c7d-b860-a8c3145fae96
Nov 05 19:27:47 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:47 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-920c330f-b6cc-4824-8935-fd19d69e495b tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53.d992b962-310b-43e0-8a3d-eea1483ff862" returned: 0 in 0.608s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-920c330f-b6cc-4824-8935-fd19d69e495b tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53.d992b962-310b-43e0-8a3d-eea1483ff862 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:47 devstack sudo[105914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53.d992b962-310b-43e0-8a3d-eea1483ff862
Nov 05 19:27:47 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:47 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-243f9b85-22fe-4bef-b543-b506444d0503 tempest-ProjectReaderTests-472750291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-d7494561-6ca5-4c7d-b860-a8c3145fae96" returned: 0 in 0.439s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-243f9b85-22fe-4bef-b543-b506444d0503 tempest-ProjectReaderTests-472750291 None] Lock "cinder-quobyte-d7494561-6ca5-4c7d-b860-a8c3145fae96" released by "delete_volume" :: held 1.002s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:47 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-243f9b85-22fe-4bef-b543-b506444d0503 tempest-ProjectReaderTests-472750291 None] Created reservations ['d72d31bf-8b63-416d-9d10-5259825ee71c', '88c96564-4fbe-41b4-8049-e483002be07d', '2c5a5971-68eb-4393-9877-3bc01f0411da', '1d34dcfd-65b4-4ccf-b051-882f967ab120'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:27:47 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-920c330f-b6cc-4824-8935-fd19d69e495b tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53.d992b962-310b-43e0-8a3d-eea1483ff862" returned: 0 in 0.510s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-920c330f-b6cc-4824-8935-fd19d69e495b tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-d992b962-310b-43e0-8a3d-eea1483ff862" released by "_delete_snapshot" :: held 2.463s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:47 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-920c330f-b6cc-4824-8935-fd19d69e495b tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-6edd9508-5597-432f-95ac-7ce5bc9b8d53" released by "delete_snapshot" :: held 2.509s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-243f9b85-22fe-4bef-b543-b506444d0503 tempest-ProjectReaderTests-472750291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-243f9b85-22fe-4bef-b543-b506444d0503 tempest-ProjectReaderTests-472750291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-243f9b85-22fe-4bef-b543-b506444d0503 tempest-ProjectReaderTests-472750291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:27:47 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-243f9b85-22fe-4bef-b543-b506444d0503 tempest-ProjectReaderTests-472750291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:27:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-243f9b85-22fe-4bef-b543-b506444d0503 tempest-ProjectReaderTests-472750291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:47 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-243f9b85-22fe-4bef-b543-b506444d0503 tempest-ProjectReaderTests-472750291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:47 devstack sudo[105919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:27:47 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:48 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-920c330f-b6cc-4824-8935-fd19d69e495b tempest-ProjectMemberTests-1640873908 None] Created reservations ['35361e3d-5462-4987-82a2-d175b9bef4ae', 'dd577d0e-ebef-4fc4-bd5d-ac299542ef4e', '823ae266-011c-4b53-a40b-d060b2b4f550', '85c203f2-50b6-4f24-b07e-6d510c4fc98b'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:27:48 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-920c330f-b6cc-4824-8935-fd19d69e495b tempest-ProjectMemberTests-1640873908 None] Delete snapshot completed successfully.
Nov 05 19:27:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-920c330f-b6cc-4824-8935-fd19d69e495b tempest-ProjectMemberTests-1640873908 None] Lock "cinder-d992b962-310b-43e0-8a3d-eea1483ff862-delete_snapshot" released by "delete_snapshot" :: held 2.709s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:48 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-243f9b85-22fe-4bef-b543-b506444d0503 tempest-ProjectReaderTests-472750291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.348s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:48 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-243f9b85-22fe-4bef-b543-b506444d0503 tempest-ProjectReaderTests-472750291 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:27:48 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-243f9b85-22fe-4bef-b543-b506444d0503 tempest-ProjectReaderTests-472750291 None] Deleted volume successfully.
Nov 05 19:27:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-243f9b85-22fe-4bef-b543-b506444d0503 tempest-ProjectReaderTests-472750291 None] Lock "cinder-d7494561-6ca5-4c7d-b860-a8c3145fae96-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1bde9303-9121-4799-a3dd-911efa87b13e tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-6edd9508-5597-432f-95ac-7ce5bc9b8d53-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1bde9303-9121-4799-a3dd-911efa87b13e tempest-ProjectMemberTests-1640873908 None] Lock "cinder-6edd9508-5597-432f-95ac-7ce5bc9b8d53-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:48 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-a14b3796-5b22-4be8-8264-0b2aea2a1b13 tempest-ProjectReaderTests-546992118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:27:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a14b3796-5b22-4be8-8264-0b2aea2a1b13 tempest-ProjectReaderTests-546992118 None] Flow 'volume_create_manager' (d1adc273-1ca8-42b0-9a12-08c34b008be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:27:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a14b3796-5b22-4be8-8264-0b2aea2a1b13 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f21137c8-10fa-4daa-9188-c5ae60372399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a14b3796-5b22-4be8-8264-0b2aea2a1b13 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f21137c8-10fa-4daa-9188-c5ae60372399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2060850706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84f6cc97-1abc-4269-9c89-efc64ea05d4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8b6de85a1d742f78e908c889957f3d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:27:49Z,use_quota=True,user_id='60990ab9a4554795bcd64339eacaa724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a14b3796-5b22-4be8-8264-0b2aea2a1b13 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c44771e8-24a8-46b1-b041-b37b40de960b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a14b3796-5b22-4be8-8264-0b2aea2a1b13 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c44771e8-24a8-46b1-b041-b37b40de960b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a14b3796-5b22-4be8-8264-0b2aea2a1b13 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (788acd86-a1ac-4d17-a22e-c2241d1cab58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a14b3796-5b22-4be8-8264-0b2aea2a1b13 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (788acd86-a1ac-4d17-a22e-c2241d1cab58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84f6cc97-1abc-4269-9c89-efc64ea05d4b', 'volume_name': 'volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a14b3796-5b22-4be8-8264-0b2aea2a1b13 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71899026-7184-483b-93e3-a39396d2f544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a14b3796-5b22-4be8-8264-0b2aea2a1b13 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71899026-7184-483b-93e3-a39396d2f544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:48 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a14b3796-5b22-4be8-8264-0b2aea2a1b13 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49797fd5-08e8-429f-85d5-5774c7a921b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:48 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-a14b3796-5b22-4be8-8264-0b2aea2a1b13 tempest-ProjectReaderTests-546992118 None] Volume 84f6cc97-1abc-4269-9c89-efc64ea05d4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b', 'volume_size': 1}
Nov 05 19:27:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a14b3796-5b22-4be8-8264-0b2aea2a1b13 tempest-ProjectReaderTests-546992118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a14b3796-5b22-4be8-8264-0b2aea2a1b13 tempest-ProjectReaderTests-546992118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a14b3796-5b22-4be8-8264-0b2aea2a1b13 tempest-ProjectReaderTests-546992118 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2060850706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84f6cc97-1abc-4269-9c89-efc64ea05d4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8b6de85a1d742f78e908c889957f3d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:27:49Z,use_quota=True,user_id='60990ab9a4554795bcd64339eacaa724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:27:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-a14b3796-5b22-4be8-8264-0b2aea2a1b13 tempest-ProjectReaderTests-546992118 None] Creating volume 84f6cc97-1abc-4269-9c89-efc64ea05d4b {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:27:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a14b3796-5b22-4be8-8264-0b2aea2a1b13 tempest-ProjectReaderTests-546992118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a14b3796-5b22-4be8-8264-0b2aea2a1b13 tempest-ProjectReaderTests-546992118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a14b3796-5b22-4be8-8264-0b2aea2a1b13 tempest-ProjectReaderTests-546992118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:27:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a14b3796-5b22-4be8-8264-0b2aea2a1b13 tempest-ProjectReaderTests-546992118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:27:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a14b3796-5b22-4be8-8264-0b2aea2a1b13 tempest-ProjectReaderTests-546992118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:48 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a14b3796-5b22-4be8-8264-0b2aea2a1b13 tempest-ProjectReaderTests-546992118 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:27:48 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-a14b3796-5b22-4be8-8264-0b2aea2a1b13 tempest-ProjectReaderTests-546992118 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:27:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a14b3796-5b22-4be8-8264-0b2aea2a1b13 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1bde9303-9121-4799-a3dd-911efa87b13e tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-quobyte-6edd9508-5597-432f-95ac-7ce5bc9b8d53" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:48 devstack sudo[105922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b 1073741824
Nov 05 19:27:48 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1bde9303-9121-4799-a3dd-911efa87b13e tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-6edd9508-5597-432f-95ac-7ce5bc9b8d53" acquired by "delete_volume" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:48 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:48 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6057d065-0c92-4a64-b761-ba2706dbb980]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:48 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1bde9303-9121-4799-a3dd-911efa87b13e tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:49 devstack sudo[105924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53
Nov 05 19:27:49 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:49 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a14b3796-5b22-4be8-8264-0b2aea2a1b13 tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b 1073741824" returned: 0 in 0.624s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:49 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1bde9303-9121-4799-a3dd-911efa87b13e tempest-ProjectMemberTests-1640873908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53" returned: 0 in 0.547s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1bde9303-9121-4799-a3dd-911efa87b13e tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:49 devstack sudo[105934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53
Nov 05 19:27:49 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a14b3796-5b22-4be8-8264-0b2aea2a1b13 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:49 devstack sudo[105936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b
Nov 05 19:27:49 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:49 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-829f0fc2-b2a0-4d0b-b778-bdd5ae92d4bb tempest-ProjectReaderTests-472750291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:27:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-829f0fc2-b2a0-4d0b-b778-bdd5ae92d4bb tempest-ProjectReaderTests-472750291 None] Flow 'volume_create_manager' (d6b1e5ca-b5ba-43f0-8ac3-fc1a847a32da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:27:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-829f0fc2-b2a0-4d0b-b778-bdd5ae92d4bb tempest-ProjectReaderTests-472750291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d62dc365-ee2c-483f-aa3c-8139c21caa28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-829f0fc2-b2a0-4d0b-b778-bdd5ae92d4bb tempest-ProjectReaderTests-472750291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d62dc365-ee2c-483f-aa3c-8139c21caa28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1787584119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7157592d-55a4-460a-8e92-c83283a1ec7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b1ea86190bb4a68bea548f167dbb954',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:27:50Z,use_quota=True,user_id='f04bba7dbc4c4da58d5b21bd9d60ab93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-829f0fc2-b2a0-4d0b-b778-bdd5ae92d4bb tempest-ProjectReaderTests-472750291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38310362-9c3c-4432-8030-c9a80aec771a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-829f0fc2-b2a0-4d0b-b778-bdd5ae92d4bb tempest-ProjectReaderTests-472750291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38310362-9c3c-4432-8030-c9a80aec771a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-829f0fc2-b2a0-4d0b-b778-bdd5ae92d4bb tempest-ProjectReaderTests-472750291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29357819-6421-4774-9e69-93588915595b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-829f0fc2-b2a0-4d0b-b778-bdd5ae92d4bb tempest-ProjectReaderTests-472750291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29357819-6421-4774-9e69-93588915595b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7157592d-55a4-460a-8e92-c83283a1ec7b', 'volume_name': 'volume-7157592d-55a4-460a-8e92-c83283a1ec7b', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-829f0fc2-b2a0-4d0b-b778-bdd5ae92d4bb tempest-ProjectReaderTests-472750291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fbf3133-b037-43d0-b96b-8d15b47258d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-829f0fc2-b2a0-4d0b-b778-bdd5ae92d4bb tempest-ProjectReaderTests-472750291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fbf3133-b037-43d0-b96b-8d15b47258d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:49 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-829f0fc2-b2a0-4d0b-b778-bdd5ae92d4bb tempest-ProjectReaderTests-472750291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55650a29-ec86-461e-9f4d-66f66755e39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:49 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-829f0fc2-b2a0-4d0b-b778-bdd5ae92d4bb tempest-ProjectReaderTests-472750291 None] Volume 7157592d-55a4-460a-8e92-c83283a1ec7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7157592d-55a4-460a-8e92-c83283a1ec7b', 'volume_size': 1}
Nov 05 19:27:49 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-829f0fc2-b2a0-4d0b-b778-bdd5ae92d4bb tempest-ProjectReaderTests-472750291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:50 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1bde9303-9121-4799-a3dd-911efa87b13e tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-6edd9508-5597-432f-95ac-7ce5bc9b8d53" returned: 0 in 0.485s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:50 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1bde9303-9121-4799-a3dd-911efa87b13e tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-6edd9508-5597-432f-95ac-7ce5bc9b8d53" released by "delete_volume" :: held 1.128s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:50 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a14b3796-5b22-4be8-8264-0b2aea2a1b13 tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b" returned: 0 in 0.499s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a14b3796-5b22-4be8-8264-0b2aea2a1b13 tempest-ProjectReaderTests-546992118 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:27:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a14b3796-5b22-4be8-8264-0b2aea2a1b13 tempest-ProjectReaderTests-546992118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-829f0fc2-b2a0-4d0b-b778-bdd5ae92d4bb tempest-ProjectReaderTests-472750291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.259s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-829f0fc2-b2a0-4d0b-b778-bdd5ae92d4bb tempest-ProjectReaderTests-472750291 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1787584119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7157592d-55a4-460a-8e92-c83283a1ec7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b1ea86190bb4a68bea548f167dbb954',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:27:50Z,use_quota=True,user_id='f04bba7dbc4c4da58d5b21bd9d60ab93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:27:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-829f0fc2-b2a0-4d0b-b778-bdd5ae92d4bb tempest-ProjectReaderTests-472750291 None] Creating volume 7157592d-55a4-460a-8e92-c83283a1ec7b {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:27:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-829f0fc2-b2a0-4d0b-b778-bdd5ae92d4bb tempest-ProjectReaderTests-472750291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-829f0fc2-b2a0-4d0b-b778-bdd5ae92d4bb tempest-ProjectReaderTests-472750291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-829f0fc2-b2a0-4d0b-b778-bdd5ae92d4bb tempest-ProjectReaderTests-472750291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:27:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-829f0fc2-b2a0-4d0b-b778-bdd5ae92d4bb tempest-ProjectReaderTests-472750291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:27:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-829f0fc2-b2a0-4d0b-b778-bdd5ae92d4bb tempest-ProjectReaderTests-472750291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-829f0fc2-b2a0-4d0b-b778-bdd5ae92d4bb tempest-ProjectReaderTests-472750291 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:27:50 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-829f0fc2-b2a0-4d0b-b778-bdd5ae92d4bb tempest-ProjectReaderTests-472750291 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:27:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-829f0fc2-b2a0-4d0b-b778-bdd5ae92d4bb tempest-ProjectReaderTests-472750291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7157592d-55a4-460a-8e92-c83283a1ec7b 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a14b3796-5b22-4be8-8264-0b2aea2a1b13 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49797fd5-08e8-429f-85d5-5774c7a921b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a14b3796-5b22-4be8-8264-0b2aea2a1b13 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (598211e0-5709-4d61-b3d3-4e58d550876a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:50 devstack sudo[105941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7157592d-55a4-460a-8e92-c83283a1ec7b 1073741824
Nov 05 19:27:50 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:50 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-a14b3796-5b22-4be8-8264-0b2aea2a1b13 tempest-ProjectReaderTests-546992118 None] Volume volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b (84f6cc97-1abc-4269-9c89-efc64ea05d4b): created successfully
Nov 05 19:27:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a14b3796-5b22-4be8-8264-0b2aea2a1b13 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (598211e0-5709-4d61-b3d3-4e58d550876a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:50 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-a14b3796-5b22-4be8-8264-0b2aea2a1b13 tempest-ProjectReaderTests-546992118 None] Flow 'volume_create_manager' (d1adc273-1ca8-42b0-9a12-08c34b008be2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:27:50 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-a14b3796-5b22-4be8-8264-0b2aea2a1b13 tempest-ProjectReaderTests-546992118 None] Created volume successfully.
Nov 05 19:27:50 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-1bde9303-9121-4799-a3dd-911efa87b13e tempest-ProjectMemberTests-1640873908 None] Created reservations ['23a4fb70-71da-4324-ad68-d16bfe0127ac', '761ef30f-2b94-4a02-967d-f66baeb0aff1', 'ec589e21-ea30-4f37-8ff5-55cedbed6e5e', 'a039dcf4-439b-4d8d-96d3-39d6fe48ddaf'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:27:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1bde9303-9121-4799-a3dd-911efa87b13e tempest-ProjectMemberTests-1640873908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1bde9303-9121-4799-a3dd-911efa87b13e tempest-ProjectMemberTests-1640873908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1bde9303-9121-4799-a3dd-911efa87b13e tempest-ProjectMemberTests-1640873908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:27:50 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-1bde9303-9121-4799-a3dd-911efa87b13e tempest-ProjectMemberTests-1640873908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:27:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-1bde9303-9121-4799-a3dd-911efa87b13e tempest-ProjectMemberTests-1640873908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1bde9303-9121-4799-a3dd-911efa87b13e tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:50 devstack sudo[105943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:27:50 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:50 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-1bde9303-9121-4799-a3dd-911efa87b13e tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.285s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:50 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-1bde9303-9121-4799-a3dd-911efa87b13e tempest-ProjectMemberTests-1640873908 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:27:50 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-1bde9303-9121-4799-a3dd-911efa87b13e tempest-ProjectMemberTests-1640873908 None] Deleted volume successfully.
Nov 05 19:27:50 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-829f0fc2-b2a0-4d0b-b778-bdd5ae92d4bb tempest-ProjectReaderTests-472750291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7157592d-55a4-460a-8e92-c83283a1ec7b 1073741824" returned: 0 in 0.475s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:50 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-1bde9303-9121-4799-a3dd-911efa87b13e tempest-ProjectMemberTests-1640873908 None] Lock "cinder-6edd9508-5597-432f-95ac-7ce5bc9b8d53-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:50 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-829f0fc2-b2a0-4d0b-b778-bdd5ae92d4bb tempest-ProjectReaderTests-472750291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7157592d-55a4-460a-8e92-c83283a1ec7b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:50 devstack sudo[105949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7157592d-55a4-460a-8e92-c83283a1ec7b
Nov 05 19:27:50 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:50 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-829f0fc2-b2a0-4d0b-b778-bdd5ae92d4bb tempest-ProjectReaderTests-472750291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7157592d-55a4-460a-8e92-c83283a1ec7b" returned: 0 in 0.390s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:51 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-829f0fc2-b2a0-4d0b-b778-bdd5ae92d4bb tempest-ProjectReaderTests-472750291 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:27:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-829f0fc2-b2a0-4d0b-b778-bdd5ae92d4bb tempest-ProjectReaderTests-472750291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-829f0fc2-b2a0-4d0b-b778-bdd5ae92d4bb tempest-ProjectReaderTests-472750291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55650a29-ec86-461e-9f4d-66f66755e39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7157592d-55a4-460a-8e92-c83283a1ec7b', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-829f0fc2-b2a0-4d0b-b778-bdd5ae92d4bb tempest-ProjectReaderTests-472750291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99825f20-3ee3-4c04-999a-bef57562e220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:51 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-829f0fc2-b2a0-4d0b-b778-bdd5ae92d4bb tempest-ProjectReaderTests-472750291 None] Volume volume-7157592d-55a4-460a-8e92-c83283a1ec7b (7157592d-55a4-460a-8e92-c83283a1ec7b): created successfully
Nov 05 19:27:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-829f0fc2-b2a0-4d0b-b778-bdd5ae92d4bb tempest-ProjectReaderTests-472750291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99825f20-3ee3-4c04-999a-bef57562e220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-829f0fc2-b2a0-4d0b-b778-bdd5ae92d4bb tempest-ProjectReaderTests-472750291 None] Flow 'volume_create_manager' (d6b1e5ca-b5ba-43f0-8ac3-fc1a847a32da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:27:51 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-829f0fc2-b2a0-4d0b-b778-bdd5ae92d4bb tempest-ProjectReaderTests-472750291 None] Created volume successfully.
Nov 05 19:27:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b71c7677-53f7-4f8b-afc8-d455bbcde9fc tempest-ProjectReaderTests-546992118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b71c7677-53f7-4f8b-afc8-d455bbcde9fc tempest-ProjectReaderTests-546992118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:51 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-b71c7677-53f7-4f8b-afc8-d455bbcde9fc tempest-ProjectReaderTests-546992118 None] Creating offline snapshot b1c3e31c-9339-494d-befc-43f8fbcceac3 of volume 84f6cc97-1abc-4269-9c89-efc64ea05d4b {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:27:51 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecaa5202-96b1-4562-b9f0-0e9a6683f421]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b71c7677-53f7-4f8b-afc8-d455bbcde9fc tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:51 devstack sudo[105952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b
Nov 05 19:27:51 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:51 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b71c7677-53f7-4f8b-afc8-d455bbcde9fc tempest-ProjectReaderTests-546992118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b" returned: 0 in 0.427s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b71c7677-53f7-4f8b-afc8-d455bbcde9fc tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b.b1c3e31c-9339-494d-befc-43f8fbcceac3 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:51 devstack sudo[105958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b.b1c3e31c-9339-494d-befc-43f8fbcceac3 1G
Nov 05 19:27:51 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:51 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-c280363f-b41a-4b4e-a90a-d0d0c7542225 tempest-ProjectMemberTests-1640873908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:27:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c280363f-b41a-4b4e-a90a-d0d0c7542225 tempest-ProjectMemberTests-1640873908 None] Flow 'volume_create_manager' (c11b67a7-5801-4e02-83ef-c76e34ab9e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:27:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c280363f-b41a-4b4e-a90a-d0d0c7542225 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9624e76b-0aac-448b-830b-2edf3d20fb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4296b084-dc1d-4c52-a894-a336b0e4b2fa tempest-ProjectReaderTests-472750291 None] Acquiring lock "cinder-7157592d-55a4-460a-8e92-c83283a1ec7b-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c280363f-b41a-4b4e-a90a-d0d0c7542225 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9624e76b-0aac-448b-830b-2edf3d20fb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2064722035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=630d7522-74e3-489d-908c-f00eea341913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d5b238d03346c2b35a48086a4ecc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:27:52Z,use_quota=True,user_id='9c94d9844c6446c58716ae4b34ced8c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c280363f-b41a-4b4e-a90a-d0d0c7542225 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3431aa8-18e2-4f7d-b333-9c367a94536e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c280363f-b41a-4b4e-a90a-d0d0c7542225 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3431aa8-18e2-4f7d-b333-9c367a94536e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c280363f-b41a-4b4e-a90a-d0d0c7542225 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60a4a128-3eb6-4af2-b4b4-4281967f5acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c280363f-b41a-4b4e-a90a-d0d0c7542225 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60a4a128-3eb6-4af2-b4b4-4281967f5acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '630d7522-74e3-489d-908c-f00eea341913', 'volume_name': 'volume-630d7522-74e3-489d-908c-f00eea341913', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c280363f-b41a-4b4e-a90a-d0d0c7542225 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f319d2ea-2bb4-49f3-b6bb-82aaf9f46a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c280363f-b41a-4b4e-a90a-d0d0c7542225 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f319d2ea-2bb4-49f3-b6bb-82aaf9f46a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:51 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c280363f-b41a-4b4e-a90a-d0d0c7542225 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6174c7e3-a41f-406d-9f61-e6a797564515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:51 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-c280363f-b41a-4b4e-a90a-d0d0c7542225 tempest-ProjectMemberTests-1640873908 None] Volume 630d7522-74e3-489d-908c-f00eea341913: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-630d7522-74e3-489d-908c-f00eea341913', 'volume_size': 1}
Nov 05 19:27:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c280363f-b41a-4b4e-a90a-d0d0c7542225 tempest-ProjectMemberTests-1640873908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4296b084-dc1d-4c52-a894-a336b0e4b2fa tempest-ProjectReaderTests-472750291 None] Lock "cinder-7157592d-55a4-460a-8e92-c83283a1ec7b-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4296b084-dc1d-4c52-a894-a336b0e4b2fa tempest-ProjectReaderTests-472750291 None] Acquiring lock "cinder-quobyte-7157592d-55a4-460a-8e92-c83283a1ec7b" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:51 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4296b084-dc1d-4c52-a894-a336b0e4b2fa tempest-ProjectReaderTests-472750291 None] Lock "cinder-quobyte-7157592d-55a4-460a-8e92-c83283a1ec7b" acquired by "delete_volume" :: waited 0.017s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:51 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac0bf69-8897-4c08-984c-37c1f7391d89]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:51 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4296b084-dc1d-4c52-a894-a336b0e4b2fa tempest-ProjectReaderTests-472750291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7157592d-55a4-460a-8e92-c83283a1ec7b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:52 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1930bc7-87e4-49d3-a351-5b2290c1d67c tempest-SnapshotDependencyTests-414637357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:27:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f1930bc7-87e4-49d3-a351-5b2290c1d67c tempest-SnapshotDependencyTests-414637357 None] Flow 'volume_create_manager' (838a6a76-ced7-46d2-bca6-421dba29ba38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:27:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f1930bc7-87e4-49d3-a351-5b2290c1d67c tempest-SnapshotDependencyTests-414637357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ee803fe-0422-4b05-bd91-6f9f685e8463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f1930bc7-87e4-49d3-a351-5b2290c1d67c tempest-SnapshotDependencyTests-414637357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ee803fe-0422-4b05-bd91-6f9f685e8463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1481628978',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0957c86a-07d6-4547-97a0-d336335562ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcf98dccccfc477bafeb36a4e0fd7e5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:27:52Z,use_quota=True,user_id='316e47858baa4b559bf48fdf7ae1fe5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f1930bc7-87e4-49d3-a351-5b2290c1d67c tempest-SnapshotDependencyTests-414637357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06eb36a2-b8cb-46d8-af09-73c3ddc52ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f1930bc7-87e4-49d3-a351-5b2290c1d67c tempest-SnapshotDependencyTests-414637357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06eb36a2-b8cb-46d8-af09-73c3ddc52ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f1930bc7-87e4-49d3-a351-5b2290c1d67c tempest-SnapshotDependencyTests-414637357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a34bcef8-82f1-4ffa-8672-ce6cc21d12f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f1930bc7-87e4-49d3-a351-5b2290c1d67c tempest-SnapshotDependencyTests-414637357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a34bcef8-82f1-4ffa-8672-ce6cc21d12f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0957c86a-07d6-4547-97a0-d336335562ac', 'volume_name': 'volume-0957c86a-07d6-4547-97a0-d336335562ac', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f1930bc7-87e4-49d3-a351-5b2290c1d67c tempest-SnapshotDependencyTests-414637357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27e3fc8c-8f4e-49f1-9fdc-a2941c639279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f1930bc7-87e4-49d3-a351-5b2290c1d67c tempest-SnapshotDependencyTests-414637357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27e3fc8c-8f4e-49f1-9fdc-a2941c639279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:52 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f1930bc7-87e4-49d3-a351-5b2290c1d67c tempest-SnapshotDependencyTests-414637357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aee4247-af05-4f7a-ad93-693d316f9b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:52 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-f1930bc7-87e4-49d3-a351-5b2290c1d67c tempest-SnapshotDependencyTests-414637357 None] Volume 0957c86a-07d6-4547-97a0-d336335562ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0957c86a-07d6-4547-97a0-d336335562ac', 'volume_size': 1}
Nov 05 19:27:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f1930bc7-87e4-49d3-a351-5b2290c1d67c tempest-SnapshotDependencyTests-414637357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:52 devstack sudo[105960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7157592d-55a4-460a-8e92-c83283a1ec7b
Nov 05 19:27:52 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:52 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b71c7677-53f7-4f8b-afc8-d455bbcde9fc tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b.b1c3e31c-9339-494d-befc-43f8fbcceac3 1G" returned: 0 in 0.540s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b71c7677-53f7-4f8b-afc8-d455bbcde9fc tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b.b1c3e31c-9339-494d-befc-43f8fbcceac3 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:52 devstack sudo[105965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b.b1c3e31c-9339-494d-befc-43f8fbcceac3
Nov 05 19:27:52 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:52 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4296b084-dc1d-4c52-a894-a336b0e4b2fa tempest-ProjectReaderTests-472750291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7157592d-55a4-460a-8e92-c83283a1ec7b" returned: 0 in 0.397s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4296b084-dc1d-4c52-a894-a336b0e4b2fa tempest-ProjectReaderTests-472750291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7157592d-55a4-460a-8e92-c83283a1ec7b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:52 devstack sudo[105970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7157592d-55a4-460a-8e92-c83283a1ec7b
Nov 05 19:27:52 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:52 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b71c7677-53f7-4f8b-afc8-d455bbcde9fc tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b.b1c3e31c-9339-494d-befc-43f8fbcceac3" returned: 0 in 0.309s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:52 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-b71c7677-53f7-4f8b-afc8-d455bbcde9fc tempest-ProjectReaderTests-546992118 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b.b1c3e31c-9339-494d-befc-43f8fbcceac3 is being set with open permissions: ugo+rw
Nov 05 19:27:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b71c7677-53f7-4f8b-afc8-d455bbcde9fc tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b.b1c3e31c-9339-494d-befc-43f8fbcceac3 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:52 devstack sudo[105975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b.b1c3e31c-9339-494d-befc-43f8fbcceac3
Nov 05 19:27:52 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:52 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4296b084-dc1d-4c52-a894-a336b0e4b2fa tempest-ProjectReaderTests-472750291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-7157592d-55a4-460a-8e92-c83283a1ec7b" returned: 0 in 0.263s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:52 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4296b084-dc1d-4c52-a894-a336b0e4b2fa tempest-ProjectReaderTests-472750291 None] Lock "cinder-quobyte-7157592d-55a4-460a-8e92-c83283a1ec7b" released by "delete_volume" :: held 0.707s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:52 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-4296b084-dc1d-4c52-a894-a336b0e4b2fa tempest-ProjectReaderTests-472750291 None] Created reservations ['f659abf1-2b02-4267-a5aa-c5dc7392d19a', '8c573501-8726-4f6b-90b5-8a83bac5f4f8', '0d9d5840-8298-4d84-af90-f5de90d4d2bf', 'd923f963-3962-4054-905e-99d26059d2d2'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:27:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4296b084-dc1d-4c52-a894-a336b0e4b2fa tempest-ProjectReaderTests-472750291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4296b084-dc1d-4c52-a894-a336b0e4b2fa tempest-ProjectReaderTests-472750291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4296b084-dc1d-4c52-a894-a336b0e4b2fa tempest-ProjectReaderTests-472750291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:27:52 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4296b084-dc1d-4c52-a894-a336b0e4b2fa tempest-ProjectReaderTests-472750291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:27:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4296b084-dc1d-4c52-a894-a336b0e4b2fa tempest-ProjectReaderTests-472750291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4296b084-dc1d-4c52-a894-a336b0e4b2fa tempest-ProjectReaderTests-472750291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:52 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b71c7677-53f7-4f8b-afc8-d455bbcde9fc tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b.b1c3e31c-9339-494d-befc-43f8fbcceac3" returned: 0 in 0.267s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:52 devstack sudo[105979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:27:52 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:52 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b71c7677-53f7-4f8b-afc8-d455bbcde9fc tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:52 devstack sudo[105981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b.info
Nov 05 19:27:52 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:53 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4296b084-dc1d-4c52-a894-a336b0e4b2fa tempest-ProjectReaderTests-472750291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.250s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:53 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-4296b084-dc1d-4c52-a894-a336b0e4b2fa tempest-ProjectReaderTests-472750291 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:27:53 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-4296b084-dc1d-4c52-a894-a336b0e4b2fa tempest-ProjectReaderTests-472750291 None] Deleted volume successfully.
Nov 05 19:27:53 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4296b084-dc1d-4c52-a894-a336b0e4b2fa tempest-ProjectReaderTests-472750291 None] Lock "cinder-7157592d-55a4-460a-8e92-c83283a1ec7b-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:53 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b71c7677-53f7-4f8b-afc8-d455bbcde9fc tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b.info" returned: 0 in 0.294s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:53 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-b71c7677-53f7-4f8b-afc8-d455bbcde9fc tempest-ProjectReaderTests-546992118 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b.info is being set with open permissions: ugo+rw
Nov 05 19:27:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b71c7677-53f7-4f8b-afc8-d455bbcde9fc tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:53 devstack sudo[105985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b.info
Nov 05 19:27:53 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:53 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b71c7677-53f7-4f8b-afc8-d455bbcde9fc tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b.info" returned: 0 in 0.275s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b71c7677-53f7-4f8b-afc8-d455bbcde9fc tempest-ProjectReaderTests-546992118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.201s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c280363f-b41a-4b4e-a90a-d0d0c7542225 tempest-ProjectMemberTests-1640873908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.520s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c280363f-b41a-4b4e-a90a-d0d0c7542225 tempest-ProjectMemberTests-1640873908 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2064722035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=630d7522-74e3-489d-908c-f00eea341913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d5b238d03346c2b35a48086a4ecc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:27:52Z,use_quota=True,user_id='9c94d9844c6446c58716ae4b34ced8c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:27:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-c280363f-b41a-4b4e-a90a-d0d0c7542225 tempest-ProjectMemberTests-1640873908 None] Creating volume 630d7522-74e3-489d-908c-f00eea341913 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:27:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c280363f-b41a-4b4e-a90a-d0d0c7542225 tempest-ProjectMemberTests-1640873908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c280363f-b41a-4b4e-a90a-d0d0c7542225 tempest-ProjectMemberTests-1640873908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c280363f-b41a-4b4e-a90a-d0d0c7542225 tempest-ProjectMemberTests-1640873908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:27:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c280363f-b41a-4b4e-a90a-d0d0c7542225 tempest-ProjectMemberTests-1640873908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:27:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c280363f-b41a-4b4e-a90a-d0d0c7542225 tempest-ProjectMemberTests-1640873908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:53 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c280363f-b41a-4b4e-a90a-d0d0c7542225 tempest-ProjectMemberTests-1640873908 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:27:53 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-c280363f-b41a-4b4e-a90a-d0d0c7542225 tempest-ProjectMemberTests-1640873908 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:27:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c280363f-b41a-4b4e-a90a-d0d0c7542225 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:53 devstack sudo[105988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913 1073741824
Nov 05 19:27:53 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:53 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b71c7677-53f7-4f8b-afc8-d455bbcde9fc tempest-ProjectReaderTests-546992118 None] Create snapshot completed successfully
Nov 05 19:27:53 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c280363f-b41a-4b4e-a90a-d0d0c7542225 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913 1073741824" returned: 0 in 0.494s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:53 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c280363f-b41a-4b4e-a90a-d0d0c7542225 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:53 devstack sudo[106030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913
Nov 05 19:27:53 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:54 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c280363f-b41a-4b4e-a90a-d0d0c7542225 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913" returned: 0 in 0.265s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-c280363f-b41a-4b4e-a90a-d0d0c7542225 tempest-ProjectMemberTests-1640873908 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:27:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-c280363f-b41a-4b4e-a90a-d0d0c7542225 tempest-ProjectMemberTests-1640873908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f1930bc7-87e4-49d3-a351-5b2290c1d67c tempest-SnapshotDependencyTests-414637357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.133s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f1930bc7-87e4-49d3-a351-5b2290c1d67c tempest-SnapshotDependencyTests-414637357 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1481628978',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0957c86a-07d6-4547-97a0-d336335562ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcf98dccccfc477bafeb36a4e0fd7e5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:27:52Z,use_quota=True,user_id='316e47858baa4b559bf48fdf7ae1fe5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:27:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-f1930bc7-87e4-49d3-a351-5b2290c1d67c tempest-SnapshotDependencyTests-414637357 None] Creating volume 0957c86a-07d6-4547-97a0-d336335562ac {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:27:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f1930bc7-87e4-49d3-a351-5b2290c1d67c tempest-SnapshotDependencyTests-414637357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f1930bc7-87e4-49d3-a351-5b2290c1d67c tempest-SnapshotDependencyTests-414637357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f1930bc7-87e4-49d3-a351-5b2290c1d67c tempest-SnapshotDependencyTests-414637357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:27:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f1930bc7-87e4-49d3-a351-5b2290c1d67c tempest-SnapshotDependencyTests-414637357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:27:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f1930bc7-87e4-49d3-a351-5b2290c1d67c tempest-SnapshotDependencyTests-414637357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f1930bc7-87e4-49d3-a351-5b2290c1d67c tempest-SnapshotDependencyTests-414637357 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:27:54 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-f1930bc7-87e4-49d3-a351-5b2290c1d67c tempest-SnapshotDependencyTests-414637357 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:27:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f1930bc7-87e4-49d3-a351-5b2290c1d67c tempest-SnapshotDependencyTests-414637357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c280363f-b41a-4b4e-a90a-d0d0c7542225 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6174c7e3-a41f-406d-9f61-e6a797564515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-630d7522-74e3-489d-908c-f00eea341913', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c280363f-b41a-4b4e-a90a-d0d0c7542225 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (178b8723-1700-4be3-aed0-771e1a889812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:54 devstack sudo[106033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac 1073741824
Nov 05 19:27:54 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:54 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-c280363f-b41a-4b4e-a90a-d0d0c7542225 tempest-ProjectMemberTests-1640873908 None] Volume volume-630d7522-74e3-489d-908c-f00eea341913 (630d7522-74e3-489d-908c-f00eea341913): created successfully
Nov 05 19:27:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c280363f-b41a-4b4e-a90a-d0d0c7542225 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (178b8723-1700-4be3-aed0-771e1a889812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:54 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-c280363f-b41a-4b4e-a90a-d0d0c7542225 tempest-ProjectMemberTests-1640873908 None] Flow 'volume_create_manager' (c11b67a7-5801-4e02-83ef-c76e34ab9e86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:27:54 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-c280363f-b41a-4b4e-a90a-d0d0c7542225 tempest-ProjectMemberTests-1640873908 None] Created volume successfully.
Nov 05 19:27:54 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0c8e6e6d-98ed-411e-8d45-bc6a45f36509 tempest-ProjectReaderTests-546992118 None] Acquiring lock "cinder-b1c3e31c-9339-494d-befc-43f8fbcceac3-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:54 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0c8e6e6d-98ed-411e-8d45-bc6a45f36509 tempest-ProjectReaderTests-546992118 None] Lock "cinder-b1c3e31c-9339-494d-befc-43f8fbcceac3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:54 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0c8e6e6d-98ed-411e-8d45-bc6a45f36509 tempest-ProjectReaderTests-546992118 None] Acquiring lock "cinder-quobyte-84f6cc97-1abc-4269-9c89-efc64ea05d4b" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:54 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0c8e6e6d-98ed-411e-8d45-bc6a45f36509 tempest-ProjectReaderTests-546992118 None] Lock "cinder-quobyte-84f6cc97-1abc-4269-9c89-efc64ea05d4b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:54 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0c8e6e6d-98ed-411e-8d45-bc6a45f36509 tempest-ProjectReaderTests-546992118 None] Acquiring lock "cinder-quobyte-b1c3e31c-9339-494d-befc-43f8fbcceac3" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:54 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0c8e6e6d-98ed-411e-8d45-bc6a45f36509 tempest-ProjectReaderTests-546992118 None] Lock "cinder-quobyte-b1c3e31c-9339-494d-befc-43f8fbcceac3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-0c8e6e6d-98ed-411e-8d45-bc6a45f36509 tempest-ProjectReaderTests-546992118 None] Deleting offline snapshot b1c3e31c-9339-494d-befc-43f8fbcceac3 of volume 84f6cc97-1abc-4269-9c89-efc64ea05d4b {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:27:54 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-0c8e6e6d-98ed-411e-8d45-bc6a45f36509 tempest-ProjectReaderTests-546992118 None] snapshot_file for this snap is: volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b.b1c3e31c-9339-494d-befc-43f8fbcceac3 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:27:54 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[60baeeb4-626c-4fad-aab7-ab77933a909f]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0c8e6e6d-98ed-411e-8d45-bc6a45f36509 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b.b1c3e31c-9339-494d-befc-43f8fbcceac3 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:54 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f1930bc7-87e4-49d3-a351-5b2290c1d67c tempest-SnapshotDependencyTests-414637357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac 1073741824" returned: 0 in 0.605s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:54 devstack sudo[106039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b.b1c3e31c-9339-494d-befc-43f8fbcceac3
Nov 05 19:27:54 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:54 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f1930bc7-87e4-49d3-a351-5b2290c1d67c tempest-SnapshotDependencyTests-414637357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:54 devstack sudo[106041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac
Nov 05 19:27:54 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8f28967c-c4ac-4f6f-8a54-78d251f99a7f tempest-ProjectMemberTests-1640873908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:55 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0c8e6e6d-98ed-411e-8d45-bc6a45f36509 tempest-ProjectReaderTests-546992118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b.b1c3e31c-9339-494d-befc-43f8fbcceac3" returned: 0 in 0.404s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:55 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-0c8e6e6d-98ed-411e-8d45-bc6a45f36509 tempest-ProjectReaderTests-546992118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:27:55 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27e10b1-2772-4c8c-aeb2-544f5b85946d]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0c8e6e6d-98ed-411e-8d45-bc6a45f36509 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:55 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f1930bc7-87e4-49d3-a351-5b2290c1d67c tempest-SnapshotDependencyTests-414637357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac" returned: 0 in 0.344s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:55 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f1930bc7-87e4-49d3-a351-5b2290c1d67c tempest-SnapshotDependencyTests-414637357 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:27:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f1930bc7-87e4-49d3-a351-5b2290c1d67c tempest-SnapshotDependencyTests-414637357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8f28967c-c4ac-4f6f-8a54-78d251f99a7f tempest-ProjectMemberTests-1640873908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.124s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f1930bc7-87e4-49d3-a351-5b2290c1d67c tempest-SnapshotDependencyTests-414637357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aee4247-af05-4f7a-ad93-693d316f9b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0957c86a-07d6-4547-97a0-d336335562ac', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f1930bc7-87e4-49d3-a351-5b2290c1d67c tempest-SnapshotDependencyTests-414637357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3d53963-ae79-4b05-aae3-3d287115f7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:55 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-8f28967c-c4ac-4f6f-8a54-78d251f99a7f tempest-ProjectMemberTests-1640873908 None] Creating offline snapshot 1c1807b7-c102-49e4-8bf3-1ac590f8e660 of volume 630d7522-74e3-489d-908c-f00eea341913 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:27:55 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-f1930bc7-87e4-49d3-a351-5b2290c1d67c tempest-SnapshotDependencyTests-414637357 None] Volume volume-0957c86a-07d6-4547-97a0-d336335562ac (0957c86a-07d6-4547-97a0-d336335562ac): created successfully
Nov 05 19:27:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f1930bc7-87e4-49d3-a351-5b2290c1d67c tempest-SnapshotDependencyTests-414637357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3d53963-ae79-4b05-aae3-3d287115f7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:55 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f1930bc7-87e4-49d3-a351-5b2290c1d67c tempest-SnapshotDependencyTests-414637357 None] Flow 'volume_create_manager' (838a6a76-ced7-46d2-bca6-421dba29ba38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:27:55 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fbfffa-0734-43f1-8e08-dce5ecb87321]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8f28967c-c4ac-4f6f-8a54-78d251f99a7f tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:55 devstack sudo[106047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b
Nov 05 19:27:55 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:55 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f1930bc7-87e4-49d3-a351-5b2290c1d67c tempest-SnapshotDependencyTests-414637357 None] Created volume successfully.
Nov 05 19:27:55 devstack sudo[106048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913
Nov 05 19:27:55 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:55 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0c8e6e6d-98ed-411e-8d45-bc6a45f36509 tempest-ProjectReaderTests-546992118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b" returned: 0 in 0.384s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0c8e6e6d-98ed-411e-8d45-bc6a45f36509 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b.b1c3e31c-9339-494d-befc-43f8fbcceac3 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:55 devstack sudo[106055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b.b1c3e31c-9339-494d-befc-43f8fbcceac3
Nov 05 19:27:55 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:55 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8f28967c-c4ac-4f6f-8a54-78d251f99a7f tempest-ProjectMemberTests-1640873908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913" returned: 0 in 0.371s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8f28967c-c4ac-4f6f-8a54-78d251f99a7f tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913.1c1807b7-c102-49e4-8bf3-1ac590f8e660 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:55 devstack sudo[106059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913.1c1807b7-c102-49e4-8bf3-1ac590f8e660 1G
Nov 05 19:27:55 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:55 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0c8e6e6d-98ed-411e-8d45-bc6a45f36509 tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b.b1c3e31c-9339-494d-befc-43f8fbcceac3" returned: 0 in 0.340s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:55 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0c8e6e6d-98ed-411e-8d45-bc6a45f36509 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b.b1c3e31c-9339-494d-befc-43f8fbcceac3 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:55 devstack sudo[106067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b.b1c3e31c-9339-494d-befc-43f8fbcceac3
Nov 05 19:27:55 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:56 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8f28967c-c4ac-4f6f-8a54-78d251f99a7f tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913.1c1807b7-c102-49e4-8bf3-1ac590f8e660 1G" returned: 0 in 0.419s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8f28967c-c4ac-4f6f-8a54-78d251f99a7f tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-630d7522-74e3-489d-908c-f00eea341913 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913.1c1807b7-c102-49e4-8bf3-1ac590f8e660 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:56 devstack sudo[106070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-630d7522-74e3-489d-908c-f00eea341913 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913.1c1807b7-c102-49e4-8bf3-1ac590f8e660
Nov 05 19:27:56 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:56 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0c8e6e6d-98ed-411e-8d45-bc6a45f36509 tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b.b1c3e31c-9339-494d-befc-43f8fbcceac3" returned: 0 in 0.277s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:56 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0c8e6e6d-98ed-411e-8d45-bc6a45f36509 tempest-ProjectReaderTests-546992118 None] Lock "cinder-quobyte-b1c3e31c-9339-494d-befc-43f8fbcceac3" released by "_delete_snapshot" :: held 1.539s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:56 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0c8e6e6d-98ed-411e-8d45-bc6a45f36509 tempest-ProjectReaderTests-546992118 None] Lock "cinder-quobyte-84f6cc97-1abc-4269-9c89-efc64ea05d4b" released by "delete_snapshot" :: held 1.567s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:56 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-0c8e6e6d-98ed-411e-8d45-bc6a45f36509 tempest-ProjectReaderTests-546992118 None] Created reservations ['accd62d2-a98c-49a0-ab63-f870a9808ed0', '2a219fb0-996d-49e6-971d-d84084703ae9', 'ad5c6666-e63b-4e16-b7c5-4a50cfa620c5', 'd558e4b9-eac0-4d0f-9056-791e91b293ba'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:27:56 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-0c8e6e6d-98ed-411e-8d45-bc6a45f36509 tempest-ProjectReaderTests-546992118 None] Delete snapshot completed successfully.
Nov 05 19:27:56 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0c8e6e6d-98ed-411e-8d45-bc6a45f36509 tempest-ProjectReaderTests-546992118 None] Lock "cinder-b1c3e31c-9339-494d-befc-43f8fbcceac3-delete_snapshot" released by "delete_snapshot" :: held 1.742s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:56 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8f28967c-c4ac-4f6f-8a54-78d251f99a7f tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-630d7522-74e3-489d-908c-f00eea341913 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913.1c1807b7-c102-49e4-8bf3-1ac590f8e660" returned: 0 in 0.321s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:56 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-8f28967c-c4ac-4f6f-8a54-78d251f99a7f tempest-ProjectMemberTests-1640873908 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913.1c1807b7-c102-49e4-8bf3-1ac590f8e660 is being set with open permissions: ugo+rw
Nov 05 19:27:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8f28967c-c4ac-4f6f-8a54-78d251f99a7f tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913.1c1807b7-c102-49e4-8bf3-1ac590f8e660 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:56 devstack sudo[106076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913.1c1807b7-c102-49e4-8bf3-1ac590f8e660
Nov 05 19:27:56 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0865bdeb-a9fb-4ee1-8db2-222c64c72adf tempest-SnapshotDependencyTests-414637357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:56 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8f28967c-c4ac-4f6f-8a54-78d251f99a7f tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913.1c1807b7-c102-49e4-8bf3-1ac590f8e660" returned: 0 in 0.253s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8f28967c-c4ac-4f6f-8a54-78d251f99a7f tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:56 devstack sudo[106079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913.info
Nov 05 19:27:56 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:56 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0ed1f966-f66f-4622-b01c-da31aded3ef6 tempest-ProjectReaderTests-546992118 None] Acquiring lock "cinder-84f6cc97-1abc-4269-9c89-efc64ea05d4b-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:56 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0ed1f966-f66f-4622-b01c-da31aded3ef6 tempest-ProjectReaderTests-546992118 None] Lock "cinder-84f6cc97-1abc-4269-9c89-efc64ea05d4b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:56 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0ed1f966-f66f-4622-b01c-da31aded3ef6 tempest-ProjectReaderTests-546992118 None] Acquiring lock "cinder-quobyte-84f6cc97-1abc-4269-9c89-efc64ea05d4b" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:56 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0ed1f966-f66f-4622-b01c-da31aded3ef6 tempest-ProjectReaderTests-546992118 None] Lock "cinder-quobyte-84f6cc97-1abc-4269-9c89-efc64ea05d4b" acquired by "delete_volume" :: waited 0.012s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:56 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6bcb85-4c57-42a5-89d5-9fde88810a4c]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0ed1f966-f66f-4622-b01c-da31aded3ef6 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:56 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8f28967c-c4ac-4f6f-8a54-78d251f99a7f tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913.info" returned: 0 in 0.254s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:56 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-8f28967c-c4ac-4f6f-8a54-78d251f99a7f tempest-ProjectMemberTests-1640873908 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913.info is being set with open permissions: ugo+rw
Nov 05 19:27:56 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8f28967c-c4ac-4f6f-8a54-78d251f99a7f tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:56 devstack sudo[106083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913.info
Nov 05 19:27:56 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:57 devstack sudo[106082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b
Nov 05 19:27:57 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:57 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8f28967c-c4ac-4f6f-8a54-78d251f99a7f tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913.info" returned: 0 in 0.237s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8f28967c-c4ac-4f6f-8a54-78d251f99a7f tempest-ProjectMemberTests-1640873908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.962s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0865bdeb-a9fb-4ee1-8db2-222c64c72adf tempest-SnapshotDependencyTests-414637357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.654s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-0865bdeb-a9fb-4ee1-8db2-222c64c72adf tempest-SnapshotDependencyTests-414637357 None] Creating offline snapshot eba07ad7-d50a-421e-8d1f-252b2281a396 of volume 0957c86a-07d6-4547-97a0-d336335562ac {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:27:57 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-8f28967c-c4ac-4f6f-8a54-78d251f99a7f tempest-ProjectMemberTests-1640873908 None] Create snapshot completed successfully
Nov 05 19:27:57 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7ca5bd-be2c-4760-98a0-f946d2ea3c24]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0865bdeb-a9fb-4ee1-8db2-222c64c72adf tempest-SnapshotDependencyTests-414637357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:57 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0ed1f966-f66f-4622-b01c-da31aded3ef6 tempest-ProjectReaderTests-546992118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b" returned: 0 in 0.376s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0ed1f966-f66f-4622-b01c-da31aded3ef6 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:57 devstack sudo[106092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b
Nov 05 19:27:57 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:57 devstack sudo[106091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac
Nov 05 19:27:57 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:57 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0ed1f966-f66f-4622-b01c-da31aded3ef6 tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-84f6cc97-1abc-4269-9c89-efc64ea05d4b" returned: 0 in 0.246s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:57 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0ed1f966-f66f-4622-b01c-da31aded3ef6 tempest-ProjectReaderTests-546992118 None] Lock "cinder-quobyte-84f6cc97-1abc-4269-9c89-efc64ea05d4b" released by "delete_volume" :: held 0.697s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:57 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-0ed1f966-f66f-4622-b01c-da31aded3ef6 tempest-ProjectReaderTests-546992118 None] Created reservations ['8113b110-c65a-4954-84a9-778ef6b472cc', '3839422d-e5a4-4665-af08-a3c8d740dfcc', 'd354e7ad-7d02-41dc-896c-a959b358d9ac', '44c9bab4-f9bb-44f9-a5c4-5255965c95fa'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:27:57 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0865bdeb-a9fb-4ee1-8db2-222c64c72adf tempest-SnapshotDependencyTests-414637357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac" returned: 0 in 0.381s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0865bdeb-a9fb-4ee1-8db2-222c64c72adf tempest-SnapshotDependencyTests-414637357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac.eba07ad7-d50a-421e-8d1f-252b2281a396 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:57 devstack sudo[106100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac.eba07ad7-d50a-421e-8d1f-252b2281a396 1G
Nov 05 19:27:57 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0ed1f966-f66f-4622-b01c-da31aded3ef6 tempest-ProjectReaderTests-546992118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0ed1f966-f66f-4622-b01c-da31aded3ef6 tempest-ProjectReaderTests-546992118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0ed1f966-f66f-4622-b01c-da31aded3ef6 tempest-ProjectReaderTests-546992118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:27:57 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-0ed1f966-f66f-4622-b01c-da31aded3ef6 tempest-ProjectReaderTests-546992118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:27:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0ed1f966-f66f-4622-b01c-da31aded3ef6 tempest-ProjectReaderTests-546992118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0ed1f966-f66f-4622-b01c-da31aded3ef6 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:57 devstack sudo[106102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:27:57 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:57 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:57 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0ed1f966-f66f-4622-b01c-da31aded3ef6 tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.247s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:57 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-0ed1f966-f66f-4622-b01c-da31aded3ef6 tempest-ProjectReaderTests-546992118 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:27:57 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-0ed1f966-f66f-4622-b01c-da31aded3ef6 tempest-ProjectReaderTests-546992118 None] Deleted volume successfully.
Nov 05 19:27:57 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-0ed1f966-f66f-4622-b01c-da31aded3ef6 tempest-ProjectReaderTests-546992118 None] Lock "cinder-84f6cc97-1abc-4269-9c89-efc64ea05d4b-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:58 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0865bdeb-a9fb-4ee1-8db2-222c64c72adf tempest-SnapshotDependencyTests-414637357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac.eba07ad7-d50a-421e-8d1f-252b2281a396 1G" returned: 0 in 0.431s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0865bdeb-a9fb-4ee1-8db2-222c64c72adf tempest-SnapshotDependencyTests-414637357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0957c86a-07d6-4547-97a0-d336335562ac -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac.eba07ad7-d50a-421e-8d1f-252b2281a396 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:58 devstack sudo[106109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0957c86a-07d6-4547-97a0-d336335562ac -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac.eba07ad7-d50a-421e-8d1f-252b2281a396
Nov 05 19:27:58 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:58 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4a40ae99-a707-4f7b-a425-82825a40b3ef tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-1c1807b7-c102-49e4-8bf3-1ac590f8e660-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:58 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4a40ae99-a707-4f7b-a425-82825a40b3ef tempest-ProjectMemberTests-1640873908 None] Lock "cinder-1c1807b7-c102-49e4-8bf3-1ac590f8e660-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:58 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4a40ae99-a707-4f7b-a425-82825a40b3ef tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-quobyte-630d7522-74e3-489d-908c-f00eea341913" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:58 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4a40ae99-a707-4f7b-a425-82825a40b3ef tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-630d7522-74e3-489d-908c-f00eea341913" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:58 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4a40ae99-a707-4f7b-a425-82825a40b3ef tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-quobyte-1c1807b7-c102-49e4-8bf3-1ac590f8e660" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:27:58 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4a40ae99-a707-4f7b-a425-82825a40b3ef tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-1c1807b7-c102-49e4-8bf3-1ac590f8e660" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:27:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-4a40ae99-a707-4f7b-a425-82825a40b3ef tempest-ProjectMemberTests-1640873908 None] Deleting offline snapshot 1c1807b7-c102-49e4-8bf3-1ac590f8e660 of volume 630d7522-74e3-489d-908c-f00eea341913 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:27:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-4a40ae99-a707-4f7b-a425-82825a40b3ef tempest-ProjectMemberTests-1640873908 None] snapshot_file for this snap is: volume-630d7522-74e3-489d-908c-f00eea341913.1c1807b7-c102-49e4-8bf3-1ac590f8e660 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:27:58 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9a6d37-3759-408c-af73-5ae0939f9af4]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4a40ae99-a707-4f7b-a425-82825a40b3ef tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913.1c1807b7-c102-49e4-8bf3-1ac590f8e660 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:58 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0865bdeb-a9fb-4ee1-8db2-222c64c72adf tempest-SnapshotDependencyTests-414637357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0957c86a-07d6-4547-97a0-d336335562ac -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac.eba07ad7-d50a-421e-8d1f-252b2281a396" returned: 0 in 0.392s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:58 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-0865bdeb-a9fb-4ee1-8db2-222c64c72adf tempest-SnapshotDependencyTests-414637357 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac.eba07ad7-d50a-421e-8d1f-252b2281a396 is being set with open permissions: ugo+rw
Nov 05 19:27:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0865bdeb-a9fb-4ee1-8db2-222c64c72adf tempest-SnapshotDependencyTests-414637357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac.eba07ad7-d50a-421e-8d1f-252b2281a396 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:58 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-57dd5a12-863f-4a4b-9ab4-391cdbb69604 tempest-ProjectReaderTests-546992118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:27:58 devstack sudo[106115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac.eba07ad7-d50a-421e-8d1f-252b2281a396
Nov 05 19:27:58 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-57dd5a12-863f-4a4b-9ab4-391cdbb69604 tempest-ProjectReaderTests-546992118 None] Flow 'volume_create_manager' (1fdec900-6159-42f0-9551-3eb005807e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:27:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-57dd5a12-863f-4a4b-9ab4-391cdbb69604 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (512343ed-658b-4a13-86b3-7dce0cca76e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:58 devstack sudo[106114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913.1c1807b7-c102-49e4-8bf3-1ac590f8e660
Nov 05 19:27:58 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-57dd5a12-863f-4a4b-9ab4-391cdbb69604 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (512343ed-658b-4a13-86b3-7dce0cca76e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-66213566',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dfe3aa7-5afd-4527-9388-2c14a263299c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8b6de85a1d742f78e908c889957f3d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:27:58Z,use_quota=True,user_id='60990ab9a4554795bcd64339eacaa724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-57dd5a12-863f-4a4b-9ab4-391cdbb69604 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e811ba3-26d1-44eb-ba7e-62b4132e44e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-57dd5a12-863f-4a4b-9ab4-391cdbb69604 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e811ba3-26d1-44eb-ba7e-62b4132e44e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-57dd5a12-863f-4a4b-9ab4-391cdbb69604 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7af20a50-a6c2-401e-95a2-e4f41fc0c2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-57dd5a12-863f-4a4b-9ab4-391cdbb69604 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7af20a50-a6c2-401e-95a2-e4f41fc0c2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dfe3aa7-5afd-4527-9388-2c14a263299c', 'volume_name': 'volume-8dfe3aa7-5afd-4527-9388-2c14a263299c', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-57dd5a12-863f-4a4b-9ab4-391cdbb69604 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c74adf8-284d-445a-9a87-647f77dbcc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-57dd5a12-863f-4a4b-9ab4-391cdbb69604 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c74adf8-284d-445a-9a87-647f77dbcc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:27:58 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-57dd5a12-863f-4a4b-9ab4-391cdbb69604 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9565deb3-d46c-4eac-ab19-27c9a03d2754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:27:58 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-57dd5a12-863f-4a4b-9ab4-391cdbb69604 tempest-ProjectReaderTests-546992118 None] Volume 8dfe3aa7-5afd-4527-9388-2c14a263299c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dfe3aa7-5afd-4527-9388-2c14a263299c', 'volume_size': 1}
Nov 05 19:27:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-57dd5a12-863f-4a4b-9ab4-391cdbb69604 tempest-ProjectReaderTests-546992118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:58 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0865bdeb-a9fb-4ee1-8db2-222c64c72adf tempest-SnapshotDependencyTests-414637357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac.eba07ad7-d50a-421e-8d1f-252b2281a396" returned: 0 in 0.260s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0865bdeb-a9fb-4ee1-8db2-222c64c72adf tempest-SnapshotDependencyTests-414637357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:58 devstack sudo[106122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac.info
Nov 05 19:27:58 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:58 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4a40ae99-a707-4f7b-a425-82825a40b3ef tempest-ProjectMemberTests-1640873908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913.1c1807b7-c102-49e4-8bf3-1ac590f8e660" returned: 0 in 0.377s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:58 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-4a40ae99-a707-4f7b-a425-82825a40b3ef tempest-ProjectMemberTests-1640873908 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-630d7522-74e3-489d-908c-f00eea341913(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:27:58 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8206e41-7f92-4a71-a517-f7684a701af7]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:27:58 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4a40ae99-a707-4f7b-a425-82825a40b3ef tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:58 devstack sudo[106124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913
Nov 05 19:27:58 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:59 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0865bdeb-a9fb-4ee1-8db2-222c64c72adf tempest-SnapshotDependencyTests-414637357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac.info" returned: 0 in 0.265s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:59 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-0865bdeb-a9fb-4ee1-8db2-222c64c72adf tempest-SnapshotDependencyTests-414637357 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac.info is being set with open permissions: ugo+rw
Nov 05 19:27:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0865bdeb-a9fb-4ee1-8db2-222c64c72adf tempest-SnapshotDependencyTests-414637357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:59 devstack sudo[106127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac.info
Nov 05 19:27:59 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:59 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4a40ae99-a707-4f7b-a425-82825a40b3ef tempest-ProjectMemberTests-1640873908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913" returned: 0 in 0.363s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4a40ae99-a707-4f7b-a425-82825a40b3ef tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913.1c1807b7-c102-49e4-8bf3-1ac590f8e660 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:59 devstack sudo[106132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913.1c1807b7-c102-49e4-8bf3-1ac590f8e660
Nov 05 19:27:59 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:59 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-0865bdeb-a9fb-4ee1-8db2-222c64c72adf tempest-SnapshotDependencyTests-414637357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac.info" returned: 0 in 0.255s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-0865bdeb-a9fb-4ee1-8db2-222c64c72adf tempest-SnapshotDependencyTests-414637357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.083s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-57dd5a12-863f-4a4b-9ab4-391cdbb69604 tempest-ProjectReaderTests-546992118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.733s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-57dd5a12-863f-4a4b-9ab4-391cdbb69604 tempest-ProjectReaderTests-546992118 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-66213566',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dfe3aa7-5afd-4527-9388-2c14a263299c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8b6de85a1d742f78e908c889957f3d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:27:58Z,use_quota=True,user_id='60990ab9a4554795bcd64339eacaa724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:27:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-57dd5a12-863f-4a4b-9ab4-391cdbb69604 tempest-ProjectReaderTests-546992118 None] Creating volume 8dfe3aa7-5afd-4527-9388-2c14a263299c {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:27:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-57dd5a12-863f-4a4b-9ab4-391cdbb69604 tempest-ProjectReaderTests-546992118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:27:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-57dd5a12-863f-4a4b-9ab4-391cdbb69604 tempest-ProjectReaderTests-546992118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:27:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-57dd5a12-863f-4a4b-9ab4-391cdbb69604 tempest-ProjectReaderTests-546992118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:27:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-57dd5a12-863f-4a4b-9ab4-391cdbb69604 tempest-ProjectReaderTests-546992118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:27:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-57dd5a12-863f-4a4b-9ab4-391cdbb69604 tempest-ProjectReaderTests-546992118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:27:59 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-57dd5a12-863f-4a4b-9ab4-391cdbb69604 tempest-ProjectReaderTests-546992118 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:27:59 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-57dd5a12-863f-4a4b-9ab4-391cdbb69604 tempest-ProjectReaderTests-546992118 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:27:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-57dd5a12-863f-4a4b-9ab4-391cdbb69604 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:59 devstack sudo[106135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c 1073741824
Nov 05 19:27:59 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:59 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-0865bdeb-a9fb-4ee1-8db2-222c64c72adf tempest-SnapshotDependencyTests-414637357 None] Create snapshot completed successfully
Nov 05 19:27:59 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4a40ae99-a707-4f7b-a425-82825a40b3ef tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913.1c1807b7-c102-49e4-8bf3-1ac590f8e660" returned: 0 in 0.382s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4a40ae99-a707-4f7b-a425-82825a40b3ef tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913.1c1807b7-c102-49e4-8bf3-1ac590f8e660 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:59 devstack sudo[106142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913.1c1807b7-c102-49e4-8bf3-1ac590f8e660
Nov 05 19:27:59 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:59 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-57dd5a12-863f-4a4b-9ab4-391cdbb69604 tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c 1073741824" returned: 0 in 0.493s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:59 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root
Nov 05 19:27:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4a40ae99-a707-4f7b-a425-82825a40b3ef tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913.1c1807b7-c102-49e4-8bf3-1ac590f8e660" returned: 0 in 0.287s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:27:59 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-57dd5a12-863f-4a4b-9ab4-391cdbb69604 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:27:59 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4a40ae99-a707-4f7b-a425-82825a40b3ef tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-1c1807b7-c102-49e4-8bf3-1ac590f8e660" released by "_delete_snapshot" :: held 1.526s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:59 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4a40ae99-a707-4f7b-a425-82825a40b3ef tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-630d7522-74e3-489d-908c-f00eea341913" released by "delete_snapshot" :: held 1.555s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:27:59 devstack sudo[106146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c
Nov 05 19:27:59 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:27:59 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-4a40ae99-a707-4f7b-a425-82825a40b3ef tempest-ProjectMemberTests-1640873908 None] Created reservations ['14b7bc92-b0b1-4de8-a15e-5cf359005a5a', '4b7b32eb-8672-4651-b982-9a9544247342', '56354c73-d88d-4327-a3ae-f4258dbda2b6', '603b99fb-ad93-4e5c-b9f8-e45038aaa16f'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:28:00 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-4a40ae99-a707-4f7b-a425-82825a40b3ef tempest-ProjectMemberTests-1640873908 None] Delete snapshot completed successfully.
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4a40ae99-a707-4f7b-a425-82825a40b3ef tempest-ProjectMemberTests-1640873908 None] Lock "cinder-1c1807b7-c102-49e4-8bf3-1ac590f8e660-delete_snapshot" released by "delete_snapshot" :: held 1.726s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:00 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-57dd5a12-863f-4a4b-9ab4-391cdbb69604 tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c" returned: 0 in 0.279s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-57dd5a12-863f-4a4b-9ab4-391cdbb69604 tempest-ProjectReaderTests-546992118 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-57dd5a12-863f-4a4b-9ab4-391cdbb69604 tempest-ProjectReaderTests-546992118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-57dd5a12-863f-4a4b-9ab4-391cdbb69604 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9565deb3-d46c-4eac-ab19-27c9a03d2754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dfe3aa7-5afd-4527-9388-2c14a263299c', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-57dd5a12-863f-4a4b-9ab4-391cdbb69604 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71fb9e9a-970a-4072-b719-8fc6347bb8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:00 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-57dd5a12-863f-4a4b-9ab4-391cdbb69604 tempest-ProjectReaderTests-546992118 None] Volume volume-8dfe3aa7-5afd-4527-9388-2c14a263299c (8dfe3aa7-5afd-4527-9388-2c14a263299c): created successfully
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-57dd5a12-863f-4a4b-9ab4-391cdbb69604 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71fb9e9a-970a-4072-b719-8fc6347bb8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-57dd5a12-863f-4a4b-9ab4-391cdbb69604 tempest-ProjectReaderTests-546992118 None] Flow 'volume_create_manager' (1fdec900-6159-42f0-9551-3eb005807e0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:28:00 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-57dd5a12-863f-4a4b-9ab4-391cdbb69604 tempest-ProjectReaderTests-546992118 None] Created volume successfully.
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Flow 'volume_create_manager' (b3ac71c7-18e0-4a51-984e-ab3018f0c506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8d3186b-a5b3-45a6-a450-633f11b53df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8d3186b-a5b3-45a6-a450-633f11b53df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98b0cc3b-ccb8-4e55-8935-c25f05f5a359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcf98dccccfc477bafeb36a4e0fd7e5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=eba07ad7-d50a-421e-8d1f-252b2281a396,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:28:00Z,use_quota=True,user_id='316e47858baa4b559bf48fdf7ae1fe5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (524f739d-7663-4a05-aea7-7e6433fb9066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (524f739d-7663-4a05-aea7-7e6433fb9066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16783b08-891b-43c5-bb4d-44ea5c601a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16783b08-891b-43c5-bb4d-44ea5c601a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '98b0cc3b-ccb8-4e55-8935-c25f05f5a359', 'volume_name': 'volume-98b0cc3b-ccb8-4e55-8935-c25f05f5a359', 'volume_size': 1, 'snapshot_id': 'eba07ad7-d50a-421e-8d1f-252b2281a396'}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5de366ad-f295-44ba-91a0-45a065152655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5de366ad-f295-44ba-91a0-45a065152655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24210470-ed63-4cfe-a804-bcbdb4f8a59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:00 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Volume 98b0cc3b-ccb8-4e55-8935-c25f05f5a359: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-98b0cc3b-ccb8-4e55-8935-c25f05f5a359', 'volume_size': 1, 'snapshot_id': 'eba07ad7-d50a-421e-8d1f-252b2281a396'}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Acquiring lock "cinder-quobyte-eba07ad7-d50a-421e-8d1f-252b2281a396-98b0cc3b-ccb8-4e55-8935-c25f05f5a359" by "_create_volume_from_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Lock "cinder-quobyte-eba07ad7-d50a-421e-8d1f-252b2281a396-98b0cc3b-ccb8-4e55-8935-c25f05f5a359" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Creating volume 98b0cc3b-ccb8-4e55-8935-c25f05f5a359 from snapshot eba07ad7-d50a-421e-8d1f-252b2281a396 {{(pid=87184) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Acquiring lock "cinder-quobyte-98b0cc3b-ccb8-4e55-8935-c25f05f5a359" by "_copy_volume_from_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Lock "cinder-quobyte-98b0cc3b-ccb8-4e55-8935-c25f05f5a359" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] snapshot: eba07ad7-d50a-421e-8d1f-252b2281a396, volume: 98b0cc3b-ccb8-4e55-8935-c25f05f5a359,  {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cc9d15be-1e54-41c9-8a7b-86aeb1bea89b tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-630d7522-74e3-489d-908c-f00eea341913-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cc9d15be-1e54-41c9-8a7b-86aeb1bea89b tempest-ProjectMemberTests-1640873908 None] Lock "cinder-630d7522-74e3-489d-908c-f00eea341913-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c3169e-4059-43ab-94ac-b8b360ab3d07]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac.eba07ad7-d50a-421e-8d1f-252b2281a396 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cc9d15be-1e54-41c9-8a7b-86aeb1bea89b tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-quobyte-630d7522-74e3-489d-908c-f00eea341913" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cc9d15be-1e54-41c9-8a7b-86aeb1bea89b tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-630d7522-74e3-489d-908c-f00eea341913" acquired by "delete_volume" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabab157-905e-48f9-b276-10312ba4c740]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cc9d15be-1e54-41c9-8a7b-86aeb1bea89b tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:00 devstack sudo[106149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac.eba07ad7-d50a-421e-8d1f-252b2281a396
Nov 05 19:28:00 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-737f70ff-c50d-4b98-987b-0c8bf87b2c12 tempest-ProjectReaderTests-546992118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:28:00 devstack sudo[106151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913
Nov 05 19:28:00 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:00 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac.eba07ad7-d50a-421e-8d1f-252b2281a396" returned: 0 in 0.406s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0957c86a-07d6-4547-97a0-d336335562ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[19199862-36cd-4dd5-ac03-39fcc99d7426]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:28:00 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:01 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cc9d15be-1e54-41c9-8a7b-86aeb1bea89b tempest-ProjectMemberTests-1640873908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913" returned: 0 in 0.376s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cc9d15be-1e54-41c9-8a7b-86aeb1bea89b tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:01 devstack sudo[106156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac
Nov 05 19:28:01 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:01 devstack sudo[106160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913
Nov 05 19:28:01 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:01 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cc9d15be-1e54-41c9-8a7b-86aeb1bea89b tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-630d7522-74e3-489d-908c-f00eea341913" returned: 0 in 0.254s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cc9d15be-1e54-41c9-8a7b-86aeb1bea89b tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-630d7522-74e3-489d-908c-f00eea341913" released by "delete_volume" :: held 0.714s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:01 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac" returned: 0 in 0.431s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 19:28:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Creating direct copy from snapshot {{(pid=87184) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 19:28:01 devstack cinder-volume[87184]: DEBUG cinder.utils [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Path /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-98b0cc3b-ccb8-4e55-8935-c25f05f5a359 not found in is_blk_device check {{(pid=87184) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 19:28:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-98b0cc3b-ccb8-4e55-8935-c25f05f5a359 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:01 devstack sudo[106167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-98b0cc3b-ccb8-4e55-8935-c25f05f5a359
Nov 05 19:28:01 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:01 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-cc9d15be-1e54-41c9-8a7b-86aeb1bea89b tempest-ProjectMemberTests-1640873908 None] Created reservations ['f70d2d40-8797-4f7c-8086-a4698a0bf676', '3fc9a530-f2e7-4044-9087-0b29b60a7d5d', 'd7ad0d84-e464-4717-be1c-8ffe4d343349', '64f25d89-e5b0-4625-a94d-f156cd2a94e7'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:28:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cc9d15be-1e54-41c9-8a7b-86aeb1bea89b tempest-ProjectMemberTests-1640873908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:28:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cc9d15be-1e54-41c9-8a7b-86aeb1bea89b tempest-ProjectMemberTests-1640873908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:28:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-cc9d15be-1e54-41c9-8a7b-86aeb1bea89b tempest-ProjectMemberTests-1640873908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:28:01 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-cc9d15be-1e54-41c9-8a7b-86aeb1bea89b tempest-ProjectMemberTests-1640873908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:28:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cc9d15be-1e54-41c9-8a7b-86aeb1bea89b tempest-ProjectMemberTests-1640873908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:28:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cc9d15be-1e54-41c9-8a7b-86aeb1bea89b tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:01 devstack sudo[106169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:28:01 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:01 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:01 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cc9d15be-1e54-41c9-8a7b-86aeb1bea89b tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.271s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:01 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-cc9d15be-1e54-41c9-8a7b-86aeb1bea89b tempest-ProjectMemberTests-1640873908 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:28:01 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-cc9d15be-1e54-41c9-8a7b-86aeb1bea89b tempest-ProjectMemberTests-1640873908 None] Deleted volume successfully.
Nov 05 19:28:01 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cc9d15be-1e54-41c9-8a7b-86aeb1bea89b tempest-ProjectMemberTests-1640873908 None] Lock "cinder-630d7522-74e3-489d-908c-f00eea341913-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:02 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-17cee307-14ed-4cd7-96b4-833a83f4cf82 tempest-ProjectMemberTests-1640873908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:28:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-17cee307-14ed-4cd7-96b4-833a83f4cf82 tempest-ProjectMemberTests-1640873908 None] Flow 'volume_create_manager' (72d9945f-1686-4111-9a3b-1cbb75f397e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:28:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-17cee307-14ed-4cd7-96b4-833a83f4cf82 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97a107bf-7725-4537-a485-d03d35f10eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-17cee307-14ed-4cd7-96b4-833a83f4cf82 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97a107bf-7725-4537-a485-d03d35f10eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-442664037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dc14138-d502-4890-8489-da1c3ba8258d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d5b238d03346c2b35a48086a4ecc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:28:02Z,use_quota=True,user_id='9c94d9844c6446c58716ae4b34ced8c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-17cee307-14ed-4cd7-96b4-833a83f4cf82 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b03dfb18-cff0-4b61-8942-3311f9b2640b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-17cee307-14ed-4cd7-96b4-833a83f4cf82 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b03dfb18-cff0-4b61-8942-3311f9b2640b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-17cee307-14ed-4cd7-96b4-833a83f4cf82 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f6ad19d-7b64-48ce-9e82-02c821685a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-17cee307-14ed-4cd7-96b4-833a83f4cf82 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f6ad19d-7b64-48ce-9e82-02c821685a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dc14138-d502-4890-8489-da1c3ba8258d', 'volume_name': 'volume-3dc14138-d502-4890-8489-da1c3ba8258d', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-17cee307-14ed-4cd7-96b4-833a83f4cf82 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d588a815-361e-4836-ba79-fe05c94b8112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-17cee307-14ed-4cd7-96b4-833a83f4cf82 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d588a815-361e-4836-ba79-fe05c94b8112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:02 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-17cee307-14ed-4cd7-96b4-833a83f4cf82 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32749c42-03f7-4423-a330-442520273cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:02 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-17cee307-14ed-4cd7-96b4-833a83f4cf82 tempest-ProjectMemberTests-1640873908 None] Volume 3dc14138-d502-4890-8489-da1c3ba8258d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dc14138-d502-4890-8489-da1c3ba8258d', 'volume_size': 1}
Nov 05 19:28:02 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-17cee307-14ed-4cd7-96b4-833a83f4cf82 tempest-ProjectMemberTests-1640873908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:28:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:28:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:28:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:28:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:28:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:28:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:28:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:05 devstack sudo[106183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:28:05 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:05 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.321s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:05 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:28:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:28:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread count: 28 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 19:28:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread info: [<_MainThread(MainThread, started 126882883072128)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126882770872512)>, <Thread(Thread-3 (stat_writer), started daemon 126882769837376)>, <Thread(Rabbit-heartbeat, started daemon 126882768896256)>, <Thread(Thread-5 (_runner), started daemon 126882768980928)>, <Thread(Thread-7 (_runner), started daemon 126882767016448)>, <Thread(fd_logger, started daemon 126882764561216)>, <Thread(privsep_reader, started daemon 126882764568576)>, <Thread(tpool_thread_0, started daemon 126882759292608)>, <Thread(tpool_thread_1, started daemon 126882750899904)>, <Thread(tpool_thread_2, started daemon 126882742507200)>, <Thread(tpool_thread_3, started daemon 126882734114496)>, <Thread(tpool_thread_4, started daemon 126882725721792)>, <Thread(tpool_thread_5, started daemon 126882717329088)>, <Thread(tpool_thread_6, started daemon 126882708920000)>, <Thread(tpool_thread_7, started daemon 126882700510912)>, <Thread(tpool_thread_8, started daemon 126882692101824)>, <Thread(tpool_thread_9, started daemon 126882683692736)>, <Thread(tpool_thread_10, started daemon 126882675283648)>, <Thread(tpool_thread_11, started daemon 126882666874560)>, <Thread(tpool_thread_12, started daemon 126882658465472)>, <Thread(tpool_thread_13, started daemon 126882650056384)>, <Thread(tpool_thread_14, started daemon 126882641647296)>, <Thread(tpool_thread_15, started daemon 126882633238208)>, <Thread(tpool_thread_16, started daemon 126882624829120)>, <Thread(tpool_thread_17, started daemon 126882616420032)>, <Thread(tpool_thread_18, started daemon 126882608010944)>, <Thread(tpool_thread_19, started daemon 126882599601856)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 19:28:07 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-98b0cc3b-ccb8-4e55-8935-c25f05f5a359" returned: 0 in 6.095s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:07 devstack cinder-volume[87184]: DEBUG cinder.image.image_utils [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Image conversion details: src /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac, size 1024.00 MB, duration 6.10 sec, destination /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-98b0cc3b-ccb8-4e55-8935-c25f05f5a359 {{(pid=87184) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 19:28:07 devstack cinder-volume[87184]: INFO cinder.image.image_utils [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Converted 1024.00 MB image at 167.99 MB/s
Nov 05 19:28:07 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-98b0cc3b-ccb8-4e55-8935-c25f05f5a359 is being set with open permissions: ugo+rw
Nov 05 19:28:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-98b0cc3b-ccb8-4e55-8935-c25f05f5a359 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:07 devstack sudo[106187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-98b0cc3b-ccb8-4e55-8935-c25f05f5a359
Nov 05 19:28:07 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:07 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-98b0cc3b-ccb8-4e55-8935-c25f05f5a359" returned: 0 in 0.240s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Lock "cinder-quobyte-98b0cc3b-ccb8-4e55-8935-c25f05f5a359" released by "_copy_volume_from_snapshot" :: held 7.290s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:07 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Lock "cinder-quobyte-eba07ad7-d50a-421e-8d1f-252b2281a396-98b0cc3b-ccb8-4e55-8935-c25f05f5a359" released by "_create_volume_from_snapshot" :: held 7.360s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.375s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:28:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-737f70ff-c50d-4b98-987b-0c8bf87b2c12 tempest-ProjectReaderTests-546992118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.055s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:28:07 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-737f70ff-c50d-4b98-987b-0c8bf87b2c12 tempest-ProjectReaderTests-546992118 None] Creating offline snapshot bdbe8db1-67f7-4ede-9463-a141653b3e16 of volume 8dfe3aa7-5afd-4527-9388-2c14a263299c {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:28:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24210470-ed63-4cfe-a804-bcbdb4f8a59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98b0cc3b-ccb8-4e55-8935-c25f05f5a359', 'volume_size': 1, 'snapshot_id': 'eba07ad7-d50a-421e-8d1f-252b2281a396'}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2197e39-7b16-45f0-a7a5-4170920613cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:07 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d24adb-3ed7-491b-ae0f-5eaa59c473ad]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:28:07 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-737f70ff-c50d-4b98-987b-0c8bf87b2c12 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:07 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Volume volume-98b0cc3b-ccb8-4e55-8935-c25f05f5a359 (98b0cc3b-ccb8-4e55-8935-c25f05f5a359): created successfully
Nov 05 19:28:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2197e39-7b16-45f0-a7a5-4170920613cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:07 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Flow 'volume_create_manager' (b3ac71c7-18e0-4a51-984e-ab3018f0c506) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:28:07 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-428253b2-afff-4751-886a-a411910c2818 tempest-SnapshotDependencyTests-414637357 None] Created volume successfully.
Nov 05 19:28:07 devstack sudo[106190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c
Nov 05 19:28:07 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:08 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-737f70ff-c50d-4b98-987b-0c8bf87b2c12 tempest-ProjectReaderTests-546992118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c" returned: 0 in 0.362s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-737f70ff-c50d-4b98-987b-0c8bf87b2c12 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c.bdbe8db1-67f7-4ede-9463-a141653b3e16 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:08 devstack sudo[106196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c.bdbe8db1-67f7-4ede-9463-a141653b3e16 1G
Nov 05 19:28:08 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:08 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-737f70ff-c50d-4b98-987b-0c8bf87b2c12 tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c.bdbe8db1-67f7-4ede-9463-a141653b3e16 1G" returned: 0 in 0.379s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-737f70ff-c50d-4b98-987b-0c8bf87b2c12 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dfe3aa7-5afd-4527-9388-2c14a263299c -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c.bdbe8db1-67f7-4ede-9463-a141653b3e16 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:08 devstack sudo[106202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dfe3aa7-5afd-4527-9388-2c14a263299c -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c.bdbe8db1-67f7-4ede-9463-a141653b3e16
Nov 05 19:28:08 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:08 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-737f70ff-c50d-4b98-987b-0c8bf87b2c12 tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dfe3aa7-5afd-4527-9388-2c14a263299c -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c.bdbe8db1-67f7-4ede-9463-a141653b3e16" returned: 0 in 0.277s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:08 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-737f70ff-c50d-4b98-987b-0c8bf87b2c12 tempest-ProjectReaderTests-546992118 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c.bdbe8db1-67f7-4ede-9463-a141653b3e16 is being set with open permissions: ugo+rw
Nov 05 19:28:08 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-737f70ff-c50d-4b98-987b-0c8bf87b2c12 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c.bdbe8db1-67f7-4ede-9463-a141653b3e16 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:08 devstack sudo[106207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c.bdbe8db1-67f7-4ede-9463-a141653b3e16
Nov 05 19:28:08 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:08 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c4c187ac-1d2a-4772-933b-0796a86769eb tempest-SnapshotDependencyTests-414637357 None] Acquiring lock "cinder-eba07ad7-d50a-421e-8d1f-252b2281a396-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c4c187ac-1d2a-4772-933b-0796a86769eb tempest-SnapshotDependencyTests-414637357 None] Lock "cinder-eba07ad7-d50a-421e-8d1f-252b2281a396-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c4c187ac-1d2a-4772-933b-0796a86769eb tempest-SnapshotDependencyTests-414637357 None] Acquiring lock "cinder-quobyte-0957c86a-07d6-4547-97a0-d336335562ac" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c4c187ac-1d2a-4772-933b-0796a86769eb tempest-SnapshotDependencyTests-414637357 None] Lock "cinder-quobyte-0957c86a-07d6-4547-97a0-d336335562ac" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c4c187ac-1d2a-4772-933b-0796a86769eb tempest-SnapshotDependencyTests-414637357 None] Acquiring lock "cinder-quobyte-eba07ad7-d50a-421e-8d1f-252b2281a396" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:09 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c4c187ac-1d2a-4772-933b-0796a86769eb tempest-SnapshotDependencyTests-414637357 None] Lock "cinder-quobyte-eba07ad7-d50a-421e-8d1f-252b2281a396" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-c4c187ac-1d2a-4772-933b-0796a86769eb tempest-SnapshotDependencyTests-414637357 None] Deleting offline snapshot eba07ad7-d50a-421e-8d1f-252b2281a396 of volume 0957c86a-07d6-4547-97a0-d336335562ac {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:28:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-c4c187ac-1d2a-4772-933b-0796a86769eb tempest-SnapshotDependencyTests-414637357 None] snapshot_file for this snap is: volume-0957c86a-07d6-4547-97a0-d336335562ac.eba07ad7-d50a-421e-8d1f-252b2281a396 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:28:09 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e541587f-5b6f-49ef-8356-19920009978c]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:28:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c4c187ac-1d2a-4772-933b-0796a86769eb tempest-SnapshotDependencyTests-414637357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac.eba07ad7-d50a-421e-8d1f-252b2281a396 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:09 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-737f70ff-c50d-4b98-987b-0c8bf87b2c12 tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c.bdbe8db1-67f7-4ede-9463-a141653b3e16" returned: 0 in 0.274s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-737f70ff-c50d-4b98-987b-0c8bf87b2c12 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:09 devstack sudo[106211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c.info
Nov 05 19:28:09 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:09 devstack sudo[106209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac.eba07ad7-d50a-421e-8d1f-252b2281a396
Nov 05 19:28:09 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:09 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-737f70ff-c50d-4b98-987b-0c8bf87b2c12 tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c.info" returned: 0 in 0.252s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:09 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-737f70ff-c50d-4b98-987b-0c8bf87b2c12 tempest-ProjectReaderTests-546992118 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c.info is being set with open permissions: ugo+rw
Nov 05 19:28:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-737f70ff-c50d-4b98-987b-0c8bf87b2c12 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:09 devstack sudo[106218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c.info
Nov 05 19:28:09 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:09 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c4c187ac-1d2a-4772-933b-0796a86769eb tempest-SnapshotDependencyTests-414637357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac.eba07ad7-d50a-421e-8d1f-252b2281a396" returned: 0 in 0.368s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-c4c187ac-1d2a-4772-933b-0796a86769eb tempest-SnapshotDependencyTests-414637357 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0957c86a-07d6-4547-97a0-d336335562ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:28:09 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8094658d-a625-4072-a060-95294dd0c9e5]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:28:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c4c187ac-1d2a-4772-933b-0796a86769eb tempest-SnapshotDependencyTests-414637357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:09 devstack sudo[106220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac
Nov 05 19:28:09 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:09 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-737f70ff-c50d-4b98-987b-0c8bf87b2c12 tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c.info" returned: 0 in 0.255s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-737f70ff-c50d-4b98-987b-0c8bf87b2c12 tempest-ProjectReaderTests-546992118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.892s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:28:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-17cee307-14ed-4cd7-96b4-833a83f4cf82 tempest-ProjectMemberTests-1640873908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.198s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:28:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-17cee307-14ed-4cd7-96b4-833a83f4cf82 tempest-ProjectMemberTests-1640873908 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-442664037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dc14138-d502-4890-8489-da1c3ba8258d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d5b238d03346c2b35a48086a4ecc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:28:02Z,use_quota=True,user_id='9c94d9844c6446c58716ae4b34ced8c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:28:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-17cee307-14ed-4cd7-96b4-833a83f4cf82 tempest-ProjectMemberTests-1640873908 None] Creating volume 3dc14138-d502-4890-8489-da1c3ba8258d {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:28:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-17cee307-14ed-4cd7-96b4-833a83f4cf82 tempest-ProjectMemberTests-1640873908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:28:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-17cee307-14ed-4cd7-96b4-833a83f4cf82 tempest-ProjectMemberTests-1640873908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:28:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-17cee307-14ed-4cd7-96b4-833a83f4cf82 tempest-ProjectMemberTests-1640873908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:28:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-17cee307-14ed-4cd7-96b4-833a83f4cf82 tempest-ProjectMemberTests-1640873908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:28:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-17cee307-14ed-4cd7-96b4-833a83f4cf82 tempest-ProjectMemberTests-1640873908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:28:09 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-17cee307-14ed-4cd7-96b4-833a83f4cf82 tempest-ProjectMemberTests-1640873908 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:28:09 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-17cee307-14ed-4cd7-96b4-833a83f4cf82 tempest-ProjectMemberTests-1640873908 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:28:09 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-17cee307-14ed-4cd7-96b4-833a83f4cf82 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:09 devstack sudo[106223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d 1073741824
Nov 05 19:28:09 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:09 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-737f70ff-c50d-4b98-987b-0c8bf87b2c12 tempest-ProjectReaderTests-546992118 None] Create snapshot completed successfully
Nov 05 19:28:10 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c4c187ac-1d2a-4772-933b-0796a86769eb tempest-SnapshotDependencyTests-414637357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac" returned: 0 in 0.538s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c4c187ac-1d2a-4772-933b-0796a86769eb tempest-SnapshotDependencyTests-414637357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac.eba07ad7-d50a-421e-8d1f-252b2281a396 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:10 devstack sudo[106232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac.eba07ad7-d50a-421e-8d1f-252b2281a396
Nov 05 19:28:10 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-452dd0f2-02f8-4e29-a851-e5f1800d9858 tempest-ProjectReaderTests-546992118 None] Acquiring lock "cinder-bdbe8db1-67f7-4ede-9463-a141653b3e16-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:10 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-17cee307-14ed-4cd7-96b4-833a83f4cf82 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d 1073741824" returned: 0 in 0.484s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-452dd0f2-02f8-4e29-a851-e5f1800d9858 tempest-ProjectReaderTests-546992118 None] Lock "cinder-bdbe8db1-67f7-4ede-9463-a141653b3e16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-452dd0f2-02f8-4e29-a851-e5f1800d9858 tempest-ProjectReaderTests-546992118 None] Acquiring lock "cinder-quobyte-8dfe3aa7-5afd-4527-9388-2c14a263299c" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-452dd0f2-02f8-4e29-a851-e5f1800d9858 tempest-ProjectReaderTests-546992118 None] Lock "cinder-quobyte-8dfe3aa7-5afd-4527-9388-2c14a263299c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-452dd0f2-02f8-4e29-a851-e5f1800d9858 tempest-ProjectReaderTests-546992118 None] Acquiring lock "cinder-quobyte-bdbe8db1-67f7-4ede-9463-a141653b3e16" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-452dd0f2-02f8-4e29-a851-e5f1800d9858 tempest-ProjectReaderTests-546992118 None] Lock "cinder-quobyte-bdbe8db1-67f7-4ede-9463-a141653b3e16" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-452dd0f2-02f8-4e29-a851-e5f1800d9858 tempest-ProjectReaderTests-546992118 None] Deleting offline snapshot bdbe8db1-67f7-4ede-9463-a141653b3e16 of volume 8dfe3aa7-5afd-4527-9388-2c14a263299c {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:28:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-452dd0f2-02f8-4e29-a851-e5f1800d9858 tempest-ProjectReaderTests-546992118 None] snapshot_file for this snap is: volume-8dfe3aa7-5afd-4527-9388-2c14a263299c.bdbe8db1-67f7-4ede-9463-a141653b3e16 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:28:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-17cee307-14ed-4cd7-96b4-833a83f4cf82 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:10 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3caa255c-8276-4d48-9a11-790b1105ad24]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:28:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-452dd0f2-02f8-4e29-a851-e5f1800d9858 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c.bdbe8db1-67f7-4ede-9463-a141653b3e16 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:10 devstack sudo[106235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d
Nov 05 19:28:10 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:10 devstack sudo[106238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c.bdbe8db1-67f7-4ede-9463-a141653b3e16
Nov 05 19:28:10 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:10 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c4c187ac-1d2a-4772-933b-0796a86769eb tempest-SnapshotDependencyTests-414637357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac.eba07ad7-d50a-421e-8d1f-252b2281a396" returned: 0 in 0.389s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c4c187ac-1d2a-4772-933b-0796a86769eb tempest-SnapshotDependencyTests-414637357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac.eba07ad7-d50a-421e-8d1f-252b2281a396 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:10 devstack sudo[106242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac.eba07ad7-d50a-421e-8d1f-252b2281a396
Nov 05 19:28:10 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:10 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-17cee307-14ed-4cd7-96b4-833a83f4cf82 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d" returned: 0 in 0.284s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-17cee307-14ed-4cd7-96b4-833a83f4cf82 tempest-ProjectMemberTests-1640873908 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:28:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-17cee307-14ed-4cd7-96b4-833a83f4cf82 tempest-ProjectMemberTests-1640873908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:28:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-17cee307-14ed-4cd7-96b4-833a83f4cf82 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32749c42-03f7-4423-a330-442520273cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dc14138-d502-4890-8489-da1c3ba8258d', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-17cee307-14ed-4cd7-96b4-833a83f4cf82 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fa0e961-0de0-4660-ae53-51ce3b7bd602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:10 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-17cee307-14ed-4cd7-96b4-833a83f4cf82 tempest-ProjectMemberTests-1640873908 None] Volume volume-3dc14138-d502-4890-8489-da1c3ba8258d (3dc14138-d502-4890-8489-da1c3ba8258d): created successfully
Nov 05 19:28:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-17cee307-14ed-4cd7-96b4-833a83f4cf82 tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fa0e961-0de0-4660-ae53-51ce3b7bd602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:10 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-17cee307-14ed-4cd7-96b4-833a83f4cf82 tempest-ProjectMemberTests-1640873908 None] Flow 'volume_create_manager' (72d9945f-1686-4111-9a3b-1cbb75f397e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:28:10 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-17cee307-14ed-4cd7-96b4-833a83f4cf82 tempest-ProjectMemberTests-1640873908 None] Created volume successfully.
Nov 05 19:28:10 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-452dd0f2-02f8-4e29-a851-e5f1800d9858 tempest-ProjectReaderTests-546992118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c.bdbe8db1-67f7-4ede-9463-a141653b3e16" returned: 0 in 0.383s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-452dd0f2-02f8-4e29-a851-e5f1800d9858 tempest-ProjectReaderTests-546992118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8dfe3aa7-5afd-4527-9388-2c14a263299c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:28:10 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-c4c187ac-1d2a-4772-933b-0796a86769eb tempest-SnapshotDependencyTests-414637357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac.eba07ad7-d50a-421e-8d1f-252b2281a396" returned: 0 in 0.283s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:10 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a59f9d3-1577-4fd1-bac6-1c29973c3bdc]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:28:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-452dd0f2-02f8-4e29-a851-e5f1800d9858 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c4c187ac-1d2a-4772-933b-0796a86769eb tempest-SnapshotDependencyTests-414637357 None] Lock "cinder-quobyte-eba07ad7-d50a-421e-8d1f-252b2281a396" released by "_delete_snapshot" :: held 1.701s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c4c187ac-1d2a-4772-933b-0796a86769eb tempest-SnapshotDependencyTests-414637357 None] Lock "cinder-quobyte-0957c86a-07d6-4547-97a0-d336335562ac" released by "delete_snapshot" :: held 1.728s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:10 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-c4c187ac-1d2a-4772-933b-0796a86769eb tempest-SnapshotDependencyTests-414637357 None] Created reservations ['ba524737-e8e4-4cee-acc7-2d80ea959ce7', 'a8ef1cfc-598a-4f8e-8eec-fde1518ed082', 'c84d2e9f-1c71-4315-8290-8ca133b7dec5', '3e4cdac5-876c-412e-b31d-8c60064e898b'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:28:10 devstack sudo[106249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c
Nov 05 19:28:10 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:10 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-c4c187ac-1d2a-4772-933b-0796a86769eb tempest-SnapshotDependencyTests-414637357 None] Delete snapshot completed successfully.
Nov 05 19:28:10 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-c4c187ac-1d2a-4772-933b-0796a86769eb tempest-SnapshotDependencyTests-414637357 None] Lock "cinder-eba07ad7-d50a-421e-8d1f-252b2281a396-delete_snapshot" released by "delete_snapshot" :: held 1.903s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-97a7990d-b51d-4261-94cc-cc6af3a581c4 tempest-ProjectMemberTests-1640873908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:28:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-97a7990d-b51d-4261-94cc-cc6af3a581c4 tempest-ProjectMemberTests-1640873908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:28:10 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-97a7990d-b51d-4261-94cc-cc6af3a581c4 tempest-ProjectMemberTests-1640873908 None] Creating offline snapshot eca34faa-73e8-43c3-9c47-5acf83f681a3 of volume 3dc14138-d502-4890-8489-da1c3ba8258d {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:28:10 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fac48ca-437c-4ef6-9333-5c855a9978fc]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:28:10 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-97a7990d-b51d-4261-94cc-cc6af3a581c4 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:11 devstack sudo[106251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d
Nov 05 19:28:11 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:11 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-452dd0f2-02f8-4e29-a851-e5f1800d9858 tempest-ProjectReaderTests-546992118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c" returned: 0 in 0.417s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-452dd0f2-02f8-4e29-a851-e5f1800d9858 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c.bdbe8db1-67f7-4ede-9463-a141653b3e16 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4f50f290-06f1-4415-a746-5a32674d3358 tempest-SnapshotDependencyTests-414637357 None] Acquiring lock "cinder-0957c86a-07d6-4547-97a0-d336335562ac-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:11 devstack sudo[106256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c.bdbe8db1-67f7-4ede-9463-a141653b3e16
Nov 05 19:28:11 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4f50f290-06f1-4415-a746-5a32674d3358 tempest-SnapshotDependencyTests-414637357 None] Lock "cinder-0957c86a-07d6-4547-97a0-d336335562ac-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4f50f290-06f1-4415-a746-5a32674d3358 tempest-SnapshotDependencyTests-414637357 None] Acquiring lock "cinder-quobyte-0957c86a-07d6-4547-97a0-d336335562ac" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4f50f290-06f1-4415-a746-5a32674d3358 tempest-SnapshotDependencyTests-414637357 None] Lock "cinder-quobyte-0957c86a-07d6-4547-97a0-d336335562ac" acquired by "delete_volume" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:11 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e361a795-c7fe-4c6d-9ad8-23b7a3db6869]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:28:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4f50f290-06f1-4415-a746-5a32674d3358 tempest-SnapshotDependencyTests-414637357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:11 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-97a7990d-b51d-4261-94cc-cc6af3a581c4 tempest-ProjectMemberTests-1640873908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d" returned: 0 in 0.441s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-97a7990d-b51d-4261-94cc-cc6af3a581c4 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d.eca34faa-73e8-43c3-9c47-5acf83f681a3 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:11 devstack sudo[106263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d.eca34faa-73e8-43c3-9c47-5acf83f681a3 1G
Nov 05 19:28:11 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:11 devstack sudo[106260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac
Nov 05 19:28:11 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:11 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-452dd0f2-02f8-4e29-a851-e5f1800d9858 tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c.bdbe8db1-67f7-4ede-9463-a141653b3e16" returned: 0 in 0.420s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-452dd0f2-02f8-4e29-a851-e5f1800d9858 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c.bdbe8db1-67f7-4ede-9463-a141653b3e16 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:11 devstack sudo[106268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c.bdbe8db1-67f7-4ede-9463-a141653b3e16
Nov 05 19:28:11 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:11 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4f50f290-06f1-4415-a746-5a32674d3358 tempest-SnapshotDependencyTests-414637357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac" returned: 0 in 0.381s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4f50f290-06f1-4415-a746-5a32674d3358 tempest-SnapshotDependencyTests-414637357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:11 devstack sudo[106276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac
Nov 05 19:28:11 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:11 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-97a7990d-b51d-4261-94cc-cc6af3a581c4 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d.eca34faa-73e8-43c3-9c47-5acf83f681a3 1G" returned: 0 in 0.420s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-97a7990d-b51d-4261-94cc-cc6af3a581c4 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dc14138-d502-4890-8489-da1c3ba8258d -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d.eca34faa-73e8-43c3-9c47-5acf83f681a3 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:11 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:11 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-452dd0f2-02f8-4e29-a851-e5f1800d9858 tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c.bdbe8db1-67f7-4ede-9463-a141653b3e16" returned: 0 in 0.286s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:11 devstack sudo[106280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dc14138-d502-4890-8489-da1c3ba8258d -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d.eca34faa-73e8-43c3-9c47-5acf83f681a3
Nov 05 19:28:11 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-452dd0f2-02f8-4e29-a851-e5f1800d9858 tempest-ProjectReaderTests-546992118 None] Lock "cinder-quobyte-bdbe8db1-67f7-4ede-9463-a141653b3e16" released by "_delete_snapshot" :: held 1.667s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:11 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-452dd0f2-02f8-4e29-a851-e5f1800d9858 tempest-ProjectReaderTests-546992118 None] Lock "cinder-quobyte-8dfe3aa7-5afd-4527-9388-2c14a263299c" released by "delete_snapshot" :: held 1.695s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:11 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-452dd0f2-02f8-4e29-a851-e5f1800d9858 tempest-ProjectReaderTests-546992118 None] Created reservations ['55f97498-0454-46fb-be47-67b24bb0ed88', '25d15d18-eb51-4ac5-8bb7-134768584775', '28332e49-4823-4dd1-926d-32e37d13c584', '67ebafa6-0489-479b-adf2-a4d7c8bfbbd4'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:28:12 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4f50f290-06f1-4415-a746-5a32674d3358 tempest-SnapshotDependencyTests-414637357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-0957c86a-07d6-4547-97a0-d336335562ac" returned: 0 in 0.278s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:12 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-452dd0f2-02f8-4e29-a851-e5f1800d9858 tempest-ProjectReaderTests-546992118 None] Delete snapshot completed successfully.
Nov 05 19:28:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4f50f290-06f1-4415-a746-5a32674d3358 tempest-SnapshotDependencyTests-414637357 None] Lock "cinder-quobyte-0957c86a-07d6-4547-97a0-d336335562ac" released by "delete_volume" :: held 0.736s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-452dd0f2-02f8-4e29-a851-e5f1800d9858 tempest-ProjectReaderTests-546992118 None] Lock "cinder-bdbe8db1-67f7-4ede-9463-a141653b3e16-delete_snapshot" released by "delete_snapshot" :: held 1.856s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:12 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-4f50f290-06f1-4415-a746-5a32674d3358 tempest-SnapshotDependencyTests-414637357 None] Created reservations ['59ba7bad-e802-4a97-9e8c-9e6990fd9131', '3aaebb4e-04e5-4d0a-a682-8ccfbf4b9de2', 'c0f79f07-fea8-4072-b63a-03ac4fb931ce', 'cfa0bbb6-d37b-4133-9607-057e59ee9ba7'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:28:12 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-97a7990d-b51d-4261-94cc-cc6af3a581c4 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dc14138-d502-4890-8489-da1c3ba8258d -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d.eca34faa-73e8-43c3-9c47-5acf83f681a3" returned: 0 in 0.309s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:12 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-97a7990d-b51d-4261-94cc-cc6af3a581c4 tempest-ProjectMemberTests-1640873908 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d.eca34faa-73e8-43c3-9c47-5acf83f681a3 is being set with open permissions: ugo+rw
Nov 05 19:28:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-97a7990d-b51d-4261-94cc-cc6af3a581c4 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d.eca34faa-73e8-43c3-9c47-5acf83f681a3 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4f50f290-06f1-4415-a746-5a32674d3358 tempest-SnapshotDependencyTests-414637357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:28:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4f50f290-06f1-4415-a746-5a32674d3358 tempest-SnapshotDependencyTests-414637357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:28:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4f50f290-06f1-4415-a746-5a32674d3358 tempest-SnapshotDependencyTests-414637357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:28:12 devstack sudo[106287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d.eca34faa-73e8-43c3-9c47-5acf83f681a3
Nov 05 19:28:12 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:12 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-4f50f290-06f1-4415-a746-5a32674d3358 tempest-SnapshotDependencyTests-414637357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:28:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-4f50f290-06f1-4415-a746-5a32674d3358 tempest-SnapshotDependencyTests-414637357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:28:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4f50f290-06f1-4415-a746-5a32674d3358 tempest-SnapshotDependencyTests-414637357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:12 devstack sudo[106289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:28:12 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b44e4afe-e437-45e6-b70c-8728e12066e3 tempest-ProjectReaderTests-546992118 None] Acquiring lock "cinder-8dfe3aa7-5afd-4527-9388-2c14a263299c-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b44e4afe-e437-45e6-b70c-8728e12066e3 tempest-ProjectReaderTests-546992118 None] Lock "cinder-8dfe3aa7-5afd-4527-9388-2c14a263299c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:12 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b4ab3587-045e-41c7-abd0-deb508f42906 tempest-SnapshotDependencyTests-414637357 None] Acquiring lock "cinder-98b0cc3b-ccb8-4e55-8935-c25f05f5a359-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-97a7990d-b51d-4261-94cc-cc6af3a581c4 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d.eca34faa-73e8-43c3-9c47-5acf83f681a3" returned: 0 in 0.283s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b44e4afe-e437-45e6-b70c-8728e12066e3 tempest-ProjectReaderTests-546992118 None] Acquiring lock "cinder-quobyte-8dfe3aa7-5afd-4527-9388-2c14a263299c" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b4ab3587-045e-41c7-abd0-deb508f42906 tempest-SnapshotDependencyTests-414637357 None] Lock "cinder-98b0cc3b-ccb8-4e55-8935-c25f05f5a359-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:12 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b44e4afe-e437-45e6-b70c-8728e12066e3 tempest-ProjectReaderTests-546992118 None] Lock "cinder-quobyte-8dfe3aa7-5afd-4527-9388-2c14a263299c" acquired by "delete_volume" :: waited 0.036s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-97a7990d-b51d-4261-94cc-cc6af3a581c4 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:12 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[303a7930-1fa8-4f77-82eb-35adbdc9a1f2]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:28:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b44e4afe-e437-45e6-b70c-8728e12066e3 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-4f50f290-06f1-4415-a746-5a32674d3358 tempest-SnapshotDependencyTests-414637357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.373s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:12 devstack sudo[106293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d.info
Nov 05 19:28:12 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:12 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-4f50f290-06f1-4415-a746-5a32674d3358 tempest-SnapshotDependencyTests-414637357 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:28:12 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-4f50f290-06f1-4415-a746-5a32674d3358 tempest-SnapshotDependencyTests-414637357 None] Deleted volume successfully.
Nov 05 19:28:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b4ab3587-045e-41c7-abd0-deb508f42906 tempest-SnapshotDependencyTests-414637357 None] Acquiring lock "cinder-quobyte-98b0cc3b-ccb8-4e55-8935-c25f05f5a359" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-4f50f290-06f1-4415-a746-5a32674d3358 tempest-SnapshotDependencyTests-414637357 None] Lock "cinder-0957c86a-07d6-4547-97a0-d336335562ac-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:12 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b4ab3587-045e-41c7-abd0-deb508f42906 tempest-SnapshotDependencyTests-414637357 None] Lock "cinder-quobyte-98b0cc3b-ccb8-4e55-8935-c25f05f5a359" acquired by "delete_volume" :: waited 0.023s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:12 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8161aff8-2c88-4a1c-8472-78ca660060a2]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:28:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b4ab3587-045e-41c7-abd0-deb508f42906 tempest-SnapshotDependencyTests-414637357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-98b0cc3b-ccb8-4e55-8935-c25f05f5a359 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:12 devstack sudo[106294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c
Nov 05 19:28:12 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:12 devstack sudo[106296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-98b0cc3b-ccb8-4e55-8935-c25f05f5a359
Nov 05 19:28:12 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:12 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-97a7990d-b51d-4261-94cc-cc6af3a581c4 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d.info" returned: 0 in 0.274s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:12 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-97a7990d-b51d-4261-94cc-cc6af3a581c4 tempest-ProjectMemberTests-1640873908 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d.info is being set with open permissions: ugo+rw
Nov 05 19:28:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-97a7990d-b51d-4261-94cc-cc6af3a581c4 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:12 devstack sudo[106300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d.info
Nov 05 19:28:12 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:12 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b44e4afe-e437-45e6-b70c-8728e12066e3 tempest-ProjectReaderTests-546992118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c" returned: 0 in 0.395s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:12 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b44e4afe-e437-45e6-b70c-8728e12066e3 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:12 devstack sudo[106305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c
Nov 05 19:28:12 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:13 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b4ab3587-045e-41c7-abd0-deb508f42906 tempest-SnapshotDependencyTests-414637357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-98b0cc3b-ccb8-4e55-8935-c25f05f5a359" returned: 0 in 0.416s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b4ab3587-045e-41c7-abd0-deb508f42906 tempest-SnapshotDependencyTests-414637357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-98b0cc3b-ccb8-4e55-8935-c25f05f5a359 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:13 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-97a7990d-b51d-4261-94cc-cc6af3a581c4 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d.info" returned: 0 in 0.276s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:13 devstack sudo[106311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-98b0cc3b-ccb8-4e55-8935-c25f05f5a359
Nov 05 19:28:13 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-97a7990d-b51d-4261-94cc-cc6af3a581c4 tempest-ProjectMemberTests-1640873908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.150s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:28:13 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-97a7990d-b51d-4261-94cc-cc6af3a581c4 tempest-ProjectMemberTests-1640873908 None] Create snapshot completed successfully
Nov 05 19:28:13 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b44e4afe-e437-45e6-b70c-8728e12066e3 tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-8dfe3aa7-5afd-4527-9388-2c14a263299c" returned: 0 in 0.271s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b44e4afe-e437-45e6-b70c-8728e12066e3 tempest-ProjectReaderTests-546992118 None] Lock "cinder-quobyte-8dfe3aa7-5afd-4527-9388-2c14a263299c" released by "delete_volume" :: held 0.736s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:13 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-b44e4afe-e437-45e6-b70c-8728e12066e3 tempest-ProjectReaderTests-546992118 None] Created reservations ['4e3bf15a-3165-4711-94d9-416d11767ff7', '7c9ff4ee-022e-4b55-9a10-13ba82fbc756', 'db603113-2012-4b92-b121-ff436af1a3fd', '8002722e-ae05-48d6-a850-2a55b1052f03'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:28:13 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b4ab3587-045e-41c7-abd0-deb508f42906 tempest-SnapshotDependencyTests-414637357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-98b0cc3b-ccb8-4e55-8935-c25f05f5a359" returned: 0 in 0.268s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b4ab3587-045e-41c7-abd0-deb508f42906 tempest-SnapshotDependencyTests-414637357 None] Lock "cinder-quobyte-98b0cc3b-ccb8-4e55-8935-c25f05f5a359" released by "delete_volume" :: held 0.736s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b44e4afe-e437-45e6-b70c-8728e12066e3 tempest-ProjectReaderTests-546992118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:28:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b44e4afe-e437-45e6-b70c-8728e12066e3 tempest-ProjectReaderTests-546992118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:28:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b44e4afe-e437-45e6-b70c-8728e12066e3 tempest-ProjectReaderTests-546992118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:28:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b44e4afe-e437-45e6-b70c-8728e12066e3 tempest-ProjectReaderTests-546992118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:28:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b44e4afe-e437-45e6-b70c-8728e12066e3 tempest-ProjectReaderTests-546992118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:28:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b44e4afe-e437-45e6-b70c-8728e12066e3 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:13 devstack sudo[106315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:28:13 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:13 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-b4ab3587-045e-41c7-abd0-deb508f42906 tempest-SnapshotDependencyTests-414637357 None] Created reservations ['17bf6c07-9fc9-4b6b-8abc-7c1a6fcf22d1', '31aa798e-a73e-4d4b-b019-aad7342a3378', '5da1307e-6b89-4c4b-8726-cf6399528cee', '01f770a8-6924-4475-9578-62088dacaa6e'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:28:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b4ab3587-045e-41c7-abd0-deb508f42906 tempest-SnapshotDependencyTests-414637357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:28:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b4ab3587-045e-41c7-abd0-deb508f42906 tempest-SnapshotDependencyTests-414637357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:28:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b4ab3587-045e-41c7-abd0-deb508f42906 tempest-SnapshotDependencyTests-414637357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:28:13 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-b4ab3587-045e-41c7-abd0-deb508f42906 tempest-SnapshotDependencyTests-414637357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:28:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-b4ab3587-045e-41c7-abd0-deb508f42906 tempest-SnapshotDependencyTests-414637357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:28:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b4ab3587-045e-41c7-abd0-deb508f42906 tempest-SnapshotDependencyTests-414637357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:13 devstack sudo[106317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:28:13 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:13 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b44e4afe-e437-45e6-b70c-8728e12066e3 tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.298s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:13 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-b44e4afe-e437-45e6-b70c-8728e12066e3 tempest-ProjectReaderTests-546992118 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:28:13 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b44e4afe-e437-45e6-b70c-8728e12066e3 tempest-ProjectReaderTests-546992118 None] Deleted volume successfully.
Nov 05 19:28:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b44e4afe-e437-45e6-b70c-8728e12066e3 tempest-ProjectReaderTests-546992118 None] Lock "cinder-8dfe3aa7-5afd-4527-9388-2c14a263299c-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:13 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:13 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-b4ab3587-045e-41c7-abd0-deb508f42906 tempest-SnapshotDependencyTests-414637357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.303s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:13 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-b4ab3587-045e-41c7-abd0-deb508f42906 tempest-SnapshotDependencyTests-414637357 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:28:13 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-b4ab3587-045e-41c7-abd0-deb508f42906 tempest-SnapshotDependencyTests-414637357 None] Deleted volume successfully.
Nov 05 19:28:13 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-b4ab3587-045e-41c7-abd0-deb508f42906 tempest-SnapshotDependencyTests-414637357 None] Lock "cinder-98b0cc3b-ccb8-4e55-8935-c25f05f5a359-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:14 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2681d0e-2003-4a02-ae9c-3787dbab7ca7 tempest-ProjectReaderTests-546992118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:28:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f2681d0e-2003-4a02-ae9c-3787dbab7ca7 tempest-ProjectReaderTests-546992118 None] Flow 'volume_create_manager' (6250b32e-8e27-4b3c-b553-a8abb3ba9a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:28:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f2681d0e-2003-4a02-ae9c-3787dbab7ca7 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1825f22-847f-4548-9480-c979e772e422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f2681d0e-2003-4a02-ae9c-3787dbab7ca7 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1825f22-847f-4548-9480-c979e772e422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-444276883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=192b4eae-a313-486e-b190-c58bab72d247,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8b6de85a1d742f78e908c889957f3d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:28:14Z,use_quota=True,user_id='60990ab9a4554795bcd64339eacaa724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f2681d0e-2003-4a02-ae9c-3787dbab7ca7 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (907e709f-a0ea-46bd-afc3-a3c14821cc17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f2681d0e-2003-4a02-ae9c-3787dbab7ca7 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (907e709f-a0ea-46bd-afc3-a3c14821cc17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f2681d0e-2003-4a02-ae9c-3787dbab7ca7 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89803bfd-2d67-4ab9-a98c-3b670a27ec1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f2681d0e-2003-4a02-ae9c-3787dbab7ca7 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89803bfd-2d67-4ab9-a98c-3b670a27ec1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '192b4eae-a313-486e-b190-c58bab72d247', 'volume_name': 'volume-192b4eae-a313-486e-b190-c58bab72d247', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f2681d0e-2003-4a02-ae9c-3787dbab7ca7 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8233fda6-15e3-4259-af36-147f735f637c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f2681d0e-2003-4a02-ae9c-3787dbab7ca7 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8233fda6-15e3-4259-af36-147f735f637c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:14 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f2681d0e-2003-4a02-ae9c-3787dbab7ca7 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efe858fd-aad9-4763-b5dc-9a6848e3f0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:14 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-f2681d0e-2003-4a02-ae9c-3787dbab7ca7 tempest-ProjectReaderTests-546992118 None] Volume 192b4eae-a313-486e-b190-c58bab72d247: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-192b4eae-a313-486e-b190-c58bab72d247', 'volume_size': 1}
Nov 05 19:28:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f2681d0e-2003-4a02-ae9c-3787dbab7ca7 tempest-ProjectReaderTests-546992118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:28:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f2681d0e-2003-4a02-ae9c-3787dbab7ca7 tempest-ProjectReaderTests-546992118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:28:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f2681d0e-2003-4a02-ae9c-3787dbab7ca7 tempest-ProjectReaderTests-546992118 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-444276883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=192b4eae-a313-486e-b190-c58bab72d247,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8b6de85a1d742f78e908c889957f3d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:28:14Z,use_quota=True,user_id='60990ab9a4554795bcd64339eacaa724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:28:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-f2681d0e-2003-4a02-ae9c-3787dbab7ca7 tempest-ProjectReaderTests-546992118 None] Creating volume 192b4eae-a313-486e-b190-c58bab72d247 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:28:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f2681d0e-2003-4a02-ae9c-3787dbab7ca7 tempest-ProjectReaderTests-546992118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:28:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f2681d0e-2003-4a02-ae9c-3787dbab7ca7 tempest-ProjectReaderTests-546992118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:28:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f2681d0e-2003-4a02-ae9c-3787dbab7ca7 tempest-ProjectReaderTests-546992118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:28:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f2681d0e-2003-4a02-ae9c-3787dbab7ca7 tempest-ProjectReaderTests-546992118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:28:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f2681d0e-2003-4a02-ae9c-3787dbab7ca7 tempest-ProjectReaderTests-546992118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:28:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f2681d0e-2003-4a02-ae9c-3787dbab7ca7 tempest-ProjectReaderTests-546992118 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:28:14 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-f2681d0e-2003-4a02-ae9c-3787dbab7ca7 tempest-ProjectReaderTests-546992118 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:28:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f2681d0e-2003-4a02-ae9c-3787dbab7ca7 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e52ea23f-f7a1-427d-be2f-27431544a57e tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-eca34faa-73e8-43c3-9c47-5acf83f681a3-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:14 devstack sudo[106321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247 1073741824
Nov 05 19:28:14 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e52ea23f-f7a1-427d-be2f-27431544a57e tempest-ProjectMemberTests-1640873908 None] Lock "cinder-eca34faa-73e8-43c3-9c47-5acf83f681a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e52ea23f-f7a1-427d-be2f-27431544a57e tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-quobyte-3dc14138-d502-4890-8489-da1c3ba8258d" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e52ea23f-f7a1-427d-be2f-27431544a57e tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-3dc14138-d502-4890-8489-da1c3ba8258d" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e52ea23f-f7a1-427d-be2f-27431544a57e tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-quobyte-eca34faa-73e8-43c3-9c47-5acf83f681a3" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:14 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e52ea23f-f7a1-427d-be2f-27431544a57e tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-eca34faa-73e8-43c3-9c47-5acf83f681a3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-e52ea23f-f7a1-427d-be2f-27431544a57e tempest-ProjectMemberTests-1640873908 None] Deleting offline snapshot eca34faa-73e8-43c3-9c47-5acf83f681a3 of volume 3dc14138-d502-4890-8489-da1c3ba8258d {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:28:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-e52ea23f-f7a1-427d-be2f-27431544a57e tempest-ProjectMemberTests-1640873908 None] snapshot_file for this snap is: volume-3dc14138-d502-4890-8489-da1c3ba8258d.eca34faa-73e8-43c3-9c47-5acf83f681a3 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:28:14 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f385f2ce-afcf-487c-85d9-58a4b9194f5d]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:28:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e52ea23f-f7a1-427d-be2f-27431544a57e tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d.eca34faa-73e8-43c3-9c47-5acf83f681a3 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:14 devstack sudo[106323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d.eca34faa-73e8-43c3-9c47-5acf83f681a3
Nov 05 19:28:14 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:14 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f2681d0e-2003-4a02-ae9c-3787dbab7ca7 tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247 1073741824" returned: 0 in 0.500s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:14 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e52ea23f-f7a1-427d-be2f-27431544a57e tempest-ProjectMemberTests-1640873908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d.eca34faa-73e8-43c3-9c47-5acf83f681a3" returned: 0 in 0.411s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-e52ea23f-f7a1-427d-be2f-27431544a57e tempest-ProjectMemberTests-1640873908 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dc14138-d502-4890-8489-da1c3ba8258d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:28:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f2681d0e-2003-4a02-ae9c-3787dbab7ca7 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:14 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbb6fe7-c1bb-498a-ab9d-8d8822d04663]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:28:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e52ea23f-f7a1-427d-be2f-27431544a57e tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:14 devstack sudo[106331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247
Nov 05 19:28:14 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:14 devstack sudo[106332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d
Nov 05 19:28:14 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:14 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f2681d0e-2003-4a02-ae9c-3787dbab7ca7 tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247" returned: 0 in 0.268s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:14 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-f2681d0e-2003-4a02-ae9c-3787dbab7ca7 tempest-ProjectReaderTests-546992118 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:28:14 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f2681d0e-2003-4a02-ae9c-3787dbab7ca7 tempest-ProjectReaderTests-546992118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:28:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f2681d0e-2003-4a02-ae9c-3787dbab7ca7 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efe858fd-aad9-4763-b5dc-9a6848e3f0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-192b4eae-a313-486e-b190-c58bab72d247', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f2681d0e-2003-4a02-ae9c-3787dbab7ca7 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f1dca10-e46f-4613-a039-922f1b123ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:15 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-f2681d0e-2003-4a02-ae9c-3787dbab7ca7 tempest-ProjectReaderTests-546992118 None] Volume volume-192b4eae-a313-486e-b190-c58bab72d247 (192b4eae-a313-486e-b190-c58bab72d247): created successfully
Nov 05 19:28:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f2681d0e-2003-4a02-ae9c-3787dbab7ca7 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f1dca10-e46f-4613-a039-922f1b123ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:15 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-f2681d0e-2003-4a02-ae9c-3787dbab7ca7 tempest-ProjectReaderTests-546992118 None] Flow 'volume_create_manager' (6250b32e-8e27-4b3c-b553-a8abb3ba9a49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:28:15 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f2681d0e-2003-4a02-ae9c-3787dbab7ca7 tempest-ProjectReaderTests-546992118 None] Created volume successfully.
Nov 05 19:28:15 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e52ea23f-f7a1-427d-be2f-27431544a57e tempest-ProjectMemberTests-1640873908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d" returned: 0 in 0.382s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e52ea23f-f7a1-427d-be2f-27431544a57e tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d.eca34faa-73e8-43c3-9c47-5acf83f681a3 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:15 devstack sudo[106340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d.eca34faa-73e8-43c3-9c47-5acf83f681a3
Nov 05 19:28:15 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:15 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e52ea23f-f7a1-427d-be2f-27431544a57e tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d.eca34faa-73e8-43c3-9c47-5acf83f681a3" returned: 0 in 0.387s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e52ea23f-f7a1-427d-be2f-27431544a57e tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d.eca34faa-73e8-43c3-9c47-5acf83f681a3 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:15 devstack sudo[106346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d.eca34faa-73e8-43c3-9c47-5acf83f681a3
Nov 05 19:28:15 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:15 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:15 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e52ea23f-f7a1-427d-be2f-27431544a57e tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d.eca34faa-73e8-43c3-9c47-5acf83f681a3" returned: 0 in 0.248s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e52ea23f-f7a1-427d-be2f-27431544a57e tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-eca34faa-73e8-43c3-9c47-5acf83f681a3" released by "_delete_snapshot" :: held 1.558s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e52ea23f-f7a1-427d-be2f-27431544a57e tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-3dc14138-d502-4890-8489-da1c3ba8258d" released by "delete_snapshot" :: held 1.582s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:15 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-e52ea23f-f7a1-427d-be2f-27431544a57e tempest-ProjectMemberTests-1640873908 None] Created reservations ['e1f53e1c-4a20-471c-8ea8-767efdc323b5', 'f03925d6-43c1-45a5-94b6-285337d89530', '0d31bbe6-0619-4257-a711-30db7a01dade', '3065d8b9-d7be-432d-8919-9b6d8cb1bcd9'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:28:15 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-e52ea23f-f7a1-427d-be2f-27431544a57e tempest-ProjectMemberTests-1640873908 None] Delete snapshot completed successfully.
Nov 05 19:28:15 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-e52ea23f-f7a1-427d-be2f-27431544a57e tempest-ProjectMemberTests-1640873908 None] Lock "cinder-eca34faa-73e8-43c3-9c47-5acf83f681a3-delete_snapshot" released by "delete_snapshot" :: held 1.713s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f7b2610f-ccbc-47bb-a835-018ebac532aa tempest-ProjectReaderTests-546992118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:28:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f7b2610f-ccbc-47bb-a835-018ebac532aa tempest-ProjectReaderTests-546992118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:28:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cbb7b1b6-5fa4-4ad7-9a84-64716c70e7b8 tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-3dc14138-d502-4890-8489-da1c3ba8258d-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:16 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-f7b2610f-ccbc-47bb-a835-018ebac532aa tempest-ProjectReaderTests-546992118 None] Creating offline snapshot d2905831-ae82-4368-a6a5-4e77e51e3bb0 of volume 192b4eae-a313-486e-b190-c58bab72d247 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:28:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cbb7b1b6-5fa4-4ad7-9a84-64716c70e7b8 tempest-ProjectMemberTests-1640873908 None] Lock "cinder-3dc14138-d502-4890-8489-da1c3ba8258d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:16 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[606a20c2-17d5-4269-98b0-302ab14104a4]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:28:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f7b2610f-ccbc-47bb-a835-018ebac532aa tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cbb7b1b6-5fa4-4ad7-9a84-64716c70e7b8 tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-quobyte-3dc14138-d502-4890-8489-da1c3ba8258d" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:16 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cbb7b1b6-5fa4-4ad7-9a84-64716c70e7b8 tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-3dc14138-d502-4890-8489-da1c3ba8258d" acquired by "delete_volume" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:16 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76c872b-6cf6-47a1-a8c1-d465bcacf336]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:28:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cbb7b1b6-5fa4-4ad7-9a84-64716c70e7b8 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:16 devstack sudo[106349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247
Nov 05 19:28:16 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:16 devstack sudo[106350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d
Nov 05 19:28:16 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:16 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f7b2610f-ccbc-47bb-a835-018ebac532aa tempest-ProjectReaderTests-546992118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247" returned: 0 in 0.379s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f7b2610f-ccbc-47bb-a835-018ebac532aa tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247.d2905831-ae82-4368-a6a5-4e77e51e3bb0 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:16 devstack sudo[106356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247.d2905831-ae82-4368-a6a5-4e77e51e3bb0 1G
Nov 05 19:28:16 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:16 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cbb7b1b6-5fa4-4ad7-9a84-64716c70e7b8 tempest-ProjectMemberTests-1640873908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d" returned: 0 in 0.372s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:16 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cbb7b1b6-5fa4-4ad7-9a84-64716c70e7b8 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:16 devstack sudo[106361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d
Nov 05 19:28:16 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:17 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cbb7b1b6-5fa4-4ad7-9a84-64716c70e7b8 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-3dc14138-d502-4890-8489-da1c3ba8258d" returned: 0 in 0.244s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cbb7b1b6-5fa4-4ad7-9a84-64716c70e7b8 tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-3dc14138-d502-4890-8489-da1c3ba8258d" released by "delete_volume" :: held 0.695s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:17 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-cbb7b1b6-5fa4-4ad7-9a84-64716c70e7b8 tempest-ProjectMemberTests-1640873908 None] Created reservations ['4862aed8-e581-4efb-b0b1-25daf9521a85', 'b1bd088b-a219-4748-bbc1-fa6e1a9715f3', 'b5a63187-e467-48aa-b25c-b239ef545f12', 'b3fe6db1-bf07-472c-9a91-7e17404144f8'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:28:17 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f7b2610f-ccbc-47bb-a835-018ebac532aa tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247.d2905831-ae82-4368-a6a5-4e77e51e3bb0 1G" returned: 0 in 0.559s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f7b2610f-ccbc-47bb-a835-018ebac532aa tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-192b4eae-a313-486e-b190-c58bab72d247 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247.d2905831-ae82-4368-a6a5-4e77e51e3bb0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:17 devstack sudo[106367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-192b4eae-a313-486e-b190-c58bab72d247 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247.d2905831-ae82-4368-a6a5-4e77e51e3bb0
Nov 05 19:28:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cbb7b1b6-5fa4-4ad7-9a84-64716c70e7b8 tempest-ProjectMemberTests-1640873908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:28:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cbb7b1b6-5fa4-4ad7-9a84-64716c70e7b8 tempest-ProjectMemberTests-1640873908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:28:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-cbb7b1b6-5fa4-4ad7-9a84-64716c70e7b8 tempest-ProjectMemberTests-1640873908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:28:17 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:17 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-cbb7b1b6-5fa4-4ad7-9a84-64716c70e7b8 tempest-ProjectMemberTests-1640873908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:28:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-cbb7b1b6-5fa4-4ad7-9a84-64716c70e7b8 tempest-ProjectMemberTests-1640873908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:28:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cbb7b1b6-5fa4-4ad7-9a84-64716c70e7b8 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:17 devstack sudo[106369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:28:17 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:17 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-cbb7b1b6-5fa4-4ad7-9a84-64716c70e7b8 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.313s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:17 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-cbb7b1b6-5fa4-4ad7-9a84-64716c70e7b8 tempest-ProjectMemberTests-1640873908 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:28:17 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-cbb7b1b6-5fa4-4ad7-9a84-64716c70e7b8 tempest-ProjectMemberTests-1640873908 None] Deleted volume successfully.
Nov 05 19:28:17 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f7b2610f-ccbc-47bb-a835-018ebac532aa tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-192b4eae-a313-486e-b190-c58bab72d247 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247.d2905831-ae82-4368-a6a5-4e77e51e3bb0" returned: 0 in 0.378s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:17 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-f7b2610f-ccbc-47bb-a835-018ebac532aa tempest-ProjectReaderTests-546992118 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247.d2905831-ae82-4368-a6a5-4e77e51e3bb0 is being set with open permissions: ugo+rw
Nov 05 19:28:17 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f7b2610f-ccbc-47bb-a835-018ebac532aa tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247.d2905831-ae82-4368-a6a5-4e77e51e3bb0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:17 devstack sudo[106377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247.d2905831-ae82-4368-a6a5-4e77e51e3bb0
Nov 05 19:28:17 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:17 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-cbb7b1b6-5fa4-4ad7-9a84-64716c70e7b8 tempest-ProjectMemberTests-1640873908 None] Lock "cinder-3dc14138-d502-4890-8489-da1c3ba8258d-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:18 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f7b2610f-ccbc-47bb-a835-018ebac532aa tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247.d2905831-ae82-4368-a6a5-4e77e51e3bb0" returned: 0 in 0.289s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f7b2610f-ccbc-47bb-a835-018ebac532aa tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:18 devstack sudo[106380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247.info
Nov 05 19:28:18 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:18 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-239967ee-1a2d-4402-8c19-4ce5625f964d tempest-ProjectMemberTests-1640873908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:28:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-239967ee-1a2d-4402-8c19-4ce5625f964d tempest-ProjectMemberTests-1640873908 None] Flow 'volume_create_manager' (cd5cd11c-7648-46bf-932b-06a83b6ea1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:28:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-239967ee-1a2d-4402-8c19-4ce5625f964d tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bf202be-a31d-4b9f-8fe1-3e2739b3628e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-239967ee-1a2d-4402-8c19-4ce5625f964d tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bf202be-a31d-4b9f-8fe1-3e2739b3628e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-92236896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bab2d490-5c7c-4d2c-a806-0fb72db25dd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d5b238d03346c2b35a48086a4ecc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:28:18Z,use_quota=True,user_id='9c94d9844c6446c58716ae4b34ced8c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-239967ee-1a2d-4402-8c19-4ce5625f964d tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93a2c755-1b4f-4da0-8cba-ce4f47a59b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-239967ee-1a2d-4402-8c19-4ce5625f964d tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93a2c755-1b4f-4da0-8cba-ce4f47a59b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-239967ee-1a2d-4402-8c19-4ce5625f964d tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (000d3467-c8c9-4611-b849-ccaf9f4a1fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-239967ee-1a2d-4402-8c19-4ce5625f964d tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (000d3467-c8c9-4611-b849-ccaf9f4a1fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bab2d490-5c7c-4d2c-a806-0fb72db25dd5', 'volume_name': 'volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-239967ee-1a2d-4402-8c19-4ce5625f964d tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (def320fa-3947-4bd9-9eb4-b9fa3b94a12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-239967ee-1a2d-4402-8c19-4ce5625f964d tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (def320fa-3947-4bd9-9eb4-b9fa3b94a12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:18 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-239967ee-1a2d-4402-8c19-4ce5625f964d tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0db2d8c-1cc5-4110-92ad-82ac674a8df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:18 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-239967ee-1a2d-4402-8c19-4ce5625f964d tempest-ProjectMemberTests-1640873908 None] Volume bab2d490-5c7c-4d2c-a806-0fb72db25dd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5', 'volume_size': 1}
Nov 05 19:28:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-239967ee-1a2d-4402-8c19-4ce5625f964d tempest-ProjectMemberTests-1640873908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:28:18 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f7b2610f-ccbc-47bb-a835-018ebac532aa tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247.info" returned: 0 in 0.323s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:18 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-f7b2610f-ccbc-47bb-a835-018ebac532aa tempest-ProjectReaderTests-546992118 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247.info is being set with open permissions: ugo+rw
Nov 05 19:28:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f7b2610f-ccbc-47bb-a835-018ebac532aa tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:18 devstack sudo[106384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247.info
Nov 05 19:28:18 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:18 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-f7b2610f-ccbc-47bb-a835-018ebac532aa tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247.info" returned: 0 in 0.262s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-f7b2610f-ccbc-47bb-a835-018ebac532aa tempest-ProjectReaderTests-546992118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.301s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:28:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-239967ee-1a2d-4402-8c19-4ce5625f964d tempest-ProjectMemberTests-1640873908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.479s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:28:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-239967ee-1a2d-4402-8c19-4ce5625f964d tempest-ProjectMemberTests-1640873908 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-92236896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bab2d490-5c7c-4d2c-a806-0fb72db25dd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d5b238d03346c2b35a48086a4ecc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:28:18Z,use_quota=True,user_id='9c94d9844c6446c58716ae4b34ced8c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:28:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-239967ee-1a2d-4402-8c19-4ce5625f964d tempest-ProjectMemberTests-1640873908 None] Creating volume bab2d490-5c7c-4d2c-a806-0fb72db25dd5 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:28:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-239967ee-1a2d-4402-8c19-4ce5625f964d tempest-ProjectMemberTests-1640873908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:28:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-239967ee-1a2d-4402-8c19-4ce5625f964d tempest-ProjectMemberTests-1640873908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:28:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-239967ee-1a2d-4402-8c19-4ce5625f964d tempest-ProjectMemberTests-1640873908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:28:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-239967ee-1a2d-4402-8c19-4ce5625f964d tempest-ProjectMemberTests-1640873908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:28:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-239967ee-1a2d-4402-8c19-4ce5625f964d tempest-ProjectMemberTests-1640873908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:28:18 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-239967ee-1a2d-4402-8c19-4ce5625f964d tempest-ProjectMemberTests-1640873908 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:28:18 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-239967ee-1a2d-4402-8c19-4ce5625f964d tempest-ProjectMemberTests-1640873908 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:28:18 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-239967ee-1a2d-4402-8c19-4ce5625f964d tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:18 devstack sudo[106387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5 1073741824
Nov 05 19:28:18 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:18 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-f7b2610f-ccbc-47bb-a835-018ebac532aa tempest-ProjectReaderTests-546992118 None] Create snapshot completed successfully
Nov 05 19:28:19 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-239967ee-1a2d-4402-8c19-4ce5625f964d tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5 1073741824" returned: 0 in 0.479s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-239967ee-1a2d-4402-8c19-4ce5625f964d tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:19 devstack sudo[106393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5
Nov 05 19:28:19 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:19 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-239967ee-1a2d-4402-8c19-4ce5625f964d tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5" returned: 0 in 0.243s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-239967ee-1a2d-4402-8c19-4ce5625f964d tempest-ProjectMemberTests-1640873908 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:28:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-239967ee-1a2d-4402-8c19-4ce5625f964d tempest-ProjectMemberTests-1640873908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:28:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-239967ee-1a2d-4402-8c19-4ce5625f964d tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0db2d8c-1cc5-4110-92ad-82ac674a8df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-239967ee-1a2d-4402-8c19-4ce5625f964d tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62884ccc-e1de-41fe-ad0c-aed3e80860c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:19 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-239967ee-1a2d-4402-8c19-4ce5625f964d tempest-ProjectMemberTests-1640873908 None] Volume volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5 (bab2d490-5c7c-4d2c-a806-0fb72db25dd5): created successfully
Nov 05 19:28:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-239967ee-1a2d-4402-8c19-4ce5625f964d tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62884ccc-e1de-41fe-ad0c-aed3e80860c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:19 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-239967ee-1a2d-4402-8c19-4ce5625f964d tempest-ProjectMemberTests-1640873908 None] Flow 'volume_create_manager' (cd5cd11c-7648-46bf-932b-06a83b6ea1a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:28:19 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-239967ee-1a2d-4402-8c19-4ce5625f964d tempest-ProjectMemberTests-1640873908 None] Created volume successfully.
Nov 05 19:28:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-33f5ee7c-eefe-4bae-91d6-3cb583169731 tempest-ProjectReaderTests-546992118 None] Acquiring lock "cinder-d2905831-ae82-4368-a6a5-4e77e51e3bb0-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-33f5ee7c-eefe-4bae-91d6-3cb583169731 tempest-ProjectReaderTests-546992118 None] Lock "cinder-d2905831-ae82-4368-a6a5-4e77e51e3bb0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-33f5ee7c-eefe-4bae-91d6-3cb583169731 tempest-ProjectReaderTests-546992118 None] Acquiring lock "cinder-quobyte-192b4eae-a313-486e-b190-c58bab72d247" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-33f5ee7c-eefe-4bae-91d6-3cb583169731 tempest-ProjectReaderTests-546992118 None] Lock "cinder-quobyte-192b4eae-a313-486e-b190-c58bab72d247" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-33f5ee7c-eefe-4bae-91d6-3cb583169731 tempest-ProjectReaderTests-546992118 None] Acquiring lock "cinder-quobyte-d2905831-ae82-4368-a6a5-4e77e51e3bb0" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:19 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-33f5ee7c-eefe-4bae-91d6-3cb583169731 tempest-ProjectReaderTests-546992118 None] Lock "cinder-quobyte-d2905831-ae82-4368-a6a5-4e77e51e3bb0" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-33f5ee7c-eefe-4bae-91d6-3cb583169731 tempest-ProjectReaderTests-546992118 None] Deleting offline snapshot d2905831-ae82-4368-a6a5-4e77e51e3bb0 of volume 192b4eae-a313-486e-b190-c58bab72d247 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:28:19 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-33f5ee7c-eefe-4bae-91d6-3cb583169731 tempest-ProjectReaderTests-546992118 None] snapshot_file for this snap is: volume-192b4eae-a313-486e-b190-c58bab72d247.d2905831-ae82-4368-a6a5-4e77e51e3bb0 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:28:19 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9d7c27-c4d5-4bab-aa37-55d8611164df]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:28:19 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-33f5ee7c-eefe-4bae-91d6-3cb583169731 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247.d2905831-ae82-4368-a6a5-4e77e51e3bb0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:19 devstack sudo[106396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247.d2905831-ae82-4368-a6a5-4e77e51e3bb0
Nov 05 19:28:19 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:20 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-33f5ee7c-eefe-4bae-91d6-3cb583169731 tempest-ProjectReaderTests-546992118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247.d2905831-ae82-4368-a6a5-4e77e51e3bb0" returned: 0 in 0.390s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-33f5ee7c-eefe-4bae-91d6-3cb583169731 tempest-ProjectReaderTests-546992118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-192b4eae-a313-486e-b190-c58bab72d247(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:28:20 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbc1864-ea8d-4fc1-b169-fdd461b446fd]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:28:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-33f5ee7c-eefe-4bae-91d6-3cb583169731 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:20 devstack sudo[106402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247
Nov 05 19:28:20 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7013a4ce-f047-46b1-a409-d1dcd691e3d4 tempest-ProjectMemberTests-1640873908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:28:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7013a4ce-f047-46b1-a409-d1dcd691e3d4 tempest-ProjectMemberTests-1640873908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:28:20 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-7013a4ce-f047-46b1-a409-d1dcd691e3d4 tempest-ProjectMemberTests-1640873908 None] Creating offline snapshot 2ac74b70-d8a0-4a4d-beb6-796f16890ed8 of volume bab2d490-5c7c-4d2c-a806-0fb72db25dd5 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:28:20 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e0012e-cb2e-4754-8d61-0fda46e5cccf]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:28:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7013a4ce-f047-46b1-a409-d1dcd691e3d4 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:20 devstack sudo[106404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5
Nov 05 19:28:20 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:20 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-33f5ee7c-eefe-4bae-91d6-3cb583169731 tempest-ProjectReaderTests-546992118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247" returned: 0 in 0.443s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-33f5ee7c-eefe-4bae-91d6-3cb583169731 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247.d2905831-ae82-4368-a6a5-4e77e51e3bb0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:20 devstack sudo[106409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247.d2905831-ae82-4368-a6a5-4e77e51e3bb0
Nov 05 19:28:20 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:20 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7013a4ce-f047-46b1-a409-d1dcd691e3d4 tempest-ProjectMemberTests-1640873908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5" returned: 0 in 0.403s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7013a4ce-f047-46b1-a409-d1dcd691e3d4 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5.2ac74b70-d8a0-4a4d-beb6-796f16890ed8 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:20 devstack sudo[106416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5.2ac74b70-d8a0-4a4d-beb6-796f16890ed8 1G
Nov 05 19:28:20 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:20 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-33f5ee7c-eefe-4bae-91d6-3cb583169731 tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247.d2905831-ae82-4368-a6a5-4e77e51e3bb0" returned: 0 in 0.411s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:20 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-33f5ee7c-eefe-4bae-91d6-3cb583169731 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247.d2905831-ae82-4368-a6a5-4e77e51e3bb0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:20 devstack sudo[106419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247.d2905831-ae82-4368-a6a5-4e77e51e3bb0
Nov 05 19:28:20 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:21 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-33f5ee7c-eefe-4bae-91d6-3cb583169731 tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247.d2905831-ae82-4368-a6a5-4e77e51e3bb0" returned: 0 in 0.266s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:21 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7013a4ce-f047-46b1-a409-d1dcd691e3d4 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5.2ac74b70-d8a0-4a4d-beb6-796f16890ed8 1G" returned: 0 in 0.429s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7013a4ce-f047-46b1-a409-d1dcd691e3d4 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5.2ac74b70-d8a0-4a4d-beb6-796f16890ed8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-33f5ee7c-eefe-4bae-91d6-3cb583169731 tempest-ProjectReaderTests-546992118 None] Lock "cinder-quobyte-d2905831-ae82-4368-a6a5-4e77e51e3bb0" released by "_delete_snapshot" :: held 1.644s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-33f5ee7c-eefe-4bae-91d6-3cb583169731 tempest-ProjectReaderTests-546992118 None] Lock "cinder-quobyte-192b4eae-a313-486e-b190-c58bab72d247" released by "delete_snapshot" :: held 1.678s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:21 devstack sudo[106426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5.2ac74b70-d8a0-4a4d-beb6-796f16890ed8
Nov 05 19:28:21 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:21 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-33f5ee7c-eefe-4bae-91d6-3cb583169731 tempest-ProjectReaderTests-546992118 None] Created reservations ['c4e39b67-edc5-4a1c-b650-57a4480f77cb', 'ba409e10-d43c-4419-892b-7188b8997956', '05f87a57-0e69-44a5-9ade-feeb0a340b6d', '77d07a93-7d79-41ca-8208-b3aeb9b28464'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:28:21 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-33f5ee7c-eefe-4bae-91d6-3cb583169731 tempest-ProjectReaderTests-546992118 None] Delete snapshot completed successfully.
Nov 05 19:28:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-33f5ee7c-eefe-4bae-91d6-3cb583169731 tempest-ProjectReaderTests-546992118 None] Lock "cinder-d2905831-ae82-4368-a6a5-4e77e51e3bb0-delete_snapshot" released by "delete_snapshot" :: held 1.818s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:21 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7013a4ce-f047-46b1-a409-d1dcd691e3d4 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5.2ac74b70-d8a0-4a4d-beb6-796f16890ed8" returned: 0 in 0.299s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:21 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-7013a4ce-f047-46b1-a409-d1dcd691e3d4 tempest-ProjectMemberTests-1640873908 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5.2ac74b70-d8a0-4a4d-beb6-796f16890ed8 is being set with open permissions: ugo+rw
Nov 05 19:28:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7013a4ce-f047-46b1-a409-d1dcd691e3d4 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5.2ac74b70-d8a0-4a4d-beb6-796f16890ed8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:21 devstack sudo[106431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5.2ac74b70-d8a0-4a4d-beb6-796f16890ed8
Nov 05 19:28:21 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ded98bd3-e0be-4274-9d3e-96c43a3ba94d tempest-ProjectReaderTests-546992118 None] Acquiring lock "cinder-192b4eae-a313-486e-b190-c58bab72d247-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ded98bd3-e0be-4274-9d3e-96c43a3ba94d tempest-ProjectReaderTests-546992118 None] Lock "cinder-192b4eae-a313-486e-b190-c58bab72d247-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ded98bd3-e0be-4274-9d3e-96c43a3ba94d tempest-ProjectReaderTests-546992118 None] Acquiring lock "cinder-quobyte-192b4eae-a313-486e-b190-c58bab72d247" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:21 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7013a4ce-f047-46b1-a409-d1dcd691e3d4 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5.2ac74b70-d8a0-4a4d-beb6-796f16890ed8" returned: 0 in 0.323s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:21 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ded98bd3-e0be-4274-9d3e-96c43a3ba94d tempest-ProjectReaderTests-546992118 None] Lock "cinder-quobyte-192b4eae-a313-486e-b190-c58bab72d247" acquired by "delete_volume" :: waited 0.032s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7013a4ce-f047-46b1-a409-d1dcd691e3d4 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:21 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[499d2ba5-c44d-4c0b-b61d-cbdc62c646fb]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:28:21 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ded98bd3-e0be-4274-9d3e-96c43a3ba94d tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:21 devstack sudo[106434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5.info
Nov 05 19:28:21 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:22 devstack sudo[106435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247
Nov 05 19:28:22 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:22 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7013a4ce-f047-46b1-a409-d1dcd691e3d4 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5.info" returned: 0 in 0.292s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:22 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-7013a4ce-f047-46b1-a409-d1dcd691e3d4 tempest-ProjectMemberTests-1640873908 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5.info is being set with open permissions: ugo+rw
Nov 05 19:28:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7013a4ce-f047-46b1-a409-d1dcd691e3d4 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:22 devstack sudo[106439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5.info
Nov 05 19:28:22 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:22 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ded98bd3-e0be-4274-9d3e-96c43a3ba94d tempest-ProjectReaderTests-546992118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247" returned: 0 in 0.431s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ded98bd3-e0be-4274-9d3e-96c43a3ba94d tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:22 devstack sudo[106444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247
Nov 05 19:28:22 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:22 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-7013a4ce-f047-46b1-a409-d1dcd691e3d4 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5.info" returned: 0 in 0.270s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-7013a4ce-f047-46b1-a409-d1dcd691e3d4 tempest-ProjectMemberTests-1640873908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.159s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:28:22 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-7013a4ce-f047-46b1-a409-d1dcd691e3d4 tempest-ProjectMemberTests-1640873908 None] Create snapshot completed successfully
Nov 05 19:28:22 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ded98bd3-e0be-4274-9d3e-96c43a3ba94d tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-192b4eae-a313-486e-b190-c58bab72d247" returned: 0 in 0.269s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:22 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ded98bd3-e0be-4274-9d3e-96c43a3ba94d tempest-ProjectReaderTests-546992118 None] Lock "cinder-quobyte-192b4eae-a313-486e-b190-c58bab72d247" released by "delete_volume" :: held 0.784s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:22 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=157,cinder:INSERT=60,cinder:UPDATE=218,cinder:DELETE=21 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:28:22 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-ded98bd3-e0be-4274-9d3e-96c43a3ba94d tempest-ProjectReaderTests-546992118 None] Created reservations ['a613f697-1e61-4bce-b191-876a3334c6ba', 'c28e8f35-02ea-4bee-8780-6be08dcf8ad4', '417f2606-084d-4497-8fce-02baa1eb75b1', '569f69a4-087f-4640-9f65-5add71a1c15a'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:28:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ded98bd3-e0be-4274-9d3e-96c43a3ba94d tempest-ProjectReaderTests-546992118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:28:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ded98bd3-e0be-4274-9d3e-96c43a3ba94d tempest-ProjectReaderTests-546992118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:28:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ded98bd3-e0be-4274-9d3e-96c43a3ba94d tempest-ProjectReaderTests-546992118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:28:22 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-ded98bd3-e0be-4274-9d3e-96c43a3ba94d tempest-ProjectReaderTests-546992118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:28:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-ded98bd3-e0be-4274-9d3e-96c43a3ba94d tempest-ProjectReaderTests-546992118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:28:22 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ded98bd3-e0be-4274-9d3e-96c43a3ba94d tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:22 devstack sudo[106449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:28:22 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:23 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-ded98bd3-e0be-4274-9d3e-96c43a3ba94d tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.277s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:23 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-ded98bd3-e0be-4274-9d3e-96c43a3ba94d tempest-ProjectReaderTests-546992118 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:28:23 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-ded98bd3-e0be-4274-9d3e-96c43a3ba94d tempest-ProjectReaderTests-546992118 None] Deleted volume successfully.
Nov 05 19:28:23 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:SELECT=180,cinder:INSERT=61,cinder:UPDATE=205,cinder:DELETE=16 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:28:23 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-ded98bd3-e0be-4274-9d3e-96c43a3ba94d tempest-ProjectReaderTests-546992118 None] Lock "cinder-192b4eae-a313-486e-b190-c58bab72d247-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:23 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-109a192f-074e-495d-91b7-c22238cef0c0 tempest-ProjectReaderTests-546992118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:28:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-109a192f-074e-495d-91b7-c22238cef0c0 tempest-ProjectReaderTests-546992118 None] Flow 'volume_create_manager' (a80a88c1-a11d-45da-b6b9-54a4246ba917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:28:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-109a192f-074e-495d-91b7-c22238cef0c0 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81918ac9-6418-49dd-83ae-d89fcca8cfc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:23 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2d025a76-8cc1-4129-b138-773cb3125647 tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-2ac74b70-d8a0-4a4d-beb6-796f16890ed8-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-109a192f-074e-495d-91b7-c22238cef0c0 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81918ac9-6418-49dd-83ae-d89fcca8cfc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1947403409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8b6de85a1d742f78e908c889957f3d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:28:24Z,use_quota=True,user_id='60990ab9a4554795bcd64339eacaa724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-109a192f-074e-495d-91b7-c22238cef0c0 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c54f1873-0a12-4910-9baa-d17a2e1a0a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-109a192f-074e-495d-91b7-c22238cef0c0 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c54f1873-0a12-4910-9baa-d17a2e1a0a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-109a192f-074e-495d-91b7-c22238cef0c0 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05763cf7-acb6-480d-bba3-c65fb1a1830c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-109a192f-074e-495d-91b7-c22238cef0c0 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05763cf7-acb6-480d-bba3-c65fb1a1830c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d', 'volume_name': 'volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-109a192f-074e-495d-91b7-c22238cef0c0 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c647444-64e9-4699-8d98-45c2d563b7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-109a192f-074e-495d-91b7-c22238cef0c0 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c647444-64e9-4699-8d98-45c2d563b7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:23 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-109a192f-074e-495d-91b7-c22238cef0c0 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e17cae5-4752-4ec0-b7e7-9edca890b4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:23 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-109a192f-074e-495d-91b7-c22238cef0c0 tempest-ProjectReaderTests-546992118 None] Volume 894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d', 'volume_size': 1}
Nov 05 19:28:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-109a192f-074e-495d-91b7-c22238cef0c0 tempest-ProjectReaderTests-546992118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:28:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-109a192f-074e-495d-91b7-c22238cef0c0 tempest-ProjectReaderTests-546992118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:28:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-109a192f-074e-495d-91b7-c22238cef0c0 tempest-ProjectReaderTests-546992118 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1947403409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8b6de85a1d742f78e908c889957f3d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:28:24Z,use_quota=True,user_id='60990ab9a4554795bcd64339eacaa724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:28:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-109a192f-074e-495d-91b7-c22238cef0c0 tempest-ProjectReaderTests-546992118 None] Creating volume 894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:28:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-109a192f-074e-495d-91b7-c22238cef0c0 tempest-ProjectReaderTests-546992118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:28:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-109a192f-074e-495d-91b7-c22238cef0c0 tempest-ProjectReaderTests-546992118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:28:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-109a192f-074e-495d-91b7-c22238cef0c0 tempest-ProjectReaderTests-546992118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:28:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-109a192f-074e-495d-91b7-c22238cef0c0 tempest-ProjectReaderTests-546992118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:28:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-109a192f-074e-495d-91b7-c22238cef0c0 tempest-ProjectReaderTests-546992118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:28:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-109a192f-074e-495d-91b7-c22238cef0c0 tempest-ProjectReaderTests-546992118 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:28:23 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-109a192f-074e-495d-91b7-c22238cef0c0 tempest-ProjectReaderTests-546992118 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:28:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-109a192f-074e-495d-91b7-c22238cef0c0 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:23 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2d025a76-8cc1-4129-b138-773cb3125647 tempest-ProjectMemberTests-1640873908 None] Lock "cinder-2ac74b70-d8a0-4a4d-beb6-796f16890ed8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.094s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:23 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2d025a76-8cc1-4129-b138-773cb3125647 tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-quobyte-bab2d490-5c7c-4d2c-a806-0fb72db25dd5" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:23 devstack sudo[106452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d 1073741824
Nov 05 19:28:23 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:23 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2d025a76-8cc1-4129-b138-773cb3125647 tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-bab2d490-5c7c-4d2c-a806-0fb72db25dd5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:23 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2d025a76-8cc1-4129-b138-773cb3125647 tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-quobyte-2ac74b70-d8a0-4a4d-beb6-796f16890ed8" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:23 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2d025a76-8cc1-4129-b138-773cb3125647 tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-2ac74b70-d8a0-4a4d-beb6-796f16890ed8" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-2d025a76-8cc1-4129-b138-773cb3125647 tempest-ProjectMemberTests-1640873908 None] Deleting offline snapshot 2ac74b70-d8a0-4a4d-beb6-796f16890ed8 of volume bab2d490-5c7c-4d2c-a806-0fb72db25dd5 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:28:23 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-2d025a76-8cc1-4129-b138-773cb3125647 tempest-ProjectMemberTests-1640873908 None] snapshot_file for this snap is: volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5.2ac74b70-d8a0-4a4d-beb6-796f16890ed8 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:28:23 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca12f96-90da-4794-a837-e42270849c31]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:28:23 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2d025a76-8cc1-4129-b138-773cb3125647 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5.2ac74b70-d8a0-4a4d-beb6-796f16890ed8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:23 devstack sudo[106454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5.2ac74b70-d8a0-4a4d-beb6-796f16890ed8
Nov 05 19:28:23 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:24 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-109a192f-074e-495d-91b7-c22238cef0c0 tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d 1073741824" returned: 0 in 0.473s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-109a192f-074e-495d-91b7-c22238cef0c0 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:24 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2d025a76-8cc1-4129-b138-773cb3125647 tempest-ProjectMemberTests-1640873908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5.2ac74b70-d8a0-4a4d-beb6-796f16890ed8" returned: 0 in 0.417s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-2d025a76-8cc1-4129-b138-773cb3125647 tempest-ProjectMemberTests-1640873908 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:28:24 devstack sudo[106464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d
Nov 05 19:28:24 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:24 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0d2168-2b71-43e0-bd34-6267919f3c9e]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:28:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2d025a76-8cc1-4129-b138-773cb3125647 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:24 devstack sudo[106466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5
Nov 05 19:28:24 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:24 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-109a192f-074e-495d-91b7-c22238cef0c0 tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d" returned: 0 in 0.286s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:24 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-109a192f-074e-495d-91b7-c22238cef0c0 tempest-ProjectReaderTests-546992118 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:28:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-109a192f-074e-495d-91b7-c22238cef0c0 tempest-ProjectReaderTests-546992118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:28:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-109a192f-074e-495d-91b7-c22238cef0c0 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e17cae5-4752-4ec0-b7e7-9edca890b4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-109a192f-074e-495d-91b7-c22238cef0c0 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59f563b1-27bf-41da-a4b0-dcfe04fd3b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:24 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-109a192f-074e-495d-91b7-c22238cef0c0 tempest-ProjectReaderTests-546992118 None] Volume volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d (894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d): created successfully
Nov 05 19:28:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-109a192f-074e-495d-91b7-c22238cef0c0 tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59f563b1-27bf-41da-a4b0-dcfe04fd3b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:24 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-109a192f-074e-495d-91b7-c22238cef0c0 tempest-ProjectReaderTests-546992118 None] Flow 'volume_create_manager' (a80a88c1-a11d-45da-b6b9-54a4246ba917) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:28:24 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-109a192f-074e-495d-91b7-c22238cef0c0 tempest-ProjectReaderTests-546992118 None] Created volume successfully.
Nov 05 19:28:24 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2d025a76-8cc1-4129-b138-773cb3125647 tempest-ProjectMemberTests-1640873908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5" returned: 0 in 0.441s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:24 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2d025a76-8cc1-4129-b138-773cb3125647 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5.2ac74b70-d8a0-4a4d-beb6-796f16890ed8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:24 devstack sudo[106472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5.2ac74b70-d8a0-4a4d-beb6-796f16890ed8
Nov 05 19:28:24 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:25 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2d025a76-8cc1-4129-b138-773cb3125647 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5.2ac74b70-d8a0-4a4d-beb6-796f16890ed8" returned: 0 in 0.332s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2d025a76-8cc1-4129-b138-773cb3125647 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5.2ac74b70-d8a0-4a4d-beb6-796f16890ed8 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:25 devstack sudo[106477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5.2ac74b70-d8a0-4a4d-beb6-796f16890ed8
Nov 05 19:28:25 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:25 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-2d025a76-8cc1-4129-b138-773cb3125647 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5.2ac74b70-d8a0-4a4d-beb6-796f16890ed8" returned: 0 in 0.250s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:25 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2d025a76-8cc1-4129-b138-773cb3125647 tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-2ac74b70-d8a0-4a4d-beb6-796f16890ed8" released by "_delete_snapshot" :: held 1.562s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:25 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2d025a76-8cc1-4129-b138-773cb3125647 tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-bab2d490-5c7c-4d2c-a806-0fb72db25dd5" released by "delete_snapshot" :: held 1.589s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:25 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-2d025a76-8cc1-4129-b138-773cb3125647 tempest-ProjectMemberTests-1640873908 None] Created reservations ['8f862308-7557-43aa-8135-3f1916597244', '64bb27fd-1099-476c-9631-549713f9aff3', '6f6b19ff-9351-4582-aaed-d42036b04ba0', 'e80e1481-beed-4bc6-b8a7-834f5d9246b6'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:28:25 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-2d025a76-8cc1-4129-b138-773cb3125647 tempest-ProjectMemberTests-1640873908 None] Delete snapshot completed successfully.
Nov 05 19:28:25 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-2d025a76-8cc1-4129-b138-773cb3125647 tempest-ProjectMemberTests-1640873908 None] Lock "cinder-2ac74b70-d8a0-4a4d-beb6-796f16890ed8-delete_snapshot" released by "delete_snapshot" :: held 1.717s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:25 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a4d2f2e5-a151-4526-8b2b-a9a5711786dc tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-bab2d490-5c7c-4d2c-a806-0fb72db25dd5-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:25 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a4d2f2e5-a151-4526-8b2b-a9a5711786dc tempest-ProjectMemberTests-1640873908 None] Lock "cinder-bab2d490-5c7c-4d2c-a806-0fb72db25dd5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-99b64a0f-e3b8-4903-a5e5-9f33bf6dc54d tempest-ProjectReaderTests-546992118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:28:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-99b64a0f-e3b8-4903-a5e5-9f33bf6dc54d tempest-ProjectReaderTests-546992118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:28:25 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a4d2f2e5-a151-4526-8b2b-a9a5711786dc tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-quobyte-bab2d490-5c7c-4d2c-a806-0fb72db25dd5" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:25 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-99b64a0f-e3b8-4903-a5e5-9f33bf6dc54d tempest-ProjectReaderTests-546992118 None] Creating offline snapshot aa2f1100-7c49-435e-bc15-46faae900a78 of volume 894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:28:25 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a4d2f2e5-a151-4526-8b2b-a9a5711786dc tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-bab2d490-5c7c-4d2c-a806-0fb72db25dd5" acquired by "delete_volume" :: waited 0.023s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:25 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad202e9b-1874-4de4-9a0b-ab5eb4f4ba1f]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:28:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-99b64a0f-e3b8-4903-a5e5-9f33bf6dc54d tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:25 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8541355d-2fe2-4a25-b2a1-f30c24cfcdd1]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:28:25 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a4d2f2e5-a151-4526-8b2b-a9a5711786dc tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:25 devstack sudo[106480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d
Nov 05 19:28:25 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:26 devstack sudo[106481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5
Nov 05 19:28:26 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:26 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-99b64a0f-e3b8-4903-a5e5-9f33bf6dc54d tempest-ProjectReaderTests-546992118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d" returned: 0 in 0.366s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-99b64a0f-e3b8-4903-a5e5-9f33bf6dc54d tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d.aa2f1100-7c49-435e-bc15-46faae900a78 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:26 devstack sudo[106490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d.aa2f1100-7c49-435e-bc15-46faae900a78 1G
Nov 05 19:28:26 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:26 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a4d2f2e5-a151-4526-8b2b-a9a5711786dc tempest-ProjectMemberTests-1640873908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5" returned: 0 in 0.392s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a4d2f2e5-a151-4526-8b2b-a9a5711786dc tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:26 devstack sudo[106492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5
Nov 05 19:28:26 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:26 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a4d2f2e5-a151-4526-8b2b-a9a5711786dc tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-bab2d490-5c7c-4d2c-a806-0fb72db25dd5" returned: 0 in 0.263s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:26 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a4d2f2e5-a151-4526-8b2b-a9a5711786dc tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-bab2d490-5c7c-4d2c-a806-0fb72db25dd5" released by "delete_volume" :: held 0.714s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:26 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-a4d2f2e5-a151-4526-8b2b-a9a5711786dc tempest-ProjectMemberTests-1640873908 None] Created reservations ['296ea8b5-b8ff-4220-a7b6-956bc4a72cc0', '031fdb45-06e0-457c-a028-ceb7a677a613', '778b4ee9-a249-4dfa-aa4d-69c1016f82ce', '560f7c14-122d-4204-b060-5d58db41e8c2'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:28:26 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-99b64a0f-e3b8-4903-a5e5-9f33bf6dc54d tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d.aa2f1100-7c49-435e-bc15-46faae900a78 1G" returned: 0 in 0.420s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-99b64a0f-e3b8-4903-a5e5-9f33bf6dc54d tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d.aa2f1100-7c49-435e-bc15-46faae900a78 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:26 devstack sudo[106499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d.aa2f1100-7c49-435e-bc15-46faae900a78
Nov 05 19:28:26 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a4d2f2e5-a151-4526-8b2b-a9a5711786dc tempest-ProjectMemberTests-1640873908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:28:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a4d2f2e5-a151-4526-8b2b-a9a5711786dc tempest-ProjectMemberTests-1640873908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:28:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a4d2f2e5-a151-4526-8b2b-a9a5711786dc tempest-ProjectMemberTests-1640873908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:28:26 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-a4d2f2e5-a151-4526-8b2b-a9a5711786dc tempest-ProjectMemberTests-1640873908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:28:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-a4d2f2e5-a151-4526-8b2b-a9a5711786dc tempest-ProjectMemberTests-1640873908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:28:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a4d2f2e5-a151-4526-8b2b-a9a5711786dc tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:26 devstack sudo[106501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:28:26 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:26 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-a4d2f2e5-a151-4526-8b2b-a9a5711786dc tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.267s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:26 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:26 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-a4d2f2e5-a151-4526-8b2b-a9a5711786dc tempest-ProjectMemberTests-1640873908 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:28:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-99b64a0f-e3b8-4903-a5e5-9f33bf6dc54d tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d.aa2f1100-7c49-435e-bc15-46faae900a78" returned: 0 in 0.315s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:26 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-99b64a0f-e3b8-4903-a5e5-9f33bf6dc54d tempest-ProjectReaderTests-546992118 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d.aa2f1100-7c49-435e-bc15-46faae900a78 is being set with open permissions: ugo+rw
Nov 05 19:28:26 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-99b64a0f-e3b8-4903-a5e5-9f33bf6dc54d tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d.aa2f1100-7c49-435e-bc15-46faae900a78 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:27 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-a4d2f2e5-a151-4526-8b2b-a9a5711786dc tempest-ProjectMemberTests-1640873908 None] Deleted volume successfully.
Nov 05 19:28:27 devstack sudo[106507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d.aa2f1100-7c49-435e-bc15-46faae900a78
Nov 05 19:28:27 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:27 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-a4d2f2e5-a151-4526-8b2b-a9a5711786dc tempest-ProjectMemberTests-1640873908 None] Lock "cinder-bab2d490-5c7c-4d2c-a806-0fb72db25dd5-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:27 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-99b64a0f-e3b8-4903-a5e5-9f33bf6dc54d tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d.aa2f1100-7c49-435e-bc15-46faae900a78" returned: 0 in 0.256s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-99b64a0f-e3b8-4903-a5e5-9f33bf6dc54d tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:27 devstack sudo[106510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d.info
Nov 05 19:28:27 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:27 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-17e28c2e-21ab-43e8-bd0d-ef2ccc02aaac tempest-ProjectMemberTests-1640873908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:28:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-17e28c2e-21ab-43e8-bd0d-ef2ccc02aaac tempest-ProjectMemberTests-1640873908 None] Flow 'volume_create_manager' (95c0dca5-ecea-46f1-a9e0-f8eb761a7f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:28:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-17e28c2e-21ab-43e8-bd0d-ef2ccc02aaac tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7379502a-e9d8-42be-8af4-d003b5b5a5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-17e28c2e-21ab-43e8-bd0d-ef2ccc02aaac tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7379502a-e9d8-42be-8af4-d003b5b5a5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1083670477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=779d3f92-8374-40ad-9dd1-1e00608c1415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d5b238d03346c2b35a48086a4ecc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:28:27Z,use_quota=True,user_id='9c94d9844c6446c58716ae4b34ced8c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-17e28c2e-21ab-43e8-bd0d-ef2ccc02aaac tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9407483-103f-4740-b3a3-f661754b8041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-17e28c2e-21ab-43e8-bd0d-ef2ccc02aaac tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9407483-103f-4740-b3a3-f661754b8041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-17e28c2e-21ab-43e8-bd0d-ef2ccc02aaac tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (522d1cb2-091d-4562-b388-41afc32a793b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-17e28c2e-21ab-43e8-bd0d-ef2ccc02aaac tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (522d1cb2-091d-4562-b388-41afc32a793b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '779d3f92-8374-40ad-9dd1-1e00608c1415', 'volume_name': 'volume-779d3f92-8374-40ad-9dd1-1e00608c1415', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-17e28c2e-21ab-43e8-bd0d-ef2ccc02aaac tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (912046eb-6f7a-43ff-b8f0-405fc1534e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-17e28c2e-21ab-43e8-bd0d-ef2ccc02aaac tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (912046eb-6f7a-43ff-b8f0-405fc1534e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:27 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-17e28c2e-21ab-43e8-bd0d-ef2ccc02aaac tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eebf41d-d5a2-4e76-a67b-fb459e617f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:27 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-17e28c2e-21ab-43e8-bd0d-ef2ccc02aaac tempest-ProjectMemberTests-1640873908 None] Volume 779d3f92-8374-40ad-9dd1-1e00608c1415: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-779d3f92-8374-40ad-9dd1-1e00608c1415', 'volume_size': 1}
Nov 05 19:28:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-17e28c2e-21ab-43e8-bd0d-ef2ccc02aaac tempest-ProjectMemberTests-1640873908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:28:27 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-99b64a0f-e3b8-4903-a5e5-9f33bf6dc54d tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d.info" returned: 0 in 0.272s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:27 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-99b64a0f-e3b8-4903-a5e5-9f33bf6dc54d tempest-ProjectReaderTests-546992118 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d.info is being set with open permissions: ugo+rw
Nov 05 19:28:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-99b64a0f-e3b8-4903-a5e5-9f33bf6dc54d tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:27 devstack sudo[106514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d.info
Nov 05 19:28:27 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:27 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-99b64a0f-e3b8-4903-a5e5-9f33bf6dc54d tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d.info" returned: 0 in 0.241s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-99b64a0f-e3b8-4903-a5e5-9f33bf6dc54d tempest-ProjectReaderTests-546992118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.971s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:28:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-17e28c2e-21ab-43e8-bd0d-ef2ccc02aaac tempest-ProjectMemberTests-1640873908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.319s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:28:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-17e28c2e-21ab-43e8-bd0d-ef2ccc02aaac tempest-ProjectMemberTests-1640873908 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1083670477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=779d3f92-8374-40ad-9dd1-1e00608c1415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d5b238d03346c2b35a48086a4ecc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:28:27Z,use_quota=True,user_id='9c94d9844c6446c58716ae4b34ced8c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:28:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-17e28c2e-21ab-43e8-bd0d-ef2ccc02aaac tempest-ProjectMemberTests-1640873908 None] Creating volume 779d3f92-8374-40ad-9dd1-1e00608c1415 {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:28:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-17e28c2e-21ab-43e8-bd0d-ef2ccc02aaac tempest-ProjectMemberTests-1640873908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:28:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-17e28c2e-21ab-43e8-bd0d-ef2ccc02aaac tempest-ProjectMemberTests-1640873908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:28:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-17e28c2e-21ab-43e8-bd0d-ef2ccc02aaac tempest-ProjectMemberTests-1640873908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:28:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-17e28c2e-21ab-43e8-bd0d-ef2ccc02aaac tempest-ProjectMemberTests-1640873908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:28:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-17e28c2e-21ab-43e8-bd0d-ef2ccc02aaac tempest-ProjectMemberTests-1640873908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:28:27 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-17e28c2e-21ab-43e8-bd0d-ef2ccc02aaac tempest-ProjectMemberTests-1640873908 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:28:27 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-17e28c2e-21ab-43e8-bd0d-ef2ccc02aaac tempest-ProjectMemberTests-1640873908 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:28:27 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-17e28c2e-21ab-43e8-bd0d-ef2ccc02aaac tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:27 devstack sudo[106517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415 1073741824
Nov 05 19:28:27 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:27 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-99b64a0f-e3b8-4903-a5e5-9f33bf6dc54d tempest-ProjectReaderTests-546992118 None] Create snapshot completed successfully
Nov 05 19:28:28 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-17e28c2e-21ab-43e8-bd0d-ef2ccc02aaac tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415 1073741824" returned: 0 in 0.404s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-17e28c2e-21ab-43e8-bd0d-ef2ccc02aaac tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:28 devstack sudo[106522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415
Nov 05 19:28:28 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:28 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-17e28c2e-21ab-43e8-bd0d-ef2ccc02aaac tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415" returned: 0 in 0.244s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:28 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-17e28c2e-21ab-43e8-bd0d-ef2ccc02aaac tempest-ProjectMemberTests-1640873908 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:28:28 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-17e28c2e-21ab-43e8-bd0d-ef2ccc02aaac tempest-ProjectMemberTests-1640873908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:28:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-17e28c2e-21ab-43e8-bd0d-ef2ccc02aaac tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eebf41d-d5a2-4e76-a67b-fb459e617f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-779d3f92-8374-40ad-9dd1-1e00608c1415', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-17e28c2e-21ab-43e8-bd0d-ef2ccc02aaac tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (369b1223-0996-4508-ad5a-0963015d9e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:28 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-17e28c2e-21ab-43e8-bd0d-ef2ccc02aaac tempest-ProjectMemberTests-1640873908 None] Volume volume-779d3f92-8374-40ad-9dd1-1e00608c1415 (779d3f92-8374-40ad-9dd1-1e00608c1415): created successfully
Nov 05 19:28:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-17e28c2e-21ab-43e8-bd0d-ef2ccc02aaac tempest-ProjectMemberTests-1640873908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (369b1223-0996-4508-ad5a-0963015d9e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:28 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-17e28c2e-21ab-43e8-bd0d-ef2ccc02aaac tempest-ProjectMemberTests-1640873908 None] Flow 'volume_create_manager' (95c0dca5-ecea-46f1-a9e0-f8eb761a7f7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:28:28 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-17e28c2e-21ab-43e8-bd0d-ef2ccc02aaac tempest-ProjectMemberTests-1640873908 None] Created volume successfully.
Nov 05 19:28:28 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9cb2733f-5a62-4a1b-b405-4c555929f327 tempest-ProjectReaderTests-546992118 None] Acquiring lock "cinder-aa2f1100-7c49-435e-bc15-46faae900a78-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:28 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9cb2733f-5a62-4a1b-b405-4c555929f327 tempest-ProjectReaderTests-546992118 None] Lock "cinder-aa2f1100-7c49-435e-bc15-46faae900a78-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:28 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9cb2733f-5a62-4a1b-b405-4c555929f327 tempest-ProjectReaderTests-546992118 None] Acquiring lock "cinder-quobyte-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:28 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9cb2733f-5a62-4a1b-b405-4c555929f327 tempest-ProjectReaderTests-546992118 None] Lock "cinder-quobyte-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:28 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9cb2733f-5a62-4a1b-b405-4c555929f327 tempest-ProjectReaderTests-546992118 None] Acquiring lock "cinder-quobyte-aa2f1100-7c49-435e-bc15-46faae900a78" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:29 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9cb2733f-5a62-4a1b-b405-4c555929f327 tempest-ProjectReaderTests-546992118 None] Lock "cinder-quobyte-aa2f1100-7c49-435e-bc15-46faae900a78" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:29 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-9cb2733f-5a62-4a1b-b405-4c555929f327 tempest-ProjectReaderTests-546992118 None] Deleting offline snapshot aa2f1100-7c49-435e-bc15-46faae900a78 of volume 894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:28:29 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-9cb2733f-5a62-4a1b-b405-4c555929f327 tempest-ProjectReaderTests-546992118 None] snapshot_file for this snap is: volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d.aa2f1100-7c49-435e-bc15-46faae900a78 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:28:29 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71414a1-2d0a-4a99-8ba9-341d644ea3c0]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:28:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9cb2733f-5a62-4a1b-b405-4c555929f327 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d.aa2f1100-7c49-435e-bc15-46faae900a78 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:29 devstack sudo[106525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d.aa2f1100-7c49-435e-bc15-46faae900a78
Nov 05 19:28:29 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:29 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9cb2733f-5a62-4a1b-b405-4c555929f327 tempest-ProjectReaderTests-546992118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d.aa2f1100-7c49-435e-bc15-46faae900a78" returned: 0 in 0.371s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:29 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-9cb2733f-5a62-4a1b-b405-4c555929f327 tempest-ProjectReaderTests-546992118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:28:29 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0b237b-2aac-4a67-82d2-08768e8feab6]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:28:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9cb2733f-5a62-4a1b-b405-4c555929f327 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:29 devstack sudo[106530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d
Nov 05 19:28:29 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8b2d1157-dec7-4d67-9bd1-66ca39140e11 tempest-ProjectMemberTests-1640873908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:28:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8b2d1157-dec7-4d67-9bd1-66ca39140e11 tempest-ProjectMemberTests-1640873908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:28:29 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-8b2d1157-dec7-4d67-9bd1-66ca39140e11 tempest-ProjectMemberTests-1640873908 None] Creating offline snapshot f2234b65-4c32-438f-b823-fd21af9f2def of volume 779d3f92-8374-40ad-9dd1-1e00608c1415 {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:28:29 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef53cda-aa38-4637-846c-a14bcee47def]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:28:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8b2d1157-dec7-4d67-9bd1-66ca39140e11 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:29 devstack sudo[106532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415
Nov 05 19:28:29 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:29 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9cb2733f-5a62-4a1b-b405-4c555929f327 tempest-ProjectReaderTests-546992118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d" returned: 0 in 0.407s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:29 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9cb2733f-5a62-4a1b-b405-4c555929f327 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d.aa2f1100-7c49-435e-bc15-46faae900a78 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:29 devstack sudo[106537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d.aa2f1100-7c49-435e-bc15-46faae900a78
Nov 05 19:28:29 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:30 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8b2d1157-dec7-4d67-9bd1-66ca39140e11 tempest-ProjectMemberTests-1640873908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415" returned: 0 in 0.397s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8b2d1157-dec7-4d67-9bd1-66ca39140e11 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415.f2234b65-4c32-438f-b823-fd21af9f2def 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:30 devstack sudo[106542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415.f2234b65-4c32-438f-b823-fd21af9f2def 1G
Nov 05 19:28:30 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:30 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9cb2733f-5a62-4a1b-b405-4c555929f327 tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d.aa2f1100-7c49-435e-bc15-46faae900a78" returned: 0 in 0.369s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9cb2733f-5a62-4a1b-b405-4c555929f327 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d.aa2f1100-7c49-435e-bc15-46faae900a78 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:30 devstack sudo[106547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d.aa2f1100-7c49-435e-bc15-46faae900a78
Nov 05 19:28:30 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:30 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8b2d1157-dec7-4d67-9bd1-66ca39140e11 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415.f2234b65-4c32-438f-b823-fd21af9f2def 1G" returned: 0 in 0.418s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8b2d1157-dec7-4d67-9bd1-66ca39140e11 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-779d3f92-8374-40ad-9dd1-1e00608c1415 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415.f2234b65-4c32-438f-b823-fd21af9f2def {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:30 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-9cb2733f-5a62-4a1b-b405-4c555929f327 tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d.aa2f1100-7c49-435e-bc15-46faae900a78" returned: 0 in 0.275s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:30 devstack sudo[106553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-779d3f92-8374-40ad-9dd1-1e00608c1415 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415.f2234b65-4c32-438f-b823-fd21af9f2def
Nov 05 19:28:30 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9cb2733f-5a62-4a1b-b405-4c555929f327 tempest-ProjectReaderTests-546992118 None] Lock "cinder-quobyte-aa2f1100-7c49-435e-bc15-46faae900a78" released by "_delete_snapshot" :: held 1.531s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9cb2733f-5a62-4a1b-b405-4c555929f327 tempest-ProjectReaderTests-546992118 None] Lock "cinder-quobyte-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d" released by "delete_snapshot" :: held 1.558s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:30 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-9cb2733f-5a62-4a1b-b405-4c555929f327 tempest-ProjectReaderTests-546992118 None] Created reservations ['909169f2-ed43-4f44-9c84-88fc2445aa94', '4caccd35-5870-499c-9fb1-c5accb76d33b', 'cb120707-9604-46c2-9453-779b474d1ca9', '52872472-cd1e-47af-9a13-6addd671df67'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:28:30 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-9cb2733f-5a62-4a1b-b405-4c555929f327 tempest-ProjectReaderTests-546992118 None] Delete snapshot completed successfully.
Nov 05 19:28:30 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-9cb2733f-5a62-4a1b-b405-4c555929f327 tempest-ProjectReaderTests-546992118 None] Lock "cinder-aa2f1100-7c49-435e-bc15-46faae900a78-delete_snapshot" released by "delete_snapshot" :: held 1.714s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:30 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8b2d1157-dec7-4d67-9bd1-66ca39140e11 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-779d3f92-8374-40ad-9dd1-1e00608c1415 -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415.f2234b65-4c32-438f-b823-fd21af9f2def" returned: 0 in 0.311s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:30 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-8b2d1157-dec7-4d67-9bd1-66ca39140e11 tempest-ProjectMemberTests-1640873908 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415.f2234b65-4c32-438f-b823-fd21af9f2def is being set with open permissions: ugo+rw
Nov 05 19:28:30 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8b2d1157-dec7-4d67-9bd1-66ca39140e11 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415.f2234b65-4c32-438f-b823-fd21af9f2def {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:30 devstack sudo[106558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415.f2234b65-4c32-438f-b823-fd21af9f2def
Nov 05 19:28:30 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:31 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8b2d1157-dec7-4d67-9bd1-66ca39140e11 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415.f2234b65-4c32-438f-b823-fd21af9f2def" returned: 0 in 0.242s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8b2d1157-dec7-4d67-9bd1-66ca39140e11 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:31 devstack sudo[106561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415.info
Nov 05 19:28:31 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-99d5c885-b51c-4d14-ac6f-ec516f7ca0ca tempest-ProjectReaderTests-546992118 None] Acquiring lock "cinder-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-99d5c885-b51c-4d14-ac6f-ec516f7ca0ca tempest-ProjectReaderTests-546992118 None] Lock "cinder-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-99d5c885-b51c-4d14-ac6f-ec516f7ca0ca tempest-ProjectReaderTests-546992118 None] Acquiring lock "cinder-quobyte-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-99d5c885-b51c-4d14-ac6f-ec516f7ca0ca tempest-ProjectReaderTests-546992118 None] Lock "cinder-quobyte-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d" acquired by "delete_volume" :: waited 0.016s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:31 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c53711-0abb-4d15-92be-de54667dc68a]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:28:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-99d5c885-b51c-4d14-ac6f-ec516f7ca0ca tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:31 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8b2d1157-dec7-4d67-9bd1-66ca39140e11 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415.info" returned: 0 in 0.281s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:31 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-8b2d1157-dec7-4d67-9bd1-66ca39140e11 tempest-ProjectMemberTests-1640873908 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415.info is being set with open permissions: ugo+rw
Nov 05 19:28:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8b2d1157-dec7-4d67-9bd1-66ca39140e11 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:31 devstack sudo[106565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415.info
Nov 05 19:28:31 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:31 devstack sudo[106563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d
Nov 05 19:28:31 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:31 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8b2d1157-dec7-4d67-9bd1-66ca39140e11 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415.info" returned: 0 in 0.251s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8b2d1157-dec7-4d67-9bd1-66ca39140e11 tempest-ProjectMemberTests-1640873908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.984s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:28:31 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-8b2d1157-dec7-4d67-9bd1-66ca39140e11 tempest-ProjectMemberTests-1640873908 None] Create snapshot completed successfully
Nov 05 19:28:31 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-99d5c885-b51c-4d14-ac6f-ec516f7ca0ca tempest-ProjectReaderTests-546992118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d" returned: 0 in 0.424s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-99d5c885-b51c-4d14-ac6f-ec516f7ca0ca tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:31 devstack sudo[106572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d
Nov 05 19:28:31 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5fd432e4-384b-468f-a5bd-eab8e25c39c5 tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-f2234b65-4c32-438f-b823-fd21af9f2def-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5fd432e4-384b-468f-a5bd-eab8e25c39c5 tempest-ProjectMemberTests-1640873908 None] Lock "cinder-f2234b65-4c32-438f-b823-fd21af9f2def-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5fd432e4-384b-468f-a5bd-eab8e25c39c5 tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-quobyte-779d3f92-8374-40ad-9dd1-1e00608c1415" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5fd432e4-384b-468f-a5bd-eab8e25c39c5 tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-779d3f92-8374-40ad-9dd1-1e00608c1415" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5fd432e4-384b-468f-a5bd-eab8e25c39c5 tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-quobyte-f2234b65-4c32-438f-b823-fd21af9f2def" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:31 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5fd432e4-384b-468f-a5bd-eab8e25c39c5 tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-f2234b65-4c32-438f-b823-fd21af9f2def" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-5fd432e4-384b-468f-a5bd-eab8e25c39c5 tempest-ProjectMemberTests-1640873908 None] Deleting offline snapshot f2234b65-4c32-438f-b823-fd21af9f2def of volume 779d3f92-8374-40ad-9dd1-1e00608c1415 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:28:31 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:31 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-5fd432e4-384b-468f-a5bd-eab8e25c39c5 tempest-ProjectMemberTests-1640873908 None] snapshot_file for this snap is: volume-779d3f92-8374-40ad-9dd1-1e00608c1415.f2234b65-4c32-438f-b823-fd21af9f2def {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:28:31 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-99d5c885-b51c-4d14-ac6f-ec516f7ca0ca tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d" returned: 0 in 0.309s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:32 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da4ac51-2ffd-446c-909a-f9dc4df9611b]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:28:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5fd432e4-384b-468f-a5bd-eab8e25c39c5 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415.f2234b65-4c32-438f-b823-fd21af9f2def {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:32 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-99d5c885-b51c-4d14-ac6f-ec516f7ca0ca tempest-ProjectReaderTests-546992118 None] Lock "cinder-quobyte-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d" released by "delete_volume" :: held 0.801s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:32 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-99d5c885-b51c-4d14-ac6f-ec516f7ca0ca tempest-ProjectReaderTests-546992118 None] Created reservations ['9ddd707b-0889-494b-835c-a56dd07a1daa', 'c7a76a36-e614-4421-8da7-dcf7da29fab0', '52101346-75c1-44fa-9680-a6805c10239f', '653679a9-0792-420a-88df-c7824f71c021'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:28:32 devstack sudo[106575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415.f2234b65-4c32-438f-b823-fd21af9f2def
Nov 05 19:28:32 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-99d5c885-b51c-4d14-ac6f-ec516f7ca0ca tempest-ProjectReaderTests-546992118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:28:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-99d5c885-b51c-4d14-ac6f-ec516f7ca0ca tempest-ProjectReaderTests-546992118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:28:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-99d5c885-b51c-4d14-ac6f-ec516f7ca0ca tempest-ProjectReaderTests-546992118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:28:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-99d5c885-b51c-4d14-ac6f-ec516f7ca0ca tempest-ProjectReaderTests-546992118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:28:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-99d5c885-b51c-4d14-ac6f-ec516f7ca0ca tempest-ProjectReaderTests-546992118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:28:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-99d5c885-b51c-4d14-ac6f-ec516f7ca0ca tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:32 devstack sudo[106577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:28:32 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:32 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:32 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-99d5c885-b51c-4d14-ac6f-ec516f7ca0ca tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.274s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:32 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-99d5c885-b51c-4d14-ac6f-ec516f7ca0ca tempest-ProjectReaderTests-546992118 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:28:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5fd432e4-384b-468f-a5bd-eab8e25c39c5 tempest-ProjectMemberTests-1640873908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415.f2234b65-4c32-438f-b823-fd21af9f2def" returned: 0 in 0.408s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-5fd432e4-384b-468f-a5bd-eab8e25c39c5 tempest-ProjectMemberTests-1640873908 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-779d3f92-8374-40ad-9dd1-1e00608c1415(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:28:32 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-99d5c885-b51c-4d14-ac6f-ec516f7ca0ca tempest-ProjectReaderTests-546992118 None] Deleted volume successfully.
Nov 05 19:28:32 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca949e0-960c-4379-8680-d35f2bc84df8]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:28:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5fd432e4-384b-468f-a5bd-eab8e25c39c5 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:32 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-99d5c885-b51c-4d14-ac6f-ec516f7ca0ca tempest-ProjectReaderTests-546992118 None] Lock "cinder-894ff1ac-eb7c-44b0-ba9d-9c6658b1b96d-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:32 devstack sudo[106583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415
Nov 05 19:28:32 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:32 devstack cinder-volume[87184]: DEBUG cinder.volume.flows.manager.create_volume [None req-76308f47-20b0-47ae-bbdf-596fbc3130fc tempest-ProjectReaderTests-546992118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87184) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 19:28:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-76308f47-20b0-47ae-bbdf-596fbc3130fc tempest-ProjectReaderTests-546992118 None] Flow 'volume_create_manager' (51a07981-99cb-4460-89f8-1d0f61ceda4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:28:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-76308f47-20b0-47ae-bbdf-596fbc3130fc tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd68662-c901-4612-80f5-56ffb2c357dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-76308f47-20b0-47ae-bbdf-596fbc3130fc tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd68662-c901-4612-80f5-56ffb2c357dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1567154414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c022d090-e2cd-4357-a5ff-140a60c0a25e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8b6de85a1d742f78e908c889957f3d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:28:33Z,use_quota=True,user_id='60990ab9a4554795bcd64339eacaa724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:32 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-76308f47-20b0-47ae-bbdf-596fbc3130fc tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbeab993-c5e9-4af9-8db1-5de4fc3d9030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-76308f47-20b0-47ae-bbdf-596fbc3130fc tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbeab993-c5e9-4af9-8db1-5de4fc3d9030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-76308f47-20b0-47ae-bbdf-596fbc3130fc tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad05ea24-16e1-4dee-93bb-d59f815aa256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-76308f47-20b0-47ae-bbdf-596fbc3130fc tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad05ea24-16e1-4dee-93bb-d59f815aa256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c022d090-e2cd-4357-a5ff-140a60c0a25e', 'volume_name': 'volume-c022d090-e2cd-4357-a5ff-140a60c0a25e', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-76308f47-20b0-47ae-bbdf-596fbc3130fc tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b084c51e-47fc-4e26-a601-ff9d2b7baa2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-76308f47-20b0-47ae-bbdf-596fbc3130fc tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b084c51e-47fc-4e26-a601-ff9d2b7baa2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:32 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-76308f47-20b0-47ae-bbdf-596fbc3130fc tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53a6864b-c6cd-4b39-be54-6e63cc048331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:32 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-76308f47-20b0-47ae-bbdf-596fbc3130fc tempest-ProjectReaderTests-546992118 None] Volume c022d090-e2cd-4357-a5ff-140a60c0a25e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c022d090-e2cd-4357-a5ff-140a60c0a25e', 'volume_size': 1}
Nov 05 19:28:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-76308f47-20b0-47ae-bbdf-596fbc3130fc tempest-ProjectReaderTests-546992118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:28:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-76308f47-20b0-47ae-bbdf-596fbc3130fc tempest-ProjectReaderTests-546992118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:28:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-76308f47-20b0-47ae-bbdf-596fbc3130fc tempest-ProjectReaderTests-546992118 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x736632caeab0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T18:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1567154414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c022d090-e2cd-4357-a5ff-140a60c0a25e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8b6de85a1d742f78e908c889957f3d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T18:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T18:28:33Z,use_quota=True,user_id='60990ab9a4554795bcd64339eacaa724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938d6b05-37e8-490c-a1dc-0819b75d69c5),volume_type_id=938d6b05-37e8-490c-a1dc-0819b75d69c5)}" {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 19:28:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-76308f47-20b0-47ae-bbdf-596fbc3130fc tempest-ProjectReaderTests-546992118 None] Creating volume c022d090-e2cd-4357-a5ff-140a60c0a25e {{(pid=87184) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 19:28:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-76308f47-20b0-47ae-bbdf-596fbc3130fc tempest-ProjectReaderTests-546992118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:28:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-76308f47-20b0-47ae-bbdf-596fbc3130fc tempest-ProjectReaderTests-546992118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:28:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-76308f47-20b0-47ae-bbdf-596fbc3130fc tempest-ProjectReaderTests-546992118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:28:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-76308f47-20b0-47ae-bbdf-596fbc3130fc tempest-ProjectReaderTests-546992118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:28:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-76308f47-20b0-47ae-bbdf-596fbc3130fc tempest-ProjectReaderTests-546992118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:28:32 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-76308f47-20b0-47ae-bbdf-596fbc3130fc tempest-ProjectReaderTests-546992118 None] Selected osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec as target Quobyte volume. {{(pid=87184) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 19:28:32 devstack cinder-volume[87184]: INFO cinder.volume.drivers.remotefs [None req-76308f47-20b0-47ae-bbdf-596fbc3130fc tempest-ProjectReaderTests-546992118 None] casted to osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec
Nov 05 19:28:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-76308f47-20b0-47ae-bbdf-596fbc3130fc tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e 1073741824 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5fd432e4-384b-468f-a5bd-eab8e25c39c5 tempest-ProjectMemberTests-1640873908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415" returned: 0 in 0.439s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:32 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5fd432e4-384b-468f-a5bd-eab8e25c39c5 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415.f2234b65-4c32-438f-b823-fd21af9f2def {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:32 devstack sudo[106588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e 1073741824
Nov 05 19:28:32 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:32 devstack sudo[106589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415.f2234b65-4c32-438f-b823-fd21af9f2def
Nov 05 19:28:32 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:33 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5fd432e4-384b-468f-a5bd-eab8e25c39c5 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415.f2234b65-4c32-438f-b823-fd21af9f2def" returned: 0 in 0.332s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5fd432e4-384b-468f-a5bd-eab8e25c39c5 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415.f2234b65-4c32-438f-b823-fd21af9f2def {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:33 devstack sudo[106599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415.f2234b65-4c32-438f-b823-fd21af9f2def
Nov 05 19:28:33 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:33 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-76308f47-20b0-47ae-bbdf-596fbc3130fc tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e 1073741824" returned: 0 in 0.438s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-76308f47-20b0-47ae-bbdf-596fbc3130fc tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:33 devstack sudo[106601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e
Nov 05 19:28:33 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:33 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-5fd432e4-384b-468f-a5bd-eab8e25c39c5 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415.f2234b65-4c32-438f-b823-fd21af9f2def" returned: 0 in 0.267s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5fd432e4-384b-468f-a5bd-eab8e25c39c5 tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-f2234b65-4c32-438f-b823-fd21af9f2def" released by "_delete_snapshot" :: held 1.565s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5fd432e4-384b-468f-a5bd-eab8e25c39c5 tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-779d3f92-8374-40ad-9dd1-1e00608c1415" released by "delete_snapshot" :: held 1.588s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:33 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-5fd432e4-384b-468f-a5bd-eab8e25c39c5 tempest-ProjectMemberTests-1640873908 None] Created reservations ['7da6cf3f-7c30-4e57-8b09-d7c03f157833', '076afabd-b196-4ad5-a3cb-9f9b936de576', '8d66ef06-8d9c-40f2-9732-9a7abf29ad6d', '54bdcff5-dd9b-4647-b604-c7971633a76f'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:28:33 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-76308f47-20b0-47ae-bbdf-596fbc3130fc tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e" returned: 0 in 0.256s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-76308f47-20b0-47ae-bbdf-596fbc3130fc tempest-ProjectReaderTests-546992118 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'} {{(pid=87184) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 19:28:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-76308f47-20b0-47ae-bbdf-596fbc3130fc tempest-ProjectReaderTests-546992118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:28:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-76308f47-20b0-47ae-bbdf-596fbc3130fc tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53a6864b-c6cd-4b39-be54-6e63cc048331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c022d090-e2cd-4357-a5ff-140a60c0a25e', 'volume_size': 1}' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-76308f47-20b0-47ae-bbdf-596fbc3130fc tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fcc77eb-a085-4739-8247-3a446ea1202d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 19:28:33 devstack cinder-volume[87184]: INFO cinder.volume.flows.manager.create_volume [None req-76308f47-20b0-47ae-bbdf-596fbc3130fc tempest-ProjectReaderTests-546992118 None] Volume volume-c022d090-e2cd-4357-a5ff-140a60c0a25e (c022d090-e2cd-4357-a5ff-140a60c0a25e): created successfully
Nov 05 19:28:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-76308f47-20b0-47ae-bbdf-596fbc3130fc tempest-ProjectReaderTests-546992118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fcc77eb-a085-4739-8247-3a446ea1202d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87184) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 19:28:33 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-76308f47-20b0-47ae-bbdf-596fbc3130fc tempest-ProjectReaderTests-546992118 None] Flow 'volume_create_manager' (51a07981-99cb-4460-89f8-1d0f61ceda4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87184) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 19:28:33 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-76308f47-20b0-47ae-bbdf-596fbc3130fc tempest-ProjectReaderTests-546992118 None] Created volume successfully.
Nov 05 19:28:33 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-5fd432e4-384b-468f-a5bd-eab8e25c39c5 tempest-ProjectMemberTests-1640873908 None] Delete snapshot completed successfully.
Nov 05 19:28:33 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-5fd432e4-384b-468f-a5bd-eab8e25c39c5 tempest-ProjectMemberTests-1640873908 None] Lock "cinder-f2234b65-4c32-438f-b823-fd21af9f2def-delete_snapshot" released by "delete_snapshot" :: held 1.786s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e58ebbd2-0143-4d2c-8f58-0d14f6e3c94a tempest-ProjectReaderTests-546992118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:28:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e58ebbd2-0143-4d2c-8f58-0d14f6e3c94a tempest-ProjectReaderTests-546992118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:28:33 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-e58ebbd2-0143-4d2c-8f58-0d14f6e3c94a tempest-ProjectReaderTests-546992118 None] Creating offline snapshot 8d31f553-d515-49ab-83b3-e307c9f2bdf0 of volume c022d090-e2cd-4357-a5ff-140a60c0a25e {{(pid=87184) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 19:28:33 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8fa62d-c4f6-4ed6-b1f2-e0b25357eafb]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:28:33 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e58ebbd2-0143-4d2c-8f58-0d14f6e3c94a tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-63c51872-aee6-418d-9cd8-32f190b95938 tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-779d3f92-8374-40ad-9dd1-1e00608c1415-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-63c51872-aee6-418d-9cd8-32f190b95938 tempest-ProjectMemberTests-1640873908 None] Lock "cinder-779d3f92-8374-40ad-9dd1-1e00608c1415-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:34 devstack sudo[106605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e
Nov 05 19:28:34 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-63c51872-aee6-418d-9cd8-32f190b95938 tempest-ProjectMemberTests-1640873908 None] Acquiring lock "cinder-quobyte-779d3f92-8374-40ad-9dd1-1e00608c1415" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-63c51872-aee6-418d-9cd8-32f190b95938 tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-779d3f92-8374-40ad-9dd1-1e00608c1415" acquired by "delete_volume" :: waited 0.021s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:34 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a6b220-2380-46b6-9377-37ccd470875e]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:28:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-63c51872-aee6-418d-9cd8-32f190b95938 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:34 devstack sudo[106607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415
Nov 05 19:28:34 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:34 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e58ebbd2-0143-4d2c-8f58-0d14f6e3c94a tempest-ProjectReaderTests-546992118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e" returned: 0 in 0.399s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e58ebbd2-0143-4d2c-8f58-0d14f6e3c94a tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e.8d31f553-d515-49ab-83b3-e307c9f2bdf0 1G {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:34 devstack sudo[106612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e.8d31f553-d515-49ab-83b3-e307c9f2bdf0 1G
Nov 05 19:28:34 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:34 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-63c51872-aee6-418d-9cd8-32f190b95938 tempest-ProjectMemberTests-1640873908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415" returned: 0 in 0.371s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-63c51872-aee6-418d-9cd8-32f190b95938 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:34 devstack sudo[106617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415
Nov 05 19:28:34 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:34 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e58ebbd2-0143-4d2c-8f58-0d14f6e3c94a tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e.8d31f553-d515-49ab-83b3-e307c9f2bdf0 1G" returned: 0 in 0.420s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e58ebbd2-0143-4d2c-8f58-0d14f6e3c94a tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c022d090-e2cd-4357-a5ff-140a60c0a25e -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e.8d31f553-d515-49ab-83b3-e307c9f2bdf0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:34 devstack sudo[106623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c022d090-e2cd-4357-a5ff-140a60c0a25e -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e.8d31f553-d515-49ab-83b3-e307c9f2bdf0
Nov 05 19:28:34 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:34 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:34 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-63c51872-aee6-418d-9cd8-32f190b95938 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-779d3f92-8374-40ad-9dd1-1e00608c1415" returned: 0 in 0.285s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:34 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-63c51872-aee6-418d-9cd8-32f190b95938 tempest-ProjectMemberTests-1640873908 None] Lock "cinder-quobyte-779d3f92-8374-40ad-9dd1-1e00608c1415" released by "delete_volume" :: held 0.725s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:34 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-63c51872-aee6-418d-9cd8-32f190b95938 tempest-ProjectMemberTests-1640873908 None] Created reservations ['1e55069d-aa68-44af-a266-483870d975bb', '7cfdd622-5731-4d5c-bc3e-63868b75104c', '6de386fc-19d0-4485-836f-01f3760cd6fc', 'e94484d8-3fb1-4a84-8467-686bbd89779e'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:28:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-63c51872-aee6-418d-9cd8-32f190b95938 tempest-ProjectMemberTests-1640873908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:28:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-63c51872-aee6-418d-9cd8-32f190b95938 tempest-ProjectMemberTests-1640873908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:28:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-63c51872-aee6-418d-9cd8-32f190b95938 tempest-ProjectMemberTests-1640873908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:28:35 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-63c51872-aee6-418d-9cd8-32f190b95938 tempest-ProjectMemberTests-1640873908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:28:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-63c51872-aee6-418d-9cd8-32f190b95938 tempest-ProjectMemberTests-1640873908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:28:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-63c51872-aee6-418d-9cd8-32f190b95938 tempest-ProjectMemberTests-1640873908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:35 devstack sudo[106625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:28:35 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:35 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e58ebbd2-0143-4d2c-8f58-0d14f6e3c94a tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c022d090-e2cd-4357-a5ff-140a60c0a25e -F qcow2 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e.8d31f553-d515-49ab-83b3-e307c9f2bdf0" returned: 0 in 0.302s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:35 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-e58ebbd2-0143-4d2c-8f58-0d14f6e3c94a tempest-ProjectReaderTests-546992118 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e.8d31f553-d515-49ab-83b3-e307c9f2bdf0 is being set with open permissions: ugo+rw
Nov 05 19:28:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e58ebbd2-0143-4d2c-8f58-0d14f6e3c94a tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e.8d31f553-d515-49ab-83b3-e307c9f2bdf0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:35 devstack sudo[106630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e.8d31f553-d515-49ab-83b3-e307c9f2bdf0
Nov 05 19:28:35 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:35 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-63c51872-aee6-418d-9cd8-32f190b95938 tempest-ProjectMemberTests-1640873908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.269s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:35 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-63c51872-aee6-418d-9cd8-32f190b95938 tempest-ProjectMemberTests-1640873908 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:28:35 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-63c51872-aee6-418d-9cd8-32f190b95938 tempest-ProjectMemberTests-1640873908 None] Deleted volume successfully.
Nov 05 19:28:35 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-63c51872-aee6-418d-9cd8-32f190b95938 tempest-ProjectMemberTests-1640873908 None] Lock "cinder-779d3f92-8374-40ad-9dd1-1e00608c1415-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:35 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e58ebbd2-0143-4d2c-8f58-0d14f6e3c94a tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e.8d31f553-d515-49ab-83b3-e307c9f2bdf0" returned: 0 in 0.281s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e58ebbd2-0143-4d2c-8f58-0d14f6e3c94a tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:35 devstack sudo[106634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e.info
Nov 05 19:28:35 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:35 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e58ebbd2-0143-4d2c-8f58-0d14f6e3c94a tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e.info" returned: 0 in 0.267s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:35 devstack cinder-volume[87184]: WARNING cinder.volume.drivers.remotefs [None req-e58ebbd2-0143-4d2c-8f58-0d14f6e3c94a tempest-ProjectReaderTests-546992118 None] /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e.info is being set with open permissions: ugo+rw
Nov 05 19:28:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e58ebbd2-0143-4d2c-8f58-0d14f6e3c94a tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e.info {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:35 devstack sudo[106638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e.info
Nov 05 19:28:35 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:35 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-e58ebbd2-0143-4d2c-8f58-0d14f6e3c94a tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e.info" returned: 0 in 0.260s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:35 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-e58ebbd2-0143-4d2c-8f58-0d14f6e3c94a tempest-ProjectReaderTests-546992118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.011s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:28:36 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-e58ebbd2-0143-4d2c-8f58-0d14f6e3c94a tempest-ProjectReaderTests-546992118 None] Create snapshot completed successfully
Nov 05 19:28:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-384db86e-ea1d-4a4b-a54f-41914dcfa7b0 tempest-ProjectReaderTests-546992118 None] Acquiring lock "cinder-8d31f553-d515-49ab-83b3-e307c9f2bdf0-delete_snapshot" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-384db86e-ea1d-4a4b-a54f-41914dcfa7b0 tempest-ProjectReaderTests-546992118 None] Lock "cinder-8d31f553-d515-49ab-83b3-e307c9f2bdf0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-384db86e-ea1d-4a4b-a54f-41914dcfa7b0 tempest-ProjectReaderTests-546992118 None] Acquiring lock "cinder-quobyte-c022d090-e2cd-4357-a5ff-140a60c0a25e" by "delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-384db86e-ea1d-4a4b-a54f-41914dcfa7b0 tempest-ProjectReaderTests-546992118 None] Lock "cinder-quobyte-c022d090-e2cd-4357-a5ff-140a60c0a25e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-384db86e-ea1d-4a4b-a54f-41914dcfa7b0 tempest-ProjectReaderTests-546992118 None] Acquiring lock "cinder-quobyte-8d31f553-d515-49ab-83b3-e307c9f2bdf0" by "_delete_snapshot" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:37 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-384db86e-ea1d-4a4b-a54f-41914dcfa7b0 tempest-ProjectReaderTests-546992118 None] Lock "cinder-quobyte-8d31f553-d515-49ab-83b3-e307c9f2bdf0" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-384db86e-ea1d-4a4b-a54f-41914dcfa7b0 tempest-ProjectReaderTests-546992118 None] Deleting offline snapshot 8d31f553-d515-49ab-83b3-e307c9f2bdf0 of volume c022d090-e2cd-4357-a5ff-140a60c0a25e {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 19:28:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-384db86e-ea1d-4a4b-a54f-41914dcfa7b0 tempest-ProjectReaderTests-546992118 None] snapshot_file for this snap is: volume-c022d090-e2cd-4357-a5ff-140a60c0a25e.8d31f553-d515-49ab-83b3-e307c9f2bdf0 {{(pid=87184) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 19:28:37 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03c4698-3738-4fd8-b011-440b0d20c087]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:28:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-384db86e-ea1d-4a4b-a54f-41914dcfa7b0 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e.8d31f553-d515-49ab-83b3-e307c9f2bdf0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:37 devstack sudo[106642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e.8d31f553-d515-49ab-83b3-e307c9f2bdf0
Nov 05 19:28:37 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:37 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-384db86e-ea1d-4a4b-a54f-41914dcfa7b0 tempest-ProjectReaderTests-546992118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e.8d31f553-d515-49ab-83b3-e307c9f2bdf0" returned: 0 in 0.382s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:37 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.remotefs [None req-384db86e-ea1d-4a4b-a54f-41914dcfa7b0 tempest-ProjectReaderTests-546992118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c022d090-e2cd-4357-a5ff-140a60c0a25e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87184) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 19:28:37 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f04683-082d-467a-9324-57f6f9f351f8]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:28:37 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-384db86e-ea1d-4a4b-a54f-41914dcfa7b0 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:37 devstack sudo[106648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e
Nov 05 19:28:37 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:38 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-384db86e-ea1d-4a4b-a54f-41914dcfa7b0 tempest-ProjectReaderTests-546992118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e" returned: 0 in 0.364s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-384db86e-ea1d-4a4b-a54f-41914dcfa7b0 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e.8d31f553-d515-49ab-83b3-e307c9f2bdf0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:38 devstack sudo[106653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e.8d31f553-d515-49ab-83b3-e307c9f2bdf0
Nov 05 19:28:38 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:38 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-384db86e-ea1d-4a4b-a54f-41914dcfa7b0 tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e.8d31f553-d515-49ab-83b3-e307c9f2bdf0" returned: 0 in 0.347s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-384db86e-ea1d-4a4b-a54f-41914dcfa7b0 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e.8d31f553-d515-49ab-83b3-e307c9f2bdf0 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:38 devstack sudo[106659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e.8d31f553-d515-49ab-83b3-e307c9f2bdf0
Nov 05 19:28:38 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:38 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:38 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-384db86e-ea1d-4a4b-a54f-41914dcfa7b0 tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e.8d31f553-d515-49ab-83b3-e307c9f2bdf0" returned: 0 in 0.266s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-384db86e-ea1d-4a4b-a54f-41914dcfa7b0 tempest-ProjectReaderTests-546992118 None] Lock "cinder-quobyte-8d31f553-d515-49ab-83b3-e307c9f2bdf0" released by "_delete_snapshot" :: held 1.487s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-384db86e-ea1d-4a4b-a54f-41914dcfa7b0 tempest-ProjectReaderTests-546992118 None] Lock "cinder-quobyte-c022d090-e2cd-4357-a5ff-140a60c0a25e" released by "delete_snapshot" :: held 1.514s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:38 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-384db86e-ea1d-4a4b-a54f-41914dcfa7b0 tempest-ProjectReaderTests-546992118 None] Created reservations ['9091502e-7f2a-4f09-8f32-dd7488cd0581', '2c9ea87b-0973-4f0d-b9e9-0721b63f639e', '929a2f5e-c0d5-4a6b-8256-9372c3c0cb2c', '3827ab1e-0bd6-4758-9df6-188077211e19'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:28:38 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-384db86e-ea1d-4a4b-a54f-41914dcfa7b0 tempest-ProjectReaderTests-546992118 None] Delete snapshot completed successfully.
Nov 05 19:28:38 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-384db86e-ea1d-4a4b-a54f-41914dcfa7b0 tempest-ProjectReaderTests-546992118 None] Lock "cinder-8d31f553-d515-49ab-83b3-e307c9f2bdf0-delete_snapshot" released by "delete_snapshot" :: held 1.670s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8d445256-044b-43ea-9104-f6a2cef9be62 tempest-ProjectReaderTests-546992118 None] Acquiring lock "cinder-c022d090-e2cd-4357-a5ff-140a60c0a25e-delete_volume" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8d445256-044b-43ea-9104-f6a2cef9be62 tempest-ProjectReaderTests-546992118 None] Lock "cinder-c022d090-e2cd-4357-a5ff-140a60c0a25e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8d445256-044b-43ea-9104-f6a2cef9be62 tempest-ProjectReaderTests-546992118 None] Acquiring lock "cinder-quobyte-c022d090-e2cd-4357-a5ff-140a60c0a25e" by "delete_volume" {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 19:28:39 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8d445256-044b-43ea-9104-f6a2cef9be62 tempest-ProjectReaderTests-546992118 None] Lock "cinder-quobyte-c022d090-e2cd-4357-a5ff-140a60c0a25e" acquired by "delete_volume" :: waited 0.017s {{(pid=87184) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 19:28:39 devstack cinder-volume[87184]: DEBUG oslo.privsep.daemon [-] privsep: reply[066e9b02-66f9-4ebb-abcb-4aa63ff812fe]: (4, 'qcow2') {{(pid=88367) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 19:28:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8d445256-044b-43ea-9104-f6a2cef9be62 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:39 devstack sudo[106668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e
Nov 05 19:28:39 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:39 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8d445256-044b-43ea-9104-f6a2cef9be62 tempest-ProjectReaderTests-546992118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e" returned: 0 in 0.364s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:39 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8d445256-044b-43ea-9104-f6a2cef9be62 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:39 devstack sudo[106674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e
Nov 05 19:28:39 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:40 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8d445256-044b-43ea-9104-f6a2cef9be62 tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39/volume-c022d090-e2cd-4357-a5ff-140a60c0a25e" returned: 0 in 0.266s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8d445256-044b-43ea-9104-f6a2cef9be62 tempest-ProjectReaderTests-546992118 None] Lock "cinder-quobyte-c022d090-e2cd-4357-a5ff-140a60c0a25e" released by "delete_volume" :: held 0.698s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:40 devstack cinder-volume[87184]: DEBUG cinder.quota [None req-8d445256-044b-43ea-9104-f6a2cef9be62 tempest-ProjectReaderTests-546992118 None] Created reservations ['268e62f4-4548-44ad-ace6-92a3f88101d3', '59330dc9-2657-4d9d-924f-3ff7b98da3ea', 'df29fbb2-e642-46b0-8108-c3383ba48bd6', 'bf693d98-f219-420d-8bea-2077b38abd9b'] {{(pid=87184) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 19:28:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8d445256-044b-43ea-9104-f6a2cef9be62 tempest-ProjectReaderTests-546992118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:28:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8d445256-044b-43ea-9104-f6a2cef9be62 tempest-ProjectReaderTests-546992118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:28:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8d445256-044b-43ea-9104-f6a2cef9be62 tempest-ProjectReaderTests-546992118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:28:40 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-8d445256-044b-43ea-9104-f6a2cef9be62 tempest-ProjectReaderTests-546992118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:28:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-8d445256-044b-43ea-9104-f6a2cef9be62 tempest-ProjectReaderTests-546992118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:28:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8d445256-044b-43ea-9104-f6a2cef9be62 tempest-ProjectReaderTests-546992118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:28:40 devstack sudo[106677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:28:40 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:28:40 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root
Nov 05 19:28:40 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-8d445256-044b-43ea-9104-f6a2cef9be62 tempest-ProjectReaderTests-546992118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.270s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:28:40 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-8d445256-044b-43ea-9104-f6a2cef9be62 tempest-ProjectReaderTests-546992118 None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:28:40 devstack cinder-volume[87184]: INFO cinder.volume.manager [None req-8d445256-044b-43ea-9104-f6a2cef9be62 tempest-ProjectReaderTests-546992118 None] Deleted volume successfully.
Nov 05 19:28:40 devstack cinder-volume[87184]: DEBUG cinder.coordination [None req-8d445256-044b-43ea-9104-f6a2cef9be62 tempest-ProjectReaderTests-546992118 None] Lock "cinder-c022d090-e2cd-4357-a5ff-140a60c0a25e-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=87184) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 19:28:50 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:UPDATE=74,cinder:SELECT=45,cinder:DELETE=3,cinder:INSERT=19 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:28:50 devstack cinder-volume[87184]: DEBUG dbcounter [-] [87184] Writing DB stats cinder:INSERT=22,cinder:UPDATE=70,cinder:SELECT=59,cinder:DELETE=7 {{(pid=87184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 19:29:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:29:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 19:29:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 19:29:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec': None} {{(pid=87184) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 19:29:05 devstack cinder-volume[87184]: DEBUG cinder.volume.drivers.quobyte [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8414ad42-c46b-4448-97c3-6dfaca2de5ec'] {{(pid=87184) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 19:29:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.lockutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87184) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 19:29:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39 {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 19:29:05 devstack sudo[106847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39
Nov 05 19:29:05 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 19:29:05 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root
Nov 05 19:29:05 devstack cinder-volume[87184]: DEBUG oslo_concurrency.processutils [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6c834f9cc42ffd167c43bc169e56de39" returned: 0 in 0.256s {{(pid=87184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 19:29:05 devstack cinder-volume[87184]: DEBUG cinder.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Notifying Schedulers of capabilities ... {{(pid=87184) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 19:29:05 devstack cinder-volume[87184]: DEBUG oslo_service.periodic_task [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] Running periodic task VolumeManager._thread_info {{(pid=87184) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 19:29:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread count: 28 {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 19:29:05 devstack cinder-volume[87184]: DEBUG cinder.volume.manager [None req-28a9212f-3a66-44c7-b8e7-286453477544 None None] thread info: [<_MainThread(MainThread, started 126882883072128)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126882770872512)>, <Thread(Thread-3 (stat_writer), started daemon 126882769837376)>, <Thread(Rabbit-heartbeat, started daemon 126882768896256)>, <Thread(Thread-5 (_runner), started daemon 126882768980928)>, <Thread(Thread-7 (_runner), started daemon 126882767016448)>, <Thread(fd_logger, started daemon 126882764561216)>, <Thread(privsep_reader, started daemon 126882764568576)>, <Thread(tpool_thread_0, started daemon 126882759292608)>, <Thread(tpool_thread_1, started daemon 126882750899904)>, <Thread(tpool_thread_2, started daemon 126882742507200)>, <Thread(tpool_thread_3, started daemon 126882734114496)>, <Thread(tpool_thread_4, started daemon 126882725721792)>, <Thread(tpool_thread_5, started daemon 126882717329088)>, <Thread(tpool_thread_6, started daemon 126882708920000)>, <Thread(tpool_thread_7, started daemon 126882700510912)>, <Thread(tpool_thread_8, started daemon 126882692101824)>, <Thread(tpool_thread_9, started daemon 126882683692736)>, <Thread(tpool_thread_10, started daemon 126882675283648)>, <Thread(tpool_thread_11, started daemon 126882666874560)>, <Thread(tpool_thread_12, started daemon 126882658465472)>, <Thread(tpool_thread_13, started daemon 126882650056384)>, <Thread(tpool_thread_14, started daemon 126882641647296)>, <Thread(tpool_thread_15, started daemon 126882633238208)>, <Thread(tpool_thread_16, started daemon 126882624829120)>, <Thread(tpool_thread_17, started daemon 126882616420032)>, <Thread(tpool_thread_18, started daemon 126882608010944)>, <Thread(tpool_thread_19, started daemon 126882599601856)>] {{(pid=87184) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}